bosh deploy fails while updating job blobstore_z1 > blobstore_z1/0

Hi all,
I am deploying CF using BOSH and i am getting this error:
Error 400007: 'blobstore_z1/0 (0eb27491-096c-4506-98b8-e06763d7f996)' is not running after update. Review logs for failed jobs: blobstore_nginx
Here is the log from bosh task:
/var/vcap/packages/director/gem_home/ruby/2.3.0/gems/bosh-director-1.3262.3.0/lib/bosh/director/instance_updater/state_applier.rb:48:in `post_start'
/var/vcap/packages/director/gem_home/ruby/2.3.0/gems/bosh-director-1.3262.3.0/lib/bosh/director/instance_updater/state_applier.rb:30:in `apply'
/var/vcap/packages/director/gem_home/ruby/2.3.0/gems/bosh-director-1.3262.3.0/lib/bosh/director/instance_updater.rb:109:in `block in update'
/var/vcap/packages/director/gem_home/ruby/2.3.0/gems/bosh-director-1.3262.3.0/lib/bosh/director/instance_updater/instance_state.rb:5:in `with_instance_update'
/var/vcap/packages/director/gem_home/ruby/2.3.0/gems/bosh-director-1.3262.3.0/lib/bosh/director/instance_updater/instance_state.rb:11:in `with_instance_update_and_event_creation'
/var/vcap/packages/director/gem_home/ruby/2.3.0/gems/bosh-director-1.3262.3.0/lib/bosh/director/instance_updater.rb:111:in `update'
/var/vcap/packages/director/gem_home/ruby/2.3.0/gems/bosh-director-1.3262.3.0/lib/bosh/director/job_updater.rb:113:in `block (2 levels) in update_canary_instance'
/var/vcap/packages/director/gem_home/ruby/2.3.0/gems/bosh_common-1.3262.3.0/lib/common/thread_formatter.rb:49:in `with_thread_name'
/var/vcap/packages/director/gem_home/ruby/2.3.0/gems/bosh-director-1.3262.3.0/lib/bosh/director/job_updater.rb:111:in `block in update_canary_instance'
/var/vcap/packages/director/gem_home/ruby/2.3.0/gems/bosh-director-1.3262.3.0/lib/bosh/director/event_log.rb:99:in `advance_and_track'
/var/vcap/packages/director/gem_home/ruby/2.3.0/gems/bosh-director-1.3262.3.0/lib/bosh/director/job_updater.rb:110:in `update_canary_instance'
/var/vcap/packages/director/gem_home/ruby/2.3.0/gems/bosh-director-1.3262.3.0/lib/bosh/director/job_updater.rb:105:in `block (2 levels) in update_canaries'
/var/vcap/packages/director/gem_home/ruby/2.3.0/gems/bosh_common-1.3262.3.0/lib/common/thread_pool.rb:77:in `block (2 levels) in create_thread'
/var/vcap/packages/director/gem_home/ruby/2.3.0/gems/bosh_common-1.3262.3.0/lib/common/thread_pool.rb:63:in `loop'
/var/vcap/packages/director/gem_home/ruby/2.3.0/gems/bosh_common-1.3262.3.0/lib/common/thread_pool.rb:63:in `block in create_thread'
/var/vcap/packages/director/gem_home/ruby/2.3.0/gems/logging-1.8.2/lib/logging/diagnostic_context.rb:323:in `block in create_with_logging_context'
E, [2016-07-28 22:29:47 #19665] [] ERROR -- DirectorJobRunner: Worker thread raised exception: 'blobstore_z1/0 (0eb27491-096c-4506-98b8-e06763d7f996)' is not running after update. Review logs for failed jobs: blobstore_nginx - /var/vcap/packages/director/gem_home/ruby/2.3.0/gems/bosh-director-1.3262.3.0/lib/bosh/director/instance_updater/state_applier.rb:48:in `post_start'
/var/vcap/packages/director/gem_home/ruby/2.3.0/gems/bosh-director-1.3262.3.0/lib/bosh/director/instance_updater/state_applier.rb:30:in `apply'
/var/vcap/packages/director/gem_home/ruby/2.3.0/gems/bosh-director-1.3262.3.0/lib/bosh/director/instance_updater.rb:109:in `block in update'
/var/vcap/packages/director/gem_home/ruby/2.3.0/gems/bosh-director-1.3262.3.0/lib/bosh/director/instance_updater/instance_state.rb:5:in `with_instance_update'
/var/vcap/packages/director/gem_home/ruby/2.3.0/gems/bosh-director-1.3262.3.0/lib/bosh/director/instance_updater/instance_state.rb:11:in `with_instance_update_and_event_creation'
/var/vcap/packages/director/gem_home/ruby/2.3.0/gems/bosh-director-1.3262.3.0/lib/bosh/director/instance_updater.rb:111:in `update'
/var/vcap/packages/director/gem_home/ruby/2.3.0/gems/bosh-director-1.3262.3.0/lib/bosh/director/job_updater.rb:113:in `block (2 levels) in update_canary_instance'
/var/vcap/packages/director/gem_home/ruby/2.3.0/gems/bosh_common-1.3262.3.0/lib/common/thread_formatter.rb:49:in `with_thread_name'
/var/vcap/packages/director/gem_home/ruby/2.3.0/gems/bosh-director-1.3262.3.0/lib/bosh/director/job_updater.rb:111:in `block in update_canary_instance'
/var/vcap/packages/director/gem_home/ruby/2.3.0/gems/bosh-director-1.3262.3.0/lib/bosh/director/event_log.rb:99:in `advance_and_track'
/var/vcap/packages/director/gem_home/ruby/2.3.0/gems/bosh-director-1.3262.3.0/lib/bosh/director/job_updater.rb:110:in `update_canary_instance'
/var/vcap/packages/director/gem_home/ruby/2.3.0/gems/bosh-director-1.3262.3.0/lib/bosh/director/job_updater.rb:105:in `block (2 levels) in update_canaries'
/var/vcap/packages/director/gem_home/ruby/2.3.0/gems/bosh_common-1.3262.3.0/lib/common/thread_pool.rb:77:in `block (2 levels) in create_thread'
/var/vcap/packages/director/gem_home/ruby/2.3.0/gems/bosh_common-1.3262.3.0/lib/common/thread_pool.rb:63:in `loop'
/var/vcap/packages/director/gem_home/ruby/2.3.0/gems/bosh_common-1.3262.3.0/lib/common/thread_pool.rb:63:in `block in create_thread'
/var/vcap/packages/director/gem_home/ruby/2.3.0/gems/logging-1.8.2/lib/logging/diagnostic_context.rb:323:in `block in create_with_logging_context'
D, [2016-07-28 22:29:47 #19665] [] DEBUG -- DirectorJobRunner: Thread is no longer needed, cleaning up

Output of bosh vms command:
+---------------------------------------------------------------------------+---------+-----+-----------+---------------+
| VM                                                                        | State   | AZ  | VM Type   | IPs           |
+---------------------------------------------------------------------------+---------+-----+-----------+---------------+
| api_z1/0 (c26b3732-7294-43d6-8eb7-e773dd84824f)                           | running | n/a | large_z1  | <IP_ADDRESS>   |
| blobstore_z1/0 (0eb27491-096c-4506-98b8-e06763d7f996)                     | failing | n/a | medium_z1 | <IP_ADDRESS>   |
| consul_z1/0 (517d10bf-637a-470f-97ac-48ecc5549e9c)                        | running | n/a | small_z1  | <IP_ADDRESS>   |
| doppler_z1/0 (6c672830-e1c0-4998-8d20-06e29be5a733)                       | running | n/a | medium_z1 | <IP_ADDRESS>   |
| etcd_z1/0 (28e6d628-5b77-4d3f-8882-865a377e9946)                          | running | n/a | medium_z1 | <IP_ADDRESS>   |
| ha_proxy_z1/0 (77732d60-ac2e-4be0-bfa1-59ff5f75ce37)                      | running | n/a | router_z1 | <IP_ADDRESS> |
|                                                                           |         |     |           | <IP_ADDRESS>   |
| hm9000_z1/0 (e2f9d941-e8a2-49cb-a3ed-59c8f8cecf30)                        | running | n/a | medium_z1 | <IP_ADDRESS>   |
| loggregator_trafficcontroller_z1/0 (39ab5e4f-0a8a-4cbd-bc5d-25c35420a362) | running | n/a | small_z1  | <IP_ADDRESS>   |
| nats_z1/0 (d5829968-5616-4d51-bb32-d5f906273aae)                          | running | n/a | medium_z1 | <IP_ADDRESS>   |
| postgres_z1/0 (3065a829-4f96-433d-a76b-dcc1ecf30c03)                      | running | n/a | medium_z1 | <IP_ADDRESS>   |
| router_z1/0 (b3c8d635-47ee-41e7-b38b-28690eb1167d)                        | running | n/a | router_z1 | <IP_ADDRESS>   |
| runner_z1/0 (2fd481fa-dc8b-458c-8d68-ae9f7a542d71)                        | running | n/a | runner_z1 | <IP_ADDRESS>   |
| stats_z1/0 (6279e637-7c4d-4355-8752-c6f45641dc2e)                         | running | n/a | small_z1  | <IP_ADDRESS>   |
| uaa_z1/0 (17488c94-2fa5-4085-8f2f-54bf67ec5059)                           | running | n/a | medium_z1 | <IP_ADDRESS>   |
+---------------------------------------------------------------------------+---------+-----+-----------+---------------+

output of bosh instances --ps
+----------------------------------------------------------------------------+---------+-----+-----------+---------------+
| Instance                                                                   | State   | AZ  | VM Type   | IPs           |
+----------------------------------------------------------------------------+---------+-----+-----------+---------------+
| api_z1/0 (c26b3732-7294-43d6-8eb7-e773dd84824f)*                           | running | n/a | large_z1  | <IP_ADDRESS>   |
+----------------------------------------------------------------------------+---------+-----+-----------+---------------+
| blobstore_z1/0 (0eb27491-096c-4506-98b8-e06763d7f996)*                     | failing | n/a | medium_z1 | <IP_ADDRESS>   |
|   consul_agent                                                             | running |     |           |               |
|   metron_agent                                                             | running |     |           |               |
|   blobstore_nginx                                                          | unknown |     |           |               |
|   blobstore_url_signer                                                     | running |     |           |               |
|   route_registrar                                                          | running |     |           |               |
+----------------------------------------------------------------------------+---------+-----+-----------+---------------+
| consul_z1/0 (517d10bf-637a-470f-97ac-48ecc5549e9c)*                        | running | n/a | small_z1  | <IP_ADDRESS>   |
|   consul_agent                                                             | running |     |           |               |
|   metron_agent                                                             | running |     |           |               |
+----------------------------------------------------------------------------+---------+-----+-----------+---------------+
| doppler_z1/0 (6c672830-e1c0-4998-8d20-06e29be5a733)*                       | running | n/a | medium_z1 | <IP_ADDRESS>   |
+----------------------------------------------------------------------------+---------+-----+-----------+---------------+
| etcd_z1/0 (28e6d628-5b77-4d3f-8882-865a377e9946)*                          | running | n/a | medium_z1 | <IP_ADDRESS>   |
|   etcd                                                                     | running |     |           |               |
|   etcd_metrics_server                                                      | running |     |           |               |
|   metron_agent                                                             | running |     |           |               |
+----------------------------------------------------------------------------+---------+-----+-----------+---------------+
| ha_proxy_z1/0 (77732d60-ac2e-4be0-bfa1-59ff5f75ce37)*                      | running | n/a | router_z1 | <IP_ADDRESS> |
|                                                                            |         |     |           | <IP_ADDRESS>   |
|   consul_template                                                          | running |     |           |               |
|   haproxy_config                                                           | running |     |           |               |
|   haproxy                                                                  | running |     |           |               |
|   metron_agent                                                             | running |     |           |               |
|   consul_agent                                                             | running |     |           |               |
+----------------------------------------------------------------------------+---------+-----+-----------+---------------+
| hm9000_z1/0 (e2f9d941-e8a2-49cb-a3ed-59c8f8cecf30)*                        | running | n/a | medium_z1 | <IP_ADDRESS>   |
+----------------------------------------------------------------------------+---------+-----+-----------+---------------+
| loggregator_trafficcontroller_z1/0 (39ab5e4f-0a8a-4cbd-bc5d-25c35420a362)* | running | n/a | small_z1  | <IP_ADDRESS>   |
+----------------------------------------------------------------------------+---------+-----+-----------+---------------+
| nats_z1/0 (d5829968-5616-4d51-bb32-d5f906273aae)*                          | running | n/a | medium_z1 | <IP_ADDRESS>   |
|   nats                                                                     | running |     |           |               |
|   nats_stream_forwarder                                                    | running |     |           |               |
|   metron_agent                                                             | running |     |           |               |
+----------------------------------------------------------------------------+---------+-----+-----------+---------------+
| postgres_z1/0 (3065a829-4f96-433d-a76b-dcc1ecf30c03)*                      | running | n/a | medium_z1 | <IP_ADDRESS>   |
+----------------------------------------------------------------------------+---------+-----+-----------+---------------+
| router_z1/0 (b3c8d635-47ee-41e7-b38b-28690eb1167d)*                        | running | n/a | router_z1 | <IP_ADDRESS>   |
+----------------------------------------------------------------------------+---------+-----+-----------+---------------+
| runner_z1/0 (2fd481fa-dc8b-458c-8d68-ae9f7a542d71)*                        | running | n/a | runner_z1 | <IP_ADDRESS>   |
+----------------------------------------------------------------------------+---------+-----+-----------+---------------+
| stats_z1/0 (6279e637-7c4d-4355-8752-c6f45641dc2e)*                         | running | n/a | small_z1  | <IP_ADDRESS>   |
|   collector                                                                | running |     |           |               |
|   metron_agent                                                             | running |     |           |               |
+----------------------------------------------------------------------------+---------+-----+-----------+---------------+
| uaa_z1/0 (17488c94-2fa5-4085-8f2f-54bf67ec5059)*                           | running | n/a | medium_z1 | <IP_ADDRESS>   |
+----------------------------------------------------------------------------+---------+-----+-----------+---------------+

(*) Bootstrap node

Instances total: 14

From monit logs inside blobstore_z1/0 VM:
[UTC Jul 29 03:49:56] info     : 'blobstore_nginx' start: /var/vcap/jobs/blobstore/bin/nginx_ctl
[UTC Jul 29 03:49:58] error    : 'blobstore_nginx' failed to start
[UTC Jul 29 03:50:02] error    : 'blobstore_nginx' process is not running
[UTC Jul 29 03:50:02] info     : 'blobstore_nginx' trying to restart

and starting it manually gives:
/var/vcap/jobs/blobstore/bin/nginx_ctl: line 15: /nginx.pid: Permission denied
logs from /var/vcap/sys/log/blobstore/nginx.stderr.log
nginx: [emerg] bind() to <IP_ADDRESS>:443 failed (13: Permission denied)
nginx: [emerg] bind() to <IP_ADDRESS>:443 failed (13: Permission denied)
nginx: [emerg] bind() to <IP_ADDRESS>:443 failed (13: Permission denied)

Can anyone help me with this issue?

ping @utako @SocalNick

Hi @utako and @SocalNick , any pointers on my issue?

@MoizArif what version of CF? In 239, we made it such that you have to run the blobstore on an unprivileged port, 4443 by default. Please see the release notes: https://github.com/cloudfoundry/cf-release/releases/tag/v239

Using release 239
root@node-42:~/cf-release# bosh releases
RSA 1024 bit CA certificates are loaded due to old openssl compatibility
Acting as user 'admin' on 'my-bosh'

+------+-------------+-------------+
| Name | Versions    | Commit Hash |
+------+-------------+-------------+
| cf   | 239+dev.26  | aae5794a    |
|      | 239+dev.27* | ea7c35cf    |
+------+-------------+-------------+
(*) Currently deployed

Releases total: 1

So i should change the tls port from 443 to 4443, right?
an excerpt from my existing cf-deployment.yml file:
properties:
  acceptance_tests: null
  app_domains:
  - cf-app.com
  app_ssh: null
  blobstore:
    admin_users:
    - password: xxx
      username: xxx
    port: 8080
    secure_link:
      secret: xxx
    tls:
      port: 443

Okay i have understood it from the release specs. I changed the tls port to 4443 (above 1024) and i am now able to get pass the error mentioned in this issue.
Wow, thanks a bunch @SocalNick.

Are there any changes to api section as well? Now my api_z1/0 got stuck.
  Started updating job api_z1 > api_z1/0 (d67835fc-9b8c-4652-9f20-4392f5238a52) (canary). Failed: Action Failed get_task: Task 51780263-1710-4fa2-5d4d-f4516fb1c5b9 result: 1 of 3 pre-start scripts failed. Failed Jobs: cloud_controller_ng. Successful Jobs: cloud_controller_clock, cloud_controller_worker. (00:04:22)

Error 450001: Action Failed get_task: Task 51780263-1710-4fa2-5d4d-f4516fb1c5b9 result: 1 of 3 pre-start scripts failed. Failed Jobs: cloud_controller_ng. Successful Jobs: cloud_controller_clock, cloud_controller_worker.

bosh instances --ps
+----------------------------------------------------------------------------+---------+-----+-----------
+---------------+
| Instance                                                                   | State   | AZ  | VM Type
| IPs           |
+----------------------------------------------------------------------------+---------+-----+-----------
+---------------+
| api_z1/0 (d67835fc-9b8c-4652-9f20-4392f5238a52)*                           | stopped | n/a | large_z1
| <IP_ADDRESS>   |
+----------------------------------------------------------------------------+---------+-----+-----------
+---------------+

Check the log files by bosh ssh api_z1/0. The log file you should look at are /var/vcap/sys/log/cloud_controller_ng/pre-start.stderr.log and /var/vcap/sys/log/cloud_controller_ng/pre-start.stdout.log.

@SocalNick , The error is:
  Started updating job api_z1 > api_z1/0 (4f30c066-9b5d-4ab9-b0b4-6f3a3170027a) (canary). Failed: Action Failed get_task: Task 48b059c1-2832-4053-43b4-5f4b12833847 result: 1 of 2 pre-start scripts failed. Failed Jobs: cloud_controller_ng. Successful Jobs: consul_agent. (00:11:03)

Error 450001: Action Failed get_task: Task 48b059c1-2832-4053-43b4-5f4b12833847 result: 1 of 2 pre-start scripts failed. Failed Jobs: cloud_controller_ng. Successful Jobs: consul_agent

Output of pre-start.stdout.log:
[2016-07-30 20:30:14+0000] {"timestamp":1469910614.5912402,"message":"PG::UndefinedTable: ERROR:  relation \"schema_migrations\" does not exist\nLINE 1: SELECT NULL AS \"nil\" FROM \"schema_migrations\" LIMIT 1\n                                  ^: SELECT NULL AS \"nil\" FROM \"schema_migrations\" LIMIT 1","log_level":"error","source":"cc.db.migrations","data":{},"thread_id":47063367889160,"fiber_id":47063403522820,"process_id":4702,"file":"/var/vcap/packages/cloud_controller_ng/cloud_controller_ng/vendor/bundle/ruby/2.3.0/gems/sequel-4.29.0/lib/sequel/database/logging.rb","lineno":70,"method":"block in log_each"}
[2016-07-30 20:30:14+0000] {"timestamp":1469910614.6184585,"message":"PG::UndefinedTable: ERROR:  relation \"schema_info\" does not exist\nLINE 1: SELECT NULL AS \"nil\" FROM \"schema_info\" LIMIT 1\n                                  ^: SELECT NULL AS \"nil\" FROM \"schema_info\" LIMIT 1","log_level":"error","source":"cc.db.migrations","data":{},"thread_id":47063367889160,"fiber_id":47063403522820,"process_id":4702,"file":"/var/vcap/packages/cloud_controller_ng/cloud_controller_ng/vendor/bundle/ruby/2.3.0/gems/sequel-4.29.0/lib/sequel/database/logging.rb","lineno":70,"method":"block in log_each"}
[2016-07-30 20:30:14+0000] {"timestamp":1469910614.6369526,"message":"PG::UndefinedTable: ERROR:  relation \"services\" does not exist\nLINE 1: ...\".\"attnum\" > 0) AND (\"pg_class\".\"oid\" = CAST(CAST('\"services...\n                                                             ^: SELECT \"pg_attribute\".\"attname\" AS \"name\", CAST(\"pg_attribute\".\"atttypid\" AS integer) AS \"oid\", CAST(\"basetype\".\"oid\" AS integer) AS \"base_oid\", format_type(\"basetype\".\"oid\", \"pg_type\".\"typtypmod\") AS \"db_base_type\", format_type(\"pg_type\".\"oid\", \"pg_attribute\".\"atttypmod\") AS \"db_type\", pg_get_expr(\"pg_attrdef\".\"adbin\", \"pg_class\".\"oid\") AS \"default\", NOT \"pg_attribute\".\"attnotnull\" AS \"allow_null\", COALESCE((\"pg_attribute\".\"attnum\" = ANY(\"pg_index\".\"indkey\")), false) AS \"primary_key\" FROM \"pg_class\" INNER JOIN \"pg_attribute\" ON (\"pg_attribute\".\"attrelid\" = \"pg_class\".\"oid\") INNER JOIN \"pg_type\" ON (\"pg_type\".\"oid\" = \"pg_attribute\".\"atttypid\") LEFT OUTER JOIN \"pg_type\" AS \"basetype\" ON (\"basetype\".\"oid\" = \"pg_type\".\"typbasetype\") LEFT OUTER JOIN \"pg_attrdef\" ON ((\"pg_attrdef\".\"adrelid\" = \"pg_class\".\"oid\") AND (\"pg_attrdef\".\"adnum\" = \"pg_attribute\".\"attnum\")) LEFT OUTER JOIN \"pg_index\" ON ((\"pg_index\".\"indrelid\" = \"pg_class\".\"oid\") AND (\"pg_index\".\"indisprimary\" IS TRUE)) WHERE ((\"pg_attribute\".\"attisdropped\" IS FALSE) AND (\"pg_attribute\".\"attnum\" > 0) AND (\"pg_class\".\"oid\" = CAST(CAST('\"services\"' AS regclass) AS oid))) ORDER BY \"pg_attribute\".\"attnum\"","log_level":"error","source":"cc.db.migrations","data":{},"thread_id":47063367889160,"fiber_id":47063403522820,"process_id":4702,"file":"/var/vcap/packages/cloud_controller_ng/cloud_controller_ng/vendor/bundle/ruby/2.3.0/gems/sequel-4.29.0/lib/sequel/database/logging.rb","lineno":70,"method":"block in log_each"}
[2016-07-30 20:30:14+0000] {"timestamp":1469910614.6378853,"message":"PG::UndefinedTable: ERROR:  relation \"services\" does not exist\nLINE 1: SELECT * FROM \"services\" LIMIT 1\n                      ^: SELECT * FROM \"services\" LIMIT 1","log_level":"error","source":"cc.db.migrations","data":{},"thread_id":47063367889160,"fiber_id":47063403522820,"process_id":4702,"file":"/var/vcap/packages/cloud_controller_ng/cloud_controller_ng/vendor/bundle/ruby/2.3.0/gems/sequel-4.29.0/lib/sequel/database/logging.rb","lineno":70,"method":"block in log_each"}
[2016-07-30 20:30:14+0000] {"timestamp":1469910614.6610012,"message":"Begin applying migration<PHONE_NUMBER>4954_new_initial_schema.rb, direction: up","log_level":"info","source":"cc.db.migrations","data":{},"thread_id":47063367889160,"fiber_id":47063403522820,"process_id":4702,"file":"/var/vcap/packages/cloud_controller_ng/cloud_controller_ng/vendor/bundle/ruby/2.3.0/gems/sequel-4.29.0/lib/sequel/database/logging.rb","lineno":70,"method":"block in log_each"}
[2016-07-30 20:30:15+0000] {"timestamp":1469910615.5097067,"message":"Finished applying migration<PHONE_NUMBER>4954_new_initial_schema.rb, direction: up, took 0.848662 seconds","log_level":"info","source":"cc.db.migrations","data":{},"thread_id":47063367889160,"fiber_id":47063403522820,"process_id":4702,"file":"/var/vcap/packages/cloud_controller_ng/cloud_controller_ng/vendor/bundle/ruby/2.3.0/gems/sequel-4.29.0/lib/sequel/database/logging.rb","lineno":70,"method":"block in log_each"}

Output of pre-start.stderr.log:
[2016-07-30 20:30:12+0000] + mkdir -p /var/vcap/data/nginx_cc/tmp
[2016-07-30 20:30:12+0000] + chown vcap:vcap /var/vcap/data/nginx_cc/tmp
[2016-07-30 20:30:12+0000] + mkdir -p /var/vcap/packages/nginx/proxy_temp
[2016-07-30 20:30:12+0000] + touch /var/vcap/packages/nginx/logs/error.log
[2016-07-30 20:30:12+0000] + chown vcap:vcap /var/vcap/packages/nginx/logs/error.log
[2016-07-30 20:30:12+0000] + mkdir -p /var/vcap/data/cloud_controller_ng/diagnostics
[2016-07-30 20:30:12+0000] + chown vcap:vcap /var/vcap/data/cloud_controller_ng/diagnostics
[2016-07-30 20:30:12+0000] + deny_overlapping_app_and_system_domains
[2016-07-30 20:30:12+0000] + app_domains=cf-app.com
[2016-07-30 20:30:12+0000] + system_domain=domain
[2016-07-30 20:30:12+0000] + ruby /var/vcap/jobs/cloud_controller_ng/bin/check_for_domain_overlap.rb domain cf-app.com
[2016-07-30 20:30:12+0000] + overlap_result=0
[2016-07-30 20:30:12+0000] + [[ 0 -ne 0 ]]
[2016-07-30 20:30:12+0000] + perform_migration
[2016-07-30 20:30:12+0000] + pushd /var/vcap/packages/cloud_controller_ng/cloud_controller_ng
[2016-07-30 20:30:12+0000] + chpst -u vcap:vcap bundle exec rake db:migrate
[2016-07-30 20:30:22+0000] + result=0
[2016-07-30 20:30:22+0000] + [[ 0 -ne 0 ]]
[2016-07-30 20:30:22+0000] + popd
[2016-07-30 20:30:22+0000] + seed_db
[2016-07-30 20:30:22+0000] + pushd /var/vcap/packages/cloud_controller_ng/cloud_controller_ng
[2016-07-30 20:30:22+0000] + chpst -u vcap:vcap bundle exec rake db:seed
[2016-07-30 20:30:24+0000] rake aborted!
[2016-07-30 20:30:24+0000] Sequel::ValidationFailed: name can contain multiple subdomains, each having only alphanumeric characters and hyphens of up to 63 characters, see RFC 1035.
[2016-07-30 20:30:24+0000] /var/vcap/packages/cloud_controller_ng/cloud_controller_ng/vendor/bundle/ruby/2.3.0/gems/sequel-4.29.0/lib/sequel/model/base.rb:1543:in `save'
[2016-07-30 20:30:24+0000] /var/vcap/packages/cloud_controller_ng/cloud_controller_ng/vendor/bundle/ruby/2.3.0/gems/sequel-4.29.0/lib/sequel/model/base.rb:148:in `create'
[2016-07-30 20:30:24+0000] /var/vcap/data/packages/cloud_controller_ng/cf72e41bf598298829d239e3e96cf50cf8417c2e.1-1971c5c8781e8b7c3bbf23ce0e04a6033aca2dfd/cloud_controller_ng/lib/cloud_controller/seeds.rb:86:in `create_seed_domains'
[2016-07-30 20:30:24+0000] /var/vcap/data/packages/cloud_controller_ng/cf72e41bf598298829d239e3e96cf50cf8417c2e.1-1971c5c8781e8b7c3bbf23ce0e04a6033aca2dfd/cloud_controller_ng/lib/cloud_controller/seeds.rb:9:in `write_seed_data'
[2016-07-30 20:30:24+0000] /var/vcap/data/packages/cloud_controller_ng/cf72e41bf598298829d239e3e96cf50cf8417c2e.1-1971c5c8781e8b7c3bbf23ce0e04a6033aca2dfd/cloud_controller_ng/lib/tasks/db.rake:135:in `block (3 levels) in <top (required)>'
[2016-07-30 20:30:24+0000] /var/vcap/data/packages/cloud_controller_ng/cf72e41bf598298829d239e3e96cf50cf8417c2e.1-1971c5c8781e8b7c3bbf23ce0e04a6033aca2dfd/cloud_controller_ng/lib/cloud_controller/background_job_environment.rb:39:in `setup_environment'
[2016-07-30 20:30:24+0000] /var/vcap/data/packages/cloud_controller_ng/cf72e41bf598298829d239e3e96cf50cf8417c2e.1-1971c5c8781e8b7c3bbf23ce0e04a6033aca2dfd/cloud_controller_ng/lib/tasks/db.rake:134:in `block (2 levels) in <top (required)>'
[2016-07-30 20:30:24+0000] Tasks: TOP => db:seed
[2016-07-30 20:30:24+0000] (See full trace by running task with --trace)

@MoizArif it appears to be a configuration error with your system domain, do you have it set to domain? How are you generating your deployment manifest? Your system and app domains should be something like:
system_domain: system.some-domain.com
system_domain_organization: system
app_domains:
  - apps.some-domain.com

or you can use the same apps and system domain
system_domain: some-domain.com
app_domains:
  - some-domain.com

If you are still having issues, our working hours are M-F 9a-6p PT. We have a dedicated interrupt pair available to help in our slack channel, drop by and you can get some realtime help.
cc @utako

@SocalNick , yes i am actually using domain.
  system_domain: domain
  system_domain_organization: domain.org

i am using the this to generate the deployment manifest:
./scripts/generate_deployment_manifest openstack /root/my-bosh/cf-stub.yml > cf-deployment.yml
Let me change the  domain names like you suggested and try again.
Do "some-domain.com" needs to be routable ?

Yes, you need to be able to set a wildcard record for the domain you use. Please follow the instructions for Preparing to Deploy on OpenStack.

Using the proper domain name worked for me at this point. Now running into another issue:
  Started updating job runner_z1 > runner_z1/0 (13743010-281b-4601-b117-479472016342) (canary). Failed: 'runner_z1/0 (13743010-281b-4601-b117-479472016342)' is not running after update. Review logs for failed jobs: warden, dea_next (00:11:00)

Error 400007: 'runner_z1/0 (13743010-281b-4601-b117-479472016342)' is not running after update. Review logs for failed jobs: warden, dea_next

All processes on the runner_z1/0 vm are running:
root@79c4cc9f-6b6d-49d4-819d-77048cbfd1a1:/home/vcap# monit summary
The Monit daemon 5.2.5 uptime: 20m

Process 'consul_agent'              running
Process 'warden'                    running
Process 'dea_next'                  running
Process 'dir_server'                running
Process 'dea_logging_agent'         running
Process 'metron_agent'              running
System 'system_localhost'           running

The warden error logs report, /var/vcap/sys/log/warden_ctl.err.log:
[2016-07-30 22:37:00+0000] ------------ STARTING warden_ctl at Sat Jul 30 22:37:00 UTC 2016 --------------
[2016-07-30 22:38:14+0000] rake aborted!
[2016-07-30 22:38:14+0000] Warden::WardenError: command exited with failure
[2016-07-30 22:38:14+0000] Tasks: TOP => warden:start
[2016-07-30 22:38:14+0000] (See full trace by running task with --trace)
[2016-07-30 22:38:14+0000] rake aborted!
[2016-07-30 22:38:14+0000] rake aborted!
[2016-07-30 22:38:14+0000] no acceptor (port is in use or requires root privileges)
[2016-07-30 22:38:14+0000] rake aborted!
[2016-07-30 22:38:14+0000] no acceptor (port is in use or requires root privileges)
[2016-07-30 22:38:14+0000] no acceptor (port is in use or requires root privileges)
[2016-07-30 22:38:14+0000] Tasks: TOP => warden:start
[2016-07-30 22:38:14+0000] (See full trace by running task with --trace)

/var/vcap/sys/log/dea_ctl.err.log reports:
[2016-07-30 22:25:47+0000] ------------ STARTING dea_ctl at Sat Jul 30 22:25:47 UTC 2016 --------------
[2016-07-30 22:25:48+0000] /var/vcap/jobs/dea_next/bin/dea_ctl: line 69: /proc/sys/net/netfilter/nf_conntrack_max: No such file or directory
[2016-07-30 22:27:56+0000] ------------ STARTING dea_ctl at Sat Jul 30 22:27:56 UTC 2016 --------------
[2016-07-30 22:30:10+0000] ------------ STARTING dea_ctl at Sat Jul 30 22:30:10 UTC 2016 --------------
[2016-07-30 22:32:24+0000] ------------ STARTING dea_ctl at Sat Jul 30 22:32:24 UTC 2016 --------------

@SocalNick :
Another quick question, the domain should point to CF router IP ?

You would normally point this at the loadbalancer, in your case this looks to be the ha_proxy_z1 VM - although you could also use an external loadbalancer instead - which then forwards traffic onto the routers.

@jleavers , thanks for the reply. in case my system_domain name is cf.test.com ,  i do:
cf api --skip-ssl-validation http://cf.test.com
with cf.test.com pointing to the Floating IP assigned to ha_proxy_z1 VM and it throws out:
Setting api endpoint to cf.test.com...
FAILED
Server error, status code: 503, error code: 0, message:

What do you think might be the issue here?

Normally the API URL will be api.SYSTEM_DOMAIN, e.g. api.cf.test.com in your example. You will probably see this listed in your deployment manifest.

@jleavers : i have used the following command:
cf api --skip-ssl-validation api.cf.test.com
and still getting the same error message:
root@dns-vm:/home/ubuntu# ./cf api --skip-ssl-validation api.cf.test.com
Setting api endpoint to http://api.cf.test.com...
FAILED
Server error, status code: 503, error code: 0, message:

DNS query results in:
root@dns-vm:/home/ubuntu# nslookup api.cf.test.com
Server:         <IP_ADDRESS>
Address:        <IP_ADDRESS>#53

Name:   api.cf.test.com
Address: <IP_ADDRESS>

and the DNS entry is: *.cf.test.com.        IN      A       <IP_ADDRESS>
where <IP_ADDRESS> is the Floating IP of the ha_proxy_z1/0 VM.

@MoizArif you are likely going to have to start looking at logs for all the components involved. That would be HAProxy, Gorouter, and CloudController. I'm going to close this issue because your original issue has been resolved. I encourage you to investigate your deployment thoroughly and try to determine the proper team to contact for more help. As I mentioned, you might be able to get help in realtime in the CloudFoundry OSS Slack. Most teams have interrupt pairs willing to help debug community issues.

@SocalNick , i dont have access to CF slack channel. can you send me an invite?

@SocalNick , yes i am doing exactly that. Thanks for all the help :)


Impact and Insights of UX Research

Conveying Impact and Insights of UX Research

How to Write Compelling User Research Insights in 6 Steps
We're often reminded of the importance of "sharing insights." But advice for how define an insight—and how we should be writing them—is vague at best.
WORDS BY NIKKI ANDERSON, VISUALS BY EMMA MCKHANN
https://dscout.com/people-nerds/writing-user-insights

Tracking the impact of UX Research: a framework
Why we should measure research (even if no one asks us to).
Caitlin D. Sullivan
https://uxdesign.cc/tracking-the-impact-of-ux-research-a-framework-9e8b8f51599b

Impact in Design and Research at DoorDash
Zach Schendel
https://medium.com/design-doordash/impact-in-design-and-research-at-doordash-d7358cfd7597

If your UX Portfolio has this 20% Well Done, it Will Give You an 80% Result
Ilma Andrade
Aug 30, 2022
To build this article I went through over 50 winner UX portfolios, looking for patterns, and we will go through 12 items to have on your case study, plus 5 items to the overall portfolio page, + The 20% you should be focusing on.

12 Ways Innovative Companies do More Impactful Research with dscout
https://pages.dscout.com/hubfs/dscout-12_Ways (2).pdf?utm_campaign=Marketing Qualified Nurture Stream&utm_medium=email&_hsmi=159139600&_hsenc=p2ANqtz-_VEjEjOsc8HcZML7QokWEsG4LM_dhrkXodasA1FZjrY0wuds2zYWtHF8Be-PBrXZCoftnt8c5ljZiCZzbZ5FSKyYNHaz5JUGmyIplEcaqOhO6I8aU&utm_content=159139600&utm_source=hs_automation

Stop Lights and Rainbow Charts: Two Engaging Templates for Qual Research Reports
Use these two straightforward report frameworks to present findings in an engaging (and colorful!) way
WORDS BY NIKKI ANDERSON, VISUALS BY EMMA MCKHANN
https://dscout.com/people-nerds/stop-light-and-rainbow-charts

What types of UXR impact are you reporting on?
Curiosity Tank
https://www.curiositytank.com/blog/what-types-of-uxr-impact-are-you-reporting-on

Get the Best of Both Worlds with a Hybrid Team
Running an unembedded team in UXR gives you the capabilities to have rigorous standards and run more lean. Here's how you can approach it, no matter your current team makeup.
WORDS BY CORI WIDEN, VISUALS BY THUMY PHAN
https://dscout.com/people-nerds/hybrid-team-structure

Mapping research impact in product development
Jake Burghardt
https://medium.com/integrating-research/mapping-research-impact-in-product-development-2bc8448d01c2

#Crafting Success: Strategies for Measuring User Research Impact” with Nikki Anderson
In this talk from April, Nikki discussed the ways you can use external and internal metrics to demonstrate the impact of user research within organizations by mapping your research work to direct metrics.
Crafting Success: Strategies for Measuring User Research Impact” with Nikki Anderson


the tooltip on input textbox does not work

the tooltip plugin does not work when use on input textbox but on a or span tag is trust
<input type="text" class="simptip-position-top" data-tooltip="Hello">

In fact, it's not created for working on input fields.


[Question] Message queue accumulation data

Component
After the data into the message queue, seem only accumulation in one

UI
Rule Engine
Installation
Generic

Description
A clear and concise details.
Environment

OS:  centos7.9
ThingsBoard: 3.4.3
ThingsBoard-edge: 3.4.3

I try to connect the 200 devices, and for 5 seconds at a time the frequency of reported data, message queue began to accumulate data, I checked the server resources, memory, CPU and disk USES only a small part.
What is limiting the consumption on the edge of the speed?
@volodymyr-babak

The same system configuration of thingsboard, access 200 devices access no message queue accumulation problems

@ashvayka @volodymyr-babak Take a look at this problem, if we do not have the right to use because the configuration file?

@WingedKitten
please describe your setup - what message queue type is used for cloud and edge, what rule chain are you using, what is device protocol is used to connect devices to edge, etc.
Please provide as much information as possible so we are able to understand and reproduce the issue.
At the moment it's not clear what exactly you are trying to achieve and what data is accumulated in the queue.
Edge is not using queue to send the data to the cloud, so accumulating messages in the queue is related to some failures in the rule engine processing.
Please take a look at rule engine statistics on cloud and edge - probably you'll find some error messages there.

I use the rabbitmq message queue, rules chain is the default
Using the MQTT protocol through the TB - gateway access
The server configuration is 8 CPU 16 gb of memory
I'm trying to do the performance test
The frequency of data is 5 seconds at a time, at the same time there are 200 sets of equipment access
But the edge can't rapid consumption of these data
Use the same methods and equipment access to TB cloud
There is no pressure.
And check the edge server resources, CPU use only about 2400 MHZ, use 983 MB of memory.

So, I don't understand why？The problem is the configuration file?

Thingsboard and edge version is 3.4.3

I was hoping to test 1000 devices, but probably around 50 message queue began to pile up

This is edge connection database server disk when pressure situation, does not seem to be IO pressure

Database is postgresql14.4 edge
TB cloud use postgresql14.4 + Cassandra
I thought that is the reason of the database, but the disk pressure seems to be very small
Edge does not use all the resources

@volodymyr-babak

The rabbitMQ cumulative number of messages in the more and more
Remote sensing data latency is bigger and bigger
@volodymyr-babak

Send data already for one hour, telemetry shows or 30 minutes ago

'Hourly telemetry persistence' only
'The amount of data transferred per hour' half, does it mean when insert data into The database too slow?
@volodymyr-babak
But the database disk usage is not high

@WingedKitten
I see that you have JS executions in your API Usage statistics, but in the previous post you mentioned that you have default rule chains.
Default rule chains do not use JS executions.
Please provide configuration of your rule chains.

That is a test for the first time in the afternoon, using the chain I revised rules, but later in order to rule out a variable, I changed the default, you can see behind several hours is no js
@volodymyr-babak

@WingedKitten
that makes sense, thanks for clarification.
Please use in-memory queue for testing, instead of RabbitMQ, and let me know if you have any delays in message transfer to the cloud in this case.
Additionally, please attach thingsboard.log and tb-edge.log files to the ticket.

Hi, I found a problem that affect synchronous speed, the amount of data when cloud_event table increases to a certain number, edge and TB cloud synchronous speed dropped, I try to truncate cloud_event table, synchronous speed again, I guess because cloud_event increases the amount of data that has affected the query speed。
I do stress test with 1000 devices, last night in the morning found cloud_event table has 7.8 G the amount of data

At the same time, the edge and TB cloud transmission speed from begin to decline at about 4 o 'clock
The database of the CPU utilization rate began to rise sharply in the 4 o 'clock.
This is the use of the network：

Now I try to shorten the TTL, but frequent delete does not seem to be a good method, can be in the form of partitions?

@WingedKitten
thanks for additional information.
I had created a new ticket to partition cloud_event table:
https://github.com/thingsboard/thingsboard-edge/issues/49
Additionally, I'll try to see what could be improved for your current test case until partition of cloud_event is done - probably we can add some more indexes for this table to make it more efficient in case of many records.
I'll get back into this thread once we have some progress on this.

Sorry, in the busy work, before I can try to provide a 9.9 GB cloud_event table data, because I truncate the test table, you can use the data to fill in your data table, to simulate when cloud_event increases to a certain number, whether the partition has effect on him。
Can I use E-mail sent to you?

Hi @WingedKitten,
I wanted to let you know that we partitioned the cloud event table by created_time in this commit: https://github.com/thingsboard/thingsboard-edge/commit/30df42d784e34fae41794601cbc20daa91fed7a8.
During our testing phase, we pushed 2000 messages per second for 1000 devices on the edge for 3 hours, and during this 3 hours 22 million cloud events were created. No lag between the cloud and the edge. At the moment, the size of cloud_event table is 7 GB.
We achieved processing speeds that were 20-50 times faster than before. One parameter that we tuned on the edge side was CLOUD_RPC_STORAGE_MAX_READ_RECORDS_COUNT. You can find this parameter in tb-edge.yml file and overwrite it using tb-edge.conf file. We used 5000 instead of the default value of 50 during the testing phase to fetch more records from the edge database during a single SELECT query.
If you encounter any further issues related to the performance of sending cloud events on the 3.5 release, feel free to reopen this ticket. Otherwise, I'll go ahead and close it.


containerTagName is deprecated

I get this warning:
"GoogleMap" with containerTagName is deprecated now and will be removed in next major release (5.0.0).
Thanks!

Please migrate to 6.0.0 instead.
6.0.0 is released on npm beta tag now. See the changelog here. We also have a new demo page. Feel free to try it:
https://tomchentw.github.io/react-google-maps/


MS3 LASAIR Version 2.0 launched, incorporating SHERLOCK Version 2.0 classifier

see github project _A2.0 : Complete Lasair2.0 release

See https://lasair.roe.ac.uk/


difference between pvc size and snapshot size

hi, i've some issues using latest (0.12.2 updated yesterday from previous 0.10.4, now i just saw you released 0.12.3 in latest hours)
i have some PVCs of 10gb on both lab and qa NS

but as you can see, the VS of the lab ones (in green, on top) have a restoresize of 100gb, so wrong... the QA ns one seems correct, though, and the snapshotter is the same for both envs...

if you need any other info, just ask
best regards, and thanks

I'm not sure how this would really have anything to do with the scheduled volume snapshotter, as all it does is create snapshot objects and let's the CSI driver handle the rest. If you provision a snapshot manually (not using the scheduled volume snapshotter) do you experience the same behavior?

you're right, done some snapshots manually and they have the same issues (10x times bigger), it' not related to the scheduler, which as you say just asks the csi driver to do them... sorry, we can close this


Calls to weighted tests in the examples are silently failing

curl -sD - 'http://localhost:8080/test/weighted'
HTTP/1.1 500 Internal Server Error
Content-Type: text/plain
Date: Sun, 15 Mar 2020 15:22:47 GMT
Content-Length: 0

curl -sD - 'http://localhost:8080/test/weighted'
HTTP/1.1 500 Internal Server Error
Content-Type: text/plain
Date: Sun, 15 Mar 2020 15:22:47 GMT
Content-Length: 0

curl -sD - 'http://localhost:8080/test/weighted'
HTTP/1.1 500 Internal Server Error
Content-Type: text/plain
Date: Sun, 15 Mar 2020 15:22:48 GMT
Content-Length: 0

After testing, it seems like the handlers are not throwing any errors and that this is potentially an issue happening in routeSelection.`


allow specifying id on entities, which sets object3d name

fits more into the ECS model where each entity has a unique identifier
allows users to add semantics to their markup <a-entity id="lightsaber-handle"></a-entity>

object3s have already an uuid. you can assign ids to the '''a-entity''' elements and query for them. Why do we want to also add it to the object3d name?

hmm yeah


Clean and fix pkg/dic initialisation

What changes does this PR introduce?

fix 2 issues/bugs in forcing file loading
rearrange calling tree to have all pkg/dic initialise-varia level called from dic_init_varia.F and move all forcing fields initialisation to dic_ini_forcing.F
improve reading of "pickup_dic" file.

What is the current behaviour?

if DIC_forcingCycle = 0, the model skip the loading of (constant in time) forcing files, even when corresponding file-name is specified.
for initial surface pH calculation, surface-silica file is loaded but using the wrong timing information (from main model "externForcingCycle/Period" instead of "DIC_forcingCycle/Period"). This can result in missing the loading of the file, reading the wrong record or even stopping for insufficient number of reccords in the file.
the purpose of each initialisation S/R is not very clear, the calling tree is more complicated than what it should be, making future changes difficult.

What is the new behaviour

fix the 2 issues/bugs
simplify calling tree (see above) and move all forcing field initialisation into dic_ini_forcing.F
improve reading of "pickup_dic" file for future extension (e.g., adding an other field): read and process meta file with error/warning (depending on pickupStrictlyMatch = T/F) if missing file or fields.

Does this PR introduce a breaking change?
No. In the case of a restart with missing binary file "pickup_dic.*.data", the model was able previously to restart with specific surface pH calculation. This has been kept.
Other information:
This set of changes should help for PR #718 implementation.
Suggested addition to tag-index
to be filled later

A little story here:
To get the new version of dic_read_pickup.F, I started from mypackage_read_pickup.F, renamed few "mypackage --> dic" but realized I need to do something with missFldList so I stole few bits of code from model/src/check_pickup.F (thinking it would go unnoticed) including the "stopFlag" variable.
But "Big Brother" OpenAD was watching, and decided to report the theft by ... printing the Flag !
My stolen "stopFlag" got changed into "PRINT *,Flag" so that everyone would know ! And the first one was GitHub workflow (the C.I.) where the only OpenAD test to use pkg/dic is failing because of that.

@mjlosch Thanks for the review. I am going to add  most of the your suggestion, except in dic_read_pickup.F: The reason is that all the changes there are just to prepare for the addition of a 3-D pH field (this is why so many lines are commented out); if we keep saving only 1 field in the pickup file (as it is now), we would not need to make any changes there.

@mjlosch  I accounted for your suggestions (except, as mentionned above,  in dic_read_pickup.F).
One thing that could be changed (in a future PR):
In dic_read_pickup.F, when "*.meta" file is not found, the check for a binary file "*.data" (done here by calling MDS_CHECK4FILE) could be moved inside S/R READ_MFLDS_SET (to return nbFields= -2 if no binary *.data file found).
This would allow, for other pkg read-pickup cases,  to improve the error message when the pickup files are completely missing (no meta, no data).

@seamanticscience thanks for the review. I've juts updated the comments in dic_surfforcing_init.F to account for your suggestions.
If you and @mjlosch agree, could merge this PR soon (unless someone wants to add something ?).

LGTM 🚀


pmw3901: add specs from datasheet to opt flow msg

Part of the optical flow msg is missing in the pmw3901 driver. Without this EKF rejects flow (here and here)
Datasheet:
https://wiki.bitcraze.io/_media/projects:crazyflie2:expansionboards:pot0189-pmw3901mb-txqt-ds-r1.00-

@RomanBapst FYI - we need to find a way to get 90% integrations like this one to 100% and keep them tested. This PR should not be necessary in the first place. Could you please coordinate with @PX4/testflights so they get hardware to add to their setups?


Added mdcheckr to detect broken links in Markdown

This will be the PR for checking for broken links in documentation, I will start adding it to more places as soon as we are happy with it here.
Please come with comments if there is something more that you'd like to add or change.

Any comments on the CHANGELOG link issue @rust-embedded/cortex-m ? I am unable to get around the scenario @japaric mentioned, unless removing the file from being checked. But it sub-optimal.

So eh, should we close this?

@korken89 Sounds good to me.

If we want to look into this again we can redo it


Allow subsections on Agenda pages

Is your feature request related to a problem? Please describe.
I am very thankful that you plugin has the agenda option. Thanks for that.
However, right now all agenda items are on one level. In general I would like to have an agenda like

topic 1

topic 1.1
topic 1.2

topic 2

Describe the solution you'd like
I believe most likely you have chosen the approach to use sections instead of a wizard dialog as a foundation for a good reason.
Maybe it would be solved with a minimal addition that ione could add a specific number of stars in the section name and they would be indentet accordingly?
Describe alternatives you've considered
Additional context
I am using version 1.21

Hi @fmms, good idea. The sections are used for a reason indeed, but I think its possible to add the stars in the section name as you suggest. Will have a look.

Forgot to mention it in the notes, but this functionality was added to the latest beta v1.25


Adding icons in the contact us box

Adding icons in the contact us option shall make the website even more good looking!!
please assign me with the required labes as per gssoc'24 extended program

@BVPKARTHIKEYA assigned!

resolved!


[IntelliJ Plugin] Fix completion for completion items with nullable kind

Purpose
This PR fixes intellij plugin code completion for completion items with nullable kind.
Check List

[x] Read the Contributing Guide
[ ] Required Balo version update
[ ] Updated Change Log
[x] Checked Tooling Support (#)
[ ] Added necessary tests

[ ] Unit Tests
[ ] Spec Conformance Tests
[ ] Integration Tests
[ ] Ballerina By Example Tests

[ ] Increased Test Coverage
[ ] Added necessary documentation

[ ] API documentation
[ ] Module documentation in Module.md files
[ ] Ballerina By Examples

Codecov Report

Merging #18652 into master will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master   #18652   +/-   ##
=======================================
  Coverage   15.15%   15.15%
=======================================
  Files          48       48
  Lines        1254     1254
  Branches      197      197
=======================================
  Hits          190      190
  Misses       1050     1050
  Partials       14       14

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 9eb828a...b3c976d. Read the comment docs.


Module not found: Error: Can't resolve 'wbindgen_anyref_xform'

Describe the Bug
It seems that the bidgen is referencing a module called __wbindgen_anyref_xform__ but it does not exist.
Steps to Reproduce

cd examples/hello_world
cargo build
yarn && yarn build
See error

Expected Behavior
It should create a successful build.
Actual Behavior
When building you will get an error like the following:
Hash: acb9fb43eda843de7980
Version: webpack 4.41.2
Time: 2470ms
Built at: 12/07/2019 1:23:28 PM
                           Asset       Size  Chunks                         Chunk Names
                      0.index.js    622 KiB       0  [emitted]
                      1.index.js   4.98 KiB       1  [emitted]
ca3b45d28b163df26586.module.wasm   77.1 KiB       1  [emitted] [immutable]
                      index.html  181 bytes          [emitted]
                        index.js   11.2 KiB    main  [emitted]              main
Entrypoint main = index.js
[./index.js] 266 bytes {main} [built]
[./pkg/index.js] 2.54 KiB {1} [built]
[./pkg/index_bg.wasm] 77 KiB {1} [built]
    + 3 hidden modules

ERROR in ./pkg/index_bg.wasm
Module not found: Error: Can't resolve '__wbindgen_anyref_xform__' in '/Users/chietala/Code/wasm-bindgen/examples/hello_world/pkg'
 @ ./pkg/index_bg.wasm
 @ ./pkg/index.js
 @ ./index.js

Additional Context
Below is my active toolchain and targets
❯ rustup show
Default host: x86_64-apple-darwin
rustup home:  /Users/chietala/.rustup

installed toolchains
--------------------

stable-x86_64-apple-darwin
nightly-x86_64-apple-darwin (default)

installed targets for active toolchain
--------------------------------------

wasm32-unknown-unknown
x86_64-apple-darwin

active toolchain
----------------

nightly-x86_64-apple-darwin (default)
rustc 1.41.0-nightly (ae1b871cc 2019-12-06)

Having the same issue, slightly different steps to reproduce:

cd examples/hello_world
(optional 1b: cargo build)
npm i
npm run serve

Toolchain/targets:
isaaclee$ rustup show
Default host: x86_64-apple-darwin

installed toolchains
--------------------

stable-x86_64-apple-darwin
beta-x86_64-apple-darwin
nightly-x86_64-apple-darwin (default)

installed targets for active toolchain
--------------------------------------

wasm32-unknown-unknown
x86_64-apple-darwin

active toolchain
----------------

nightly-x86_64-apple-darwin (default)
rustc 1.37.0-nightly (d132f544f 2019-06-07)

Thanks for the report! Unfortunately this is an instance of https://github.com/rustwasm/wasm-bindgen/issues/1227 where you're using a git version of the crate but a crates.io version of the CLI. I'm gonna close this in favor of that issue, but for a quick-fix for now you can copy the examples out of this repository, and they should build just fine!

ERROR in ./index.js
Module not found: Error: Can't resolve 'rust_js_game' in 'C:\Users\SOURAV\rust-js-game\www'
@ ./index.js 1:0-37 3:0-10
@ ./bootstrap.js
i ｢wdm｣: Failed to compile.
having same issue


Translate messages to English

Hi!,
I accept this change, but some files will have to be created for internationalization.
Best regards,
Fegor.


Find -module() attribute across the code

Hello @fnchooft
I was going over your contribution to allow erlang modules. NIce work! I wanted to contribute a bit to it as well to see if we can get it running. I am not very familiar with Elixir, hence the need for livebook to support Erlang modules :).
I did a slight modification to your code, specifically the way it detects if it corresponds to a module. Your implementation expected the code to start with-module(. In some ocassions comments are written on top of the code, etc.
I added a way to check across the entire code for at least one valid -module(module_name). definition. (If multiple, compilation will fail).
This will allow to have snippets like the following:
%% When starting an erlang module you have to declare -module(your_module).

-module(your_module).
...

I think we can close this pull request. Changes added to the v2 branch


Replace "DocumentDB" with "SQL"

I have confirmation from the Cosmos DB team that this should absolutely be "SQL."
See also: https://docs.microsoft.com/en-us/azure/cosmos-db/faq

Should we do something like "SQL (DocumentDB)"?

Let's just go with "SQL" and we can link to the FAQ in the changelog for clarification. This will be consistent with the portal.

Dupe of #415


Revert "[release-1.22] use upstream_cluster_raw for json access log"

Reverts istio/istio#54226

see https://github.com/istio/istio/pull/54226#issuecomment-2525344938

@zirain: The following test failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name
Commit
Details
Required
Rerun command

release-notes_istio_release-1.22
03855cc7f8a72f11f497979f437aeb631307f934
link
true
/test release-notes

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

/test release-notes


clients/horizonclient: fix inconsistent units of time in HorizonTimeOut

PR Checklist
PR Structure

[ ] This PR has reasonably narrow scope (if not, break it down into smaller PRs).
[ ] This PR avoids mixing refactoring changes with feature changes (split into two PRs
otherwise).
[ ] This PR's title starts with name of package that is most changed in the PR, ex.
services/friendbot, or all or doc if the changes are broad or impact many
packages.

Thoroughness

[ ] This PR adds tests for the most critical parts of the new functionality or fixes.
[ ] I've updated any docs (developer docs, .md
files, etc... affected by this change). Take a look in the docs folder for a given service,
like this one.

Release planning

[ ] I've updated the relevant CHANGELOG (here for Horizon) if
needed with deprecations, added features, breaking changes, and DB schema changes.
[ ] I've decided if this PR requires a new major/minor version according to
semver, or if it's mainly a patch change. The PR is targeted at the next
release branch if it's not a patch change.

What
Remove HorizonTimeOut and its related functions and fields that operate
on a value of seconds and replace with HorizonTimeout that operates on a
value of nanoseconds.
Why
The HorizonTimeOut identifier is defined as a time.Duration, and by
using that type we are stating that any value it holds is in
nanoseconds. Right now the code uses the type incorrectly to hold
seconds and this is confusing and misleading.
There is no good way to fix this because to change the type or the units
it holds is a breaking change. If we simply change the type someone
might see compiler errors. If we change the units someone might
unexpectedly continue to pass in seconds when they should now be using
nanoseconds. Alternatively, we can break this in a way that will cause
compiler errors and we can correct the units at the same time, ensuring
that the problem is fixed, fixed well, and any surprise is maybe
warranted because anyone using this field may also have a bug in their
own system.
The least breaking approach is definitely the first option above and to
just change this type from a time.Duration to a uint and to have it
continue to be seconds. But, given the likely rare use of this field,
and that someone else who is using it could easily have misunderstood
its meaning, it might be better to just break it and consider this like
a bug rather than a feature deviation.
By removing the function we ensure that anyone using it reassess their
use of it. It's easy to rename this identifier because the word 'Timeout'
is actually one word so we can call the new so we can use the one word
name 'Timeout' instead of 'TimeOut'.
Known limitations
N/A

We talked outside this PR and this change is going to be destined for horizonclient v3, and will be rebased onto the v3 branch once it is created, #2293.

@abuiles Thanks for updating the base branch. I have resolved conflicts. If you folks are 👍 with this going into v3 let me know and I'll merge it, or please feel free to squash & merge it yourself to the branch.

@abuiles Could the release branch be forwarded to the current master to get the Go 1.14 changes?

@leighmcculloch sure thing!


UUID, ID or HashIds for REST API

Analysis
Resources

https://dev.mysql.com/doc/refman/8.0/en/binary-varbinary.html
https://docs.oracle.com/cd/E17952_01/mysql-8.0-en/string-type-syntax.html#:~:text=The BINARY attribute is a,on numeric character code values.
https://instagram-engineering.com/sharding-ids-at-instagram-1cf5a71e5a5c
https://github.com/vinkla/hashids
https://www.percona.com/blog/2019/11/22/uuids-are-popular-but-bad-for-performance-lets-discuss/

Advice
After discussing this ticket with @Hoopless and @MiKessels, we've decided to use the standard ID. UUID and HashID will require some extra research to properly implement it.

Advice
After discussing this ticket with @Hoopless and @MiKessels, we've decided to use the standard ID. UUID and HashID will require some extra research to properly implement it.

Advise
I've found out that using HashIDs are case sensitive. We have an option to disable this, but this will cut the number of uses in half. So we are trying to find a way how to solve this. We have found out the following;

Using unique in the database might require varbinary or binary.
How to implement this can be found at https://laracasts.com/discuss/channels/eloquent/varbinary-equivalent-in-eloquent

Asked for advice from one of my colleagues. He will advise UUID since this is already implemented into Laravel which makes it easier for the application to understand and use.

@Hoopless Although it's good to think about what is easier to implement within Laravel, I think it's still interessant to research and learn more about HashID's.
I don't think we have to store the HashId in the database, but only the ID. That's the whole purpose of this right 😂 .
So: /users/asfasdf
asfasdf => 203
SELECT * FROM users WHERE id = 203

Hey @cyrildewit, Yes agreed. However, I wanted to note how my (work) colleagues thought about it. I am sure we will implement this feature. But indeed, in the database. I will pick the ticket (https://github.com/KA-Huis/space-management/issues/67) up and will change the information in the ticket itself.

@Hoopless I understand where you comment came from. I just reacted with what thought popped up in my mind.


mysqldialect: allow use bool with tinyint

Do we have any plan to support convert between tinyint and bool.
Consider that MySQL always use tinyint to save bool value.
Feel free to reject to change this PR

@vmihailenco this pr is just as example, and maybe not the best solution.
MySQL has not real BOOLEAN type.
mysql> CREATE TABLE t(b BOOLEAN);
Query OK, 0 rows affected (0.02 sec)

mysql> SHOW CREATE TABLE t\G
*************************** 1. row ***************************
       Table: t
Create Table: CREATE TABLE `t` (
  `b` tinyint(1) DEFAULT NULL
) ENGINE=InnoDB DEFAULT CHARSET=latin1
1 row in set (0.00 sec)

bun suppot auto convert int to bool scanBool .
database/sql also support auto convert int to bool ConvertValue .
So, auto convert int to bool maybe a common practice.
However, when use go-sql-driver/mysql without prepare statement, it will use MySQL's text protocol. Under this way, it will read TINYINT as []uint8. So we need do extra work for this.
Another solution without only few changes:
diff --git a/schema/scan.go b/schema/scan.go
index f45ee01..edec442 100644
--- a/schema/scan.go
+++ b/schema/scan.go
@@ -102,6 +102,11 @@ func scanBool(dest reflect.Value, src interface{}) error {
        case int64:
                dest.SetBool(src != 0)
                return nil
+       case []byte:
+               if len(src) == 1 {
+                       dest.SetBool(src[0] != 48)
+                       return nil
+               }
        }
        return fmt.Errorf("bun: can't scan %#v into %s", src, dest.Type())
 }

Another solution without only few changes:

I like it and we already do a similar thing for other types. I will send a PR.


Optimize buzy loop

we have loop with potential too many empty repeats
use wait to reduce the useless cycles
            async with self.condition:
                while queue.empty() and active_tasks:
                    await self.condition.wait()

                if not queue.empty():
                    yield queue.get_nowait()
                elif not active_tasks:
                    break

notify on each queue.put and in _task_done
self.condition.notify_all()

or even simpler solution - send special object to queue inside _task_done
so now we can wait for queue, ignore the task done signal and check for active_tasks

semaphore.acquire() for root task too because we add to it _task_done and there will be ValueError if we release unacked semaphore


Junit test case report not available.

Describe the solution you'd like
Currently, when we turn on, Run Junit test case switch on the build configuration. While the build is in progress user can only see that Junit test cases ran. But there is no details about how many test cases ran, how many succeeded/failed, what is code coverage etc.

That's for this feature request @prashantrane123! We'll keep this open and track interest.

Do I understand correctly, that currently, if my build fails with the message:
* What went wrong:
Execution failed for task ':app:testQaReleaseUnitTest'.
> There were failing tests. See the report at: file:///Users/runner/runners/2.160.0/work/1/s/app/build/reports/tests/testQaReleaseUnitTest/index.html

there is no way to get this index.html file and therefore spot the issue?

track interest.

Sorry, but I did not get the meaning of track interest?


Update CLI extensions available doc

Update CLI extensions available doc.
Triggered by Azure/azure-cli-extensions - TRAVIS_BUILD_ID=457565266
https://github.com/Azure/azure-cli-extensions/commit/a33df510c96fb663fada3d135435816c758efd03

:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

docs-ref-conceptual/azure-cli-extensions-list.md
:white_check_mark:Succeeded
View (azure-cli-latest) View (azure-cli-2017-03-09-profile) View (azure-cli-2018-03-01-hybrid)

For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.


object to json

Hi, suppose in my excel, I have the following data
name	profit
"p1"	        10
"p2"	         6
I want to convert them into json string like: "product":[{"name":"p1", "profit":10},{"name":"p2", "profit":6}]
I tried ConvertToJson, but failed.
Could you help me?

ConvertToJson takes in a Dictionary for objects and Collection/Array for arrays. In you case the shape to send to ConvertToJson would be the following:
Dictionary {
  product: Collection/Array [
    Dictionary {name: p1, profit: 10},
    Dictionary {name: p2, profit: 6}
  ]
}

Dim Products As New Collection
Dim Product As Dictionary
Dim Row As Long

For Row = 1 To 2
    Set Product = New Dictionary
    Product("name") = Cells(Row, 1).Value
    Product("profit") = Cells(Row, 2).Value
    Products.Add Product
Next Row

Dim Obj As New Dictionary
Set Obj("product") = Products

Dim Json As String
Json = ConvertToJson(Obj)
' => {"product":[{"name":"p1","profit":10},{"name":"p2","profit":6}]}

great，thank  you so much

By the way, when the profit is 0.6 in excel 2010, it is parsed to .6 in json string. How to parse it to 0.6.
In excel 2013, 0.6 in excel can be parsed to 0.6 in json correctly.

I solved it.
I changed ConvertToJson = VBA.Replace(json_DictionaryCollectionOrArray, ",", ".") to  ConvertToJson = IIf(json_DictionaryCollectionOrArray > 0 And json_DictionaryCollectionOrArray < 1, "0" & VBA.Replace(json_DictionaryCollectionOrArray, ",", "."), VBA.Replace(json_DictionaryCollectionOrArray, ",", "."))


Add data to thumbnail element, return data on thumbnail_getSelectedItems

Fixes #1686

looks good!

removing "enhancement". bug fix to achieve parity with other _getSelectedItems functions in repeater


Shap values Error when using XGBoost Sklearn API

I trying to use TreeExplainer.shap_values with a XGBRegressor. But I'm getting the following below.
The same code works if model is an ExtraTreesRegressor for example. Could anyone tell me what might be causing this?
---------------------------------------------------------------------------
ValueError                                Traceback (most recent call last)
<ipython-input-100-adb413970450> in get_shap_res(lag, models, label)
      6     explainer = shap.TreeExplainer(model)
----> 7     shap_values = explainer.shap_values(X)
      8
      9     # visualize the first prediction's explanation (use matplotlib=True to avoid Javascript)

/usr/local/lib/python3.5/dist-packages/shap/explainers/tree.py in shap_values(self, X, y, tree_limit, approximate)
    177                 phi = self.model.original_model.predict(
    178                     X, ntree_limit=tree_limit, pred_contribs=True,
--> 179                     approx_contribs=approximate, validate_features=False
    180                 )
    181

/usr/local/lib/python3.5/dist-packages/xgboost/core.py in predict(self, data, output_margin, ntree_limit, pred_leaf, pred_contribs, approx_contribs, pred_interactions, validate_features)
   1243                     preds = preds.reshape(nrow, data.num_col() + 1)
   1244                 else:
-> 1245                     preds = preds.reshape(nrow, ngroup, data.num_col() + 1)
   1246             else:
   1247                 preds = preds.reshape(nrow, chunk_size)

ValueError: cannot reshape array of size 2855439 into shape (18663,0,6513)

btw, found a workaround in the meantime:
shap_values = model.get_booster().predict(
    xgb.DMatrix(X[model.feature_names]),
    pred_contribs=True,
)


Real world examples for all supported pub types

We are currently improving the support for different publication types within the ref list. It would be helpful to have a real world example for each type so we can understand them better and cover edge cases.
@Melissa37 @fabiobatalha @gustavofonseca could you collect and post those here? Maybe including a link to the published article that contains the pub-type.

How do we differentiate between books and book chapters?
They are both book-type publications, but a chapter in a book has more metadata (usually the chapter title, page numbers and authors (if the main book is edited and has different contributors for each
chapter)).
<!-- Book reference: Editors, no chapter details -->
    <ref id="bib8">
        <element-citation publication-type="book">
            <person-group person-group-type="editor">
                <name>
                    <surname>Cardé</surname>
                    <given-names>RT</given-names>
                </name>
                <name>
                    <surname>Millar</surname>
                    <given-names>JG</given-names>
                </name>
            </person-group>
            <year iso-8601-date="2004">2004</year>
            <source>Advances in insect chemical ecology</source>
            <publisher-name>Cambridge University Press</publisher-name>
            <publisher-loc>Cambridge</publisher-loc>
        </element-citation>
    </ref>
<!-- Book reference: Has edition, editor is author -->
    <ref id="bib10">
        <element-citation publication-type="book">
            <person-group person-group-type="editor">
                <name>
                    <surname>Chmeil</surname>
                    <given-names>N</given-names>
                </name>
            </person-group>
            <year iso-8601-date="2008">2008</year>
            <edition>2</edition>
            <source>An Introduction to Work and Organizational Psychology: A European
                Perspective</source>
            <publisher-name>Wiley-Blackwell</publisher-name>
        </element-citation>
    </ref>
<!-- Book reference: publisher location - US: city followed by state code -->
    <ref id="bib11">
        <element-citation publication-type="book">
            <person-group person-group-type="author">
                <name>
                    <surname>Coyne</surname>
                    <given-names>JA</given-names>
                </name>
                <name>
                    <surname>Orr</surname>
                    <given-names>HA</given-names>
                </name>
            </person-group>
            <person-group person-group-type="editor">
                <name>
                    <surname>Otte</surname>
                    <given-names>D</given-names>
                </name>
                <name>
                    <surname>Endler</surname>
                    <given-names>JA</given-names>
                </name>
            </person-group>
            <year iso-8601-date="1989">1989</year>
            <chapter-title>Two rules of speciation</chapter-title>
            <source>Speciation and its consequences</source>
            <fpage>1</fpage>
            <lpage>2</lpage>
            <publisher-loc>Sunderland, MA</publisher-loc>
            <publisher-name>Sinauer Associates</publisher-name>
        </element-citation>
    </ref>
<!-- Book reference: simple book reference, with ISBN -->
    <ref id="bib22">
        <element-citation publication-type="book">
            <person-group person-group-type="author">
                <name>
                    <surname>Horne</surname>
                    <given-names>P</given-names>
                </name>
                <name>
                    <surname>Page</surname>
                    <given-names>J</given-names>
                </name>
            </person-group>
            <year iso-8601-date="2008">2008</year>
            <source>Integrated pest management for crops and pastures</source>
            <publisher-name>Landlinks Press</publisher-name>
            <publisher-loc>Victoria</publisher-loc>
            <pub-id pub-id-type="isbn">9780643092570</pub-id>
        </element-citation>
    </ref>
<!-- Book reference: Has volume, no publisher location -->
    <ref id="bib25">
        <element-citation publication-type="book">
            <person-group person-group-type="author">
                <name>
                    <surname>Koch</surname>
                    <given-names>S</given-names>
                </name>
            </person-group>
            <year iso-8601-date="1959">1959</year>
            <volume>3: Formulations of the Person and the Social Context</volume>
            <source>Psychology A Study Of A Science</source>
            <publisher-name>Mcgraw-Hill Book Company</publisher-name>
        </element-citation>
    </ref>
<!-- Book reference: chapter in book with editors -->
    <ref id="bib48">
        <element-citation publication-type="book">
            <person-group person-group-type="author">
                <name>
                    <surname>Turlings</surname>
                    <given-names>TCJ</given-names>
                </name>
                <name>
                    <surname>Wäckers</surname>
                    <given-names>FL</given-names>
                </name>
            </person-group>
            <person-group person-group-type="editor">
                <name>
                    <surname>Cardé</surname>
                    <given-names>RT</given-names>
                </name>
                <name>
                    <surname>Millar</surname>
                    <given-names>JG</given-names>
                </name>
            </person-group>
            <year iso-8601-date="2004">2004a</year>
            <source>Advances in insect chemical ecology</source>
            <chapter-title>Recruitment of predators and parasitoids by herbivore-injured
                plants</chapter-title>
            <publisher-name>Cambridge University Press</publisher-name>
            <publisher-loc>Cambridge</publisher-loc>
            <fpage>21</fpage>
            <lpage>75</lpage>
        </element-citation>
    </ref>
<!-- Book reference: book with editors and authors, no chapter, and example of  -->
            <ref id="bib49">
                <element-citation publication-type="book">
                    <person-group person-group-type="author">
                        <name>
                            <surname>Turlings</surname>
                            <given-names>TCJ</given-names>
                        </name>
                        <name>
                            <surname>Wäckers</surname>
                            <given-names>FL</given-names>
                        </name>
                    </person-group>
                    <person-group person-group-type="editor">
                        <name>
                            <surname>Cardé</surname>
                            <given-names>RT</given-names>
                        </name>
                        <name>
                            <surname>Millar</surname>
                            <given-names>JG</given-names>
                        </name>
                    </person-group>
                    <year iso-8601-date="2004">2004b</year>
                    <source>Advances in insect chemical ecology</source>
                    <publisher-name>Cambridge University Press</publisher-name>
                </element-citation>
            </ref>

@Melissa37 thank you! Can you give examples for all the other pub types as well? I will incorporate them into the Texture kitchen sink file.

Hi @michael in the next link you can see some examples from SciELO:
http://docs.scielo.org/projects/scielo-publishing-schema/pt_BR/1.8-branch/tagset/elemento-element-citation.html
If you wish to see the same in english you may download their manual from:
https://github.com/scieloorg/scielo_publishing_schema/raw/master/versions/EN-scielo-publishing-schema-1.5.pdf
That manual it's a few outdated according to the SciELO Publishing Schema, but in this case is the same, you can consult the examples in page 75.
Those examples differ from the exposed by Melissa, because according to SciELO Publishing Schema it's needed to include the  tag to express the ref as is in the original pdf, and that tag it's read by it's system to show the refs to the end users.
Let me know if you wish some real examples with it's published articles.

We should handle the volume field also for multi-volumes books as the example bib25 indicates it here:
            <volume>3: Formulations of the Person and the Social Context</volume>
            <source>Psychology A Study Of A Science</source>


Added new intent to documentation

Since discord officially flipped the switch on the MESSAGE_CONTENT intent being required back in 2022, the documentation has become slightly out of date. This corrects the missing intent in https://replaceitem.github.io/carpet-discarpet/setup/#intents
I also chose to include a warning in the "chat" example script, stating that the user will need to add a new intent to discarpet.json to use it. I feel that it's more likely for new users to get stuck, as that's one of the first examples they'll try to run. (At least according to the case study of 1 that I participated in :P)
If the maintainer feels that the additional context is unnecessary, remove commit 7b9e9fd203ab5d45d2e97810a6d90cf20a43fc86 . The other commit contains only the corrections

Oh and I was unable to build the site locally for testing, so you might want to double check I didn't break any syntax before merging. I'm pretty OK with markdown, but it wouldn't surprise me if I made a mistake

You can test the docs locally by running mkdocs serve, if you have it installed.

Alright i put the warning directly into the script file, just so we can specify which intents are required for the script


Add a pipeline for generating micromasters report joining micromasters and bigquery data

Add a pipeline for joining the micromasters and bigquery data in the Athena cluster to generate the report and save it as a table to Athena. This will involve the following steps:
A sensor that waits for the micromasters and bigquery data update jobs to finish to launch the report generating pipeline
A solid per page in the linked sample report that generates a file that is indexed by Athena. The Athena tables will be exposed to bi users.
There are some manual adjustments made to this data in the mm_autorep codebase - a small number of users should have certificates but do not have certificates according to the bigquery edx database. For now we can store the list as a constant in this codebase but if we add more automated reports to ol-data-pipelines we can consider adding a “report_adjustments” repo similar to https://github.com/mitodl/open-resource-blocklists to make it easier to keep track of and add special case report adjustments as necessary.

@pdpinch @abeglova can we close this now?


Monitor UI and Simple UI not compatible with linux

When installing the Monitor UI and Simple UI, I get an error on the dependency 'fsevents'. Reading the 'fsevents' docs, it seems it's platform specific for Mac OS X  (darwin). I'm using linux. Here's the terminal output:

It works on Windows and presumably on MAC. These are the high priority platforms and apparently the only ones on which it has been tested. If you choose to add Linux support, please ensure that your changes are tested on Windows and MAC. I would be happy to handle the Windows testing.


Error handling in ttrt perf mode

Tracy does not do correct error handling, which results in a false positive.

merged: e1ccf6f06162ea84df8d89c0cca7a17a93bbd3e9


ping and log against ACH and OFAC rather than panic on startup

We'll integrate proper health checks, but panic'ing on startup is an anti-pattern so let's get rid of that.
Issue: https://github.com/moov-io/paygate/issues/50

Codecov Report

Merging #67 into master will decrease coverage by 0.33%.
The diff coverage is 0%.

@@            Coverage Diff             @@
##           master      #67      +/-   ##
==========================================
- Coverage   46.82%   46.48%   -0.34%
==========================================
  Files          16       16
  Lines        2063     2078      +15
==========================================
  Hits          966      966
- Misses        875      890      +15
  Partials      222      222

Impacted Files
Coverage Δ

main.go
0% <0%> (ø)
:arrow_up:

ofac.go
42.42% <0%> (-4.25%)
:arrow_down:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 209c597...6d97e5e. Read the comment docs.


Accept Jackson's JsonNode and return List

This feature would be useful I think. Since you are internally using Jackson already

This is supported by the JacksonJsonNodeJsonProvider.

Well, JacksonJsonNodeJsonProvider will map the resulting value for you, but it won't actually return you the reference to the node. Unless I am misunderstanding the usage.
What I want to achieve is basically take a huge Json object and filter it down using path, but keeping the original structure. Can't seem to figure out how to achieve it with the current API. Suggestions?

Maybe if there was an option to make DocumentContext set(String path, Object newValue, Predicate... filters) to not through com.jayway.jsonpath.PathNotFoundException and instead create missing properties, that would be useful

There has been discussions about creating missing path elements but it has not been planed.
Is this not what you want?
@Test
public void issue_160() {
  //will return reference
  ArrayNode arrayNode1 = using(JACKSON_JSON_NODE_CONFIGURATION)
        .parse(JSON_DOCUMENT)
        .read("$.store.book");

  //will create new ArrayNode holding references to original items. New array will
  //be created by all path operations that are not definite. The array representation
  //created is decided by the JsonProvider
  ArrayNode arrayNode2 = using(JACKSON_JSON_NODE_CONFIGURATION)
        .parse(JSON_DOCUMENT)
<EMAIL_ADDRESS>== 'fiction')]");

  //will transform result according to type specification using JsonMappingProvider
  List<JsonNode> arrayNode3 = using(JACKSON_JSON_NODE_CONFIGURATION)
        .parse(JSON_DOCUMENT)
        .read("$.store.book[*]", new TypeRef<List<JsonNode>>(){});

  //will return reference
  ObjectNode objectNode = using(JACKSON_JSON_NODE_CONFIGURATION)
        .parse(JSON_DOCUMENT)
        .read("$.store.book[0]");

   //will return reference
  TextNode textNode = using(JACKSON_JSON_NODE_CONFIGURATION)
        .parse(JSON_DOCUMENT)
        .read("$.store.book[0].category");
}

Thank you for the response.
Doing this
 ArrayNode arrayNode1 = using(JACKSON_JSON_NODE_CONFIGURATION)
        .parse(JSON_DOCUMENT)
        .read("$.store.book");

returns array node where each node is a string with a JsonPath. What I would want is an actual reference to the node at that path. The config that I am using is this:
Configuration.defaultConfiguration().jsonProvider(new JacksonJsonNodeJsonProvider()).mappingProvider(new JacksonMappingProvider());

Basically, if this is the input JSON:
{"hello":"hello_value","remove":{"this":"this value will be removed","and_this":"this value will also be removed"}}

then JsonPath.using(JACKSON_JSON_NODE_CONFIGURATION).parse(JSON_DOCUMENT).read("$.remove")  returns ["$['remove']"] and not the reference to the node at $.remove path.
Am I missing something?

returns references, but any idea how to preserve original structure, e.g. have it return all the previous structure up to this leaf? Maybe somehow get JsonPointer?

Not sure I understand what want. When reading "$.store.book"  you don't want the book  ArrayNode? You want JsonPointers as result?

@kallestenflo
basically I want to be able to reconstruct
{
  "store" : {
    "book" : book ArrayNode
  }
}

without having to parse "$.store.book" to reconstruct the object. Do you think it's possible?

e.g. if I have
{
  "store" : {
    "book" : book ArrayNode,
    "bicycle" : bicycle ObjectNode,
    "doll" : doll ObjectNode
  }
}

I want to be able to get
{
  "store" : {
    "book" : book ArrayNode
  }
}

from "$.store.book"
as well as
{
  "store" : {
    "doll" : doll ObjectNode
  }
}

from "$.store.doll"
Do you see what I mean?

I think what is being asked for (and I'm looking for) is a way to use JsonPath to match a sub-tree so it can be copied to a new position (on a new JsonObject) while preserving the structure. or removing the matched tree from the parsed json.
Using Option.AS_PATH_LIST is an option to get the tree, but the hope if a list of paths are returned, they match the ordered list of values returned from a standard #read() call. This is more frustrated by the need to parse the paths so the segments can be reconstructed.

Is there are reason you need to map to a specific JsonNode Implementation instead of the JsonNode interface?


Change Copy on Dashboard Homepage

I'd like to change the copy in the tutorial on the homepage in the Livepeer.com dashboard.
Current State:

Change title to: Welcome to your dashboard{firstName && , ${firstName}

Create your first live stream

No code required! All you need to do is create a RTMP stream with broadcasting software like OBS Studio or streamlabs. Here’s how.

Tap + Create stream below give your stream a name
From the Stream Details, copy the Playback URL and Stream Key.
Then paste them into your broadcasting software.
Tap “Go Live” in the broadcasting software to start streaming.

Need more help? Read our step-by-step guide.
Get started tutorial (BUTTON)

Build with the Livepeer API

Ready to code? The Livepeer API is nimble and designed for customization.  All you need to do is create an RTMP stream with broadcasting software like OBS Studio, streamlabs, or ffmpeg.
Explore the API (BUTTON)

Create your own app

Livepeer video infrastructure is designed to serve your app, from the ground up and at scale. Get started by reviewing and cloning one of our sample apps.
Clone and create (BUTTON)

https://github.com/livepeer/livepeer-com/pull/697


WIP: Test zone pivots for versions

Close/reopen to see if snippets system can download the latest .net rc or not...

The "how to serialize/deserialize" and "how to migrate" articles are both gigantic. It seems like this might be a good time to split them up. Maybe have a header node in the TOC with subarticles for each.

Yes they are large. We discussed this issue when we did the doc planning, and the consensus of the product team (and what I've heard from other sources confirms it) is that people prefer the large articles and use find-on-page to go to what they want. For now I'm keeping to that plan, but I'll reconsider if I get feedback advocating break-up of the pages.


Feature/frontpage design

[x] Front Page Redesigned
[x] Feature List
[x] Mission Statement
[x] Newsletter Box
[x] Login page styling fixed
[x] Sign up styling fixed
[x] Removed forgot password button

Everything works fine , merging


pretained model how to train ?

Hello, I run your code. It is so amazing. I do not wanna start training, I would like to start from this 27-character (pretained model ) training a new style font. Please tell me how to do it specifically. p.s:Wasserstein GAN(WGAN) maybe is another better try.

Hello, whether you slove this problem?

@GitHubGreens  @miraclezqc  Have you found the solution?  I also have the same question.  I am using another repo for Pix2Pix  ans I want to resume the training from the last saved weights.

Hello, I run your code. It is so amazing. I do not wanna start training, I would like to start from this 27-character (pretained model ) training a new style font. Please tell me how to do it specifically. p.s:Wasserstein GAN(WGAN) maybe is another better try.

can you offer me  the Pretained model ? i can't download it<EMAIL_ADDRESS>


Add a Gitter chat badge to README.rst

timlegrand/giterm now has a Chat Room on Gitter
@timlegrand has just created a chat room. You can visit it here: https://gitter.im/timlegrand/giterm.
This pull-request adds this badge to your README.rst:

If my aim is a little off, please let me know.
Happy chatting.
PS: Click here if you would prefer not to receive automatic pull-requests from Gitter in future.

Done


Translate cypher query to ActiveNode

How can this cypher expression:
MATCH (Scaffold {branch_count: 1, edge_count: 4})-[HAS_MOLECULE]->(m:Molecule {atom_count: 5, formula: 'C2N1O2'}),
(m)-[HAS_ATOM]->(a0:Atom),
(a0:Atom {element: 'C'})-[:HAS_BOND {bond_type: 'single'}]-(a1:Atom {element: 'C'}),
(a0:Atom {element: 'C'})-[:HAS_BOND {bond_type: 'single'}]-(a2:Atom {element: 'O'}),
(a0:Atom {element: 'C'})-[:HAS_BOND {bond_type: 'double'}]-(a3:Atom {element: 'O'}),
(a1:Atom {element: 'C'})-[:HAS_BOND {bond_type: 'single'}]-(a4:Atom {element: 'N'})
RETURN m

Be translated to  #ActiveNode?

I do in fact agree that the Cypher version is more readable - and it is way easier to find good help on Cypher queries because of the bigger user group.
I will in fact be constructing queries dynamically, but putting together a cypher string is pretty straight forward. Let me see if I can get this this ActiveBase.query to work. (For now it goes undefined method pluck' for #Neo4j::Core::CypherSession::Result:0x00007fe3681ea1b0 (NoMethodError)` for some reason).
Before was testing neo4j-core's session.query, but I would like to get ActiveNode objects returned instead of Neo4j::Core::Node objects - unless I should go completely neo4j-core (is that recommended?).

Regarding the error you're running into, are you sure neo4jrb is set up properly? I.e. it's connecting to the database, etc.
If you just want to dynamically compose cypher strings, definitely check out neo4j-core. You can get a neo4j-core query object with Neo4j::ActiveBase.new_query, and use can use it like
query = Neo4j::ActiveBase.new_query

query = query.match("(Scaffold {branch_count: 1, edge_count: 4})-[HAS_MOLECULE]->(m:Molecule {atom_count: 5, formula: 'C2N1O2'})")
     .match("(m)-[HAS_ATOM]->(a0:Atom)")
     .match("(a0:Atom {element: 'C'})-[:HAS_BOND {bond_type: 'single'}]-(a1:Atom {element: 'C'})")
     .match("(a0:Atom {element: 'C'})-[:HAS_BOND {bond_type: 'single'}]-(a2:Atom {element: 'O'})")
     .match("(a0:Atom {element: 'C'})-[:HAS_BOND {bond_type: 'double'}]-(a3:Atom {element: 'O'})")

query = query.match("(a1:Atom {element: 'C'})-[:HAS_BOND {bond_type: 'single'}]-(a4:Atom {element: 'N'})")

query.pluck(:m)

Query clause methods docs

The above should return ActiveNode / ActiveRel objects (assuming you've created the models).
One potential "gotcha" with neo4j-core query clause methods is that it will automatically combine clauses. I.e., multiple .match calls (like above) are, by default, combined into the same MATCH clause with a comma ,. In this case that's what you want, but if you wanted separate match clauses you'd need to call .break on the chain.
I.e. this:
query = Neo4j::ActiveBase.new_query

query = query.match("(Scaffold {branch_count: 1, edge_count: 4})-[HAS_MOLECULE]->(m:Molecule {atom_count: 5, formula: 'C2N1O2'})")

query = query.break.match("(m)-[HAS_ATOM]->(a0:Atom)")

This leads to
MATCH (Scaffold {branch_count: 1, edge_count: 4})-[HAS_MOLECULE]->(m:Molecule {atom_count: 5, formula: 'C2N1O2'})
MATCH (m)-[HAS_ATOM]->(a0:Atom)

Also:
I just updated the ActiveNode query in my original answer because I hadn't noticed that your query referred to the a0 node multiple times. Regardless, hopefully you get the idea.

Also, off the top of my head, I don't remember how Neo4jrb translates queries using .branch. It may use a WHERE clause, which, while ultimately returning the same results as your original cypher query, wouldn't be as performant (I think).

Right. Thanks for the help. I got the results = Neo4j::ActiveBase.query() to work (though no pluck-luck, so iterating over the results instead).

CodeTriage referred me here.
Seems like this can be closed.
If not, how can I help?

Closing this. @iehdk, you can reopen it you still have any issues. Thanks.

Thanks @bobmazanec


Update Yarn 2 instructions

The location where the SDK is put has changed, and there are more --sdk commands now, so clarified which one should be used.

Cool, this seems god.

Thanks!


JavaDoc references to AutomataLib are broken

Currently, the generated JavaDoc of the distribution artifact (which we also upload to our gh-pages branch) does not properly link to AutomataLib classes / documentation.
This seems to be an issue with the distribution artifact / aggegrate-jar goal, as the per-module JavaDoc generation does not seem to have this problem.

This issue (also) fixed by 26fe0f1ab67463e11b0210f2ef7182387e973ae1


Feature: Certificate to Application Mapping Information in the metrics

Hi
We explored multiple tools to monitor the certificates on k8s. But one feature which is missing everywhere is the certificate to application mapping.
Say a given certificate is expired or going to expire, it will be great if we know which application will be affected by it.
I can create a PR for this if the maintainers feel it is a good feature to have

Hi
Indeed identification of affected workloads may be needed to process alerts, for example when dealing with multi-tenant clusters for alerts to be routed to the correct user or team. Usually this would likely be handled by Alertmanager with routing rules based on namespace. However it may not offer the granularity you're looking for because many applications are deployed in the same namespace.
So I do understand the need and I'm curious how the exporter would be providing the missing link for a solid mapping.
It would be a neet feature if done right!
What implementation do you have in mind?
Scanning all Kubernetes resources to find backreferences to Secrets would be really computational intensive for the exporter and the apiserver. While not being exhaustive enough because of unexpected Secret consumers: custom resources, operators, service meshes, ingress controllers not using Ingress, etc.
Cheers

Yes, I am doing the same, to scan kubernetes resources ( deployments, statefulsets, daemonsets ) and embed secret_reference information into the metrics. I agree it is computational intensive, but i thought we can control the periodicity of the computation. Or we can have a sidecar which can compute this while the main container serve this information.
I haven't tested the implementation on cluster with many deployments, statefulsets or daemonsets.

Considering this would be an optional feature enabled with a flag, so that nobody gets the additional load on their cluster by default:
I have two concerns.
First is with the restitution of this application mapping on metric labels.
One issue this exporter is already dealing with is avoiding metric duplicates while keeping label cardinality low to behave nicely with Prometheus, preventing storage growth over time with a stable number of certificate. That's best practice, and what default settings are expected to do. It can be tuned anyway, and I remember an other feature was even added with regards to saving storage for a notoriously expensive SaaS platform.
Propagating application mapping to a certificate metric could consequently require new label(s) or metric(s).
The first issue lays with dealing with Secrets referenced by many resources. Finding a way to communicate all back-references. For example a unique label could hold a list of kinds and names, or one label for each kind having a list of names. This is likely what you put in secret_reference. Unfortunately it wont create a stable metric cardinality as an unmodified certificate will see label changes while application deployments are altered. Creating new metrics in storage for the same certificate. This is bad practice territory.
A better way could be adding new metric names to add sorts of pointers to used Secrets. A PromQL query is then able to match a certificate with applications. One problem with that is a lack of unique identifier for joining the query. Perhaps this could be solved though.
A second issue is having a solid way to never yield duplicates. I think these two examples with labels or reference metrics are safe, other implementations are not.
My second concern is about the computation issue, and the effectiveness of the feature. Keeping in mind the ease and cost of maintaining this piece of software while keeping the broadest compatibility across all versions of Kubernetes. Accessing and processing new kinds of resources may have consequences. And there are interaction between functionalities and options to consider, such as how to deal with caching which the exporter already does.
Basically, can we really do this right. Adding a new feature is nice but it has to be reliable and do what users expect with the least amount of caveats. It's still unclear where we can stand not having the Kubernetes API providing Secret reference. This scanning approach comes with so many downsides it questions the relevance of having the exporter perform application mapping.
Having said all that, my initial opinion of doing the mapping on the Prometheus/Alertmanager side is strengthened.
You probably have a source of truth in the form of a CI or an operator where the mapping between Secret and application is known. Having this component also affect the Prometheus/Alertmanager configuration would probably do what you're looking for. Perhaps with rewriting rules, or per-application alerting rules. This could even be compatible with the Prometheus operator and maybe manage with PrometheusRule and AlermanagerConfig resources if these are tools you rely on.
This issue is being discussed at @enix already, keeping you in touch!
Let us know if

Hello @npdgm
Interested to know any outcome of the previous comment ? You said it is being discussed at @enix