User wants to find applications on NEAR

Story
As a USER who has NEAR, I want to find applications on NEAR to play / spend / buy / sell.
Acceptance Criteria

[ ] Find list current of applications with some understanding of their usage
[ ] See which ones user have already used / logged in
[ ] See in which ones have assets (tokens, NFTs, LP position, etc)

Suggestion
Simplest version of this is to put a banner on main page that links to few of the NEAR apps.
If user wants to see more, they can click to expand - which for now can go to https://awesomenear.com or later can be list inside the wallet's app.

Related to https://github.com/near/near-wallet-roadmap/issues/7

Related to https://github.com/near/near-wallet-roadmap/issues/7

Completed as a part of https://github.com/near/near-wallet-roadmap/issues/18?


[Constraint solver] Disable fallback diagnostic when error emitted into a transaction

When we are using diagnostic transactions to disable immediate emission of diagnostics, DiagnosticEngine::hadAnyError() no longer accurately reports whether an error occurred. Thread the DiagnosticTransaction into the ConstraintSystem so we can also check whether it contains an error before emitting the fallback diagnostic.
Fixes rdar://128272346.

@swift-ci please smoke test


nedit tab issue

The nedit text editor inserts tabs into scripts when the auto indent isn't turned off. I've now changed my default settings in nedit so that it is turned off, however there is a lot of code I've written without it turned off. The code seems to run ok (i.e. Python can interpret the tabs), however when you open the scripts with a different text editor (like TextWrangler) all the indentation is screwed up. I need to fix this because if people clone my repo that code may format wrong for them

No longer using nedit


Fixes for VPR architecture parsing

This PR fixes VPR architecture parsing by adding complete support for row and col layout constructs. Apart from that it fixes multiple other minor issues.

LGTM


Update Composer dependencies (2020-11-28-00-06)

Visual regression test passed!
View the visual regression test report


Multithreading error

System: Ubuntu 14.04.5 LTS
Python: Python 2.7.6
Pip packages:
ffmpy==0.2.2
futures==3.0.5
imageio==2.1.1
moviepy==<IP_ADDRESS>
multiprocess==0.70.5
youtube-dl==2017.3.2
I get the following error when I run your script. Any help would be appreciated.
yt_bb_classification_train: Downloading annotations...
--2017-03-04 00:16:19--  https://research.google.com/youtube-bb/yt_bb_classification_train.csv.gz
Resolving research.google.com (research.google.com)... <IP_ADDRESS>, 2607:f8b0:4005:808::200e
Connecting to research.google.com (research.google.com)|<IP_ADDRESS>|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [application/gzip]
Saving to: 'yt_bb_classification_train.csv.gz'

    [        <=>                                                                                ] 28,582,014  16.7MB/s   in 1.6s

2017-03-04 00:16:21 (16.7 MB/s) - 'yt_bb_classification_train.csv.gz' saved [28582014]

yt_bb_classification_train: Unzipping annotations...
yt_bb_classification_train: Parsing annotations into clip data...
Exception in thread Thread-1:
Traceback (most recent call last):
  File "/usr/lib/python2.7/threading.py", line 810, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.7/threading.py", line 763, in run
    self.__target(*self.__args, **self.__kwargs)
  File "/usr/local/lib/python2.7/dist-packages/concurrent/futures/process.py", line 208, in _queue_management_worker
    result_item = result_queue.get(block=True)
  File "/usr/lib/python2.7/multiprocessing/queues.py", line 117, in get
    res = self._recv()
TypeError: ('__init__() takes at least 3 arguments (1 given)', <class 'subprocess.CalledProcessError'>, ())

I remember running into an issue like this when I ran with an older version of python (as you are). The script uses some of the newer python functionality, so you will need to run with 3.0+. For reference I am running with Python 3.5.2

Seems to have fixed the issue, thanks! Might be helpful to put that somewhere in the README.

Thanks, will do


[bug] error: linking with cc failed: exit status: 1 on fedora

Describe the bug
Hi,
I'm testing Tauri with a Vue frontend on fedora 40 but the app doesn't compile :(
I get this error output when running npm run tauri dev:
error: linking with cc failed: exit status: 1
[ALOT OF TEXT]
= note: /usr/bin/ld: /usr/lib/gcc/x86_64-redhat-linux/14/../../../../lib64/libwebkit2gtk-4.0.so: undefined reference to g_once_init_leave_pointer'           /usr/bin/ld: /usr/lib/gcc/x86_64-redhat-linux/14/../../../../lib64/libwebkit2gtk-4.0.so: undefined reference to g_once_init_enter_pointer'
collect2: error: ld returned 1 exit status
= note: some extern functions couldn't be found; some native libraries may need to be installed or have their path specified
= note: use the -l flag to specify native libraries to link
= note: use the cargo:rustc-link-lib directive to specify the native libraries to link with Cargo (see https://doc.rust-lang.org/cargo/reference/build-scripts.html#rustc-link-lib)
error: could not compile nout (bin "nout") due to 1 previous error
Reproduction

-> npm create tauri-app@latest example
✔ Choose which language to use for your frontend · TypeScript / JavaScript - (pnpm, yarn, npm, bun)
✔ Choose your package manager · npm
✔ Choose your UI template · Vue - (https://vuejs.org/)
✔ Choose your UI flavor · TypeScript
-> cd example
-> npm install
-> npm run tauri dev

Expected behavior
App is build and runs fine
Full tauri info output
[✔] Environment
    - OS: Fedora 40.0.0 X64
    ✔ webkit2gtk-4.0: 2.44.1
    ✔ rsvg2: 2.57.1
    ✔ rustc: 1.79.0 (129f3b996 2024-06-10)
    ✔ cargo: 1.79.0 (ffa9cf99a 2024-06-03)
    ✔ rustup: 1.27.1 (54dd3d00f 2024-04-24)
    ✔ Rust toolchain: stable-x86_64-unknown-linux-gnu (default)
    - node: 20.12.2
    - pnpm: 9.4.0
    - yarn: 1.22.22
    - npm: 10.5.0

[-] Packages
    - tauri [RUST]: 1.6.8
    - tauri-build [RUST]: 1.5.2
    - wry [RUST]: 0.24.10
    - tao [RUST]: 0.16.9
    - tauri-cli [RUST]: 1.5.14
    - @tauri-apps/api [NPM]: 1.5.6
    - @tauri-apps/cli [NPM]: 1.5.14

[-] App
    - build-type: bundle
    - CSP: unset
    - distDir: ../dist
    - devPath: http://localhost:1420/
    - framework: Vue.js
    - bundler: Vite

Stack trace
error: linking with cc failed: exit status: 1
...
...
...
  = note: /usr/bin/ld: /usr/lib/gcc/x86_64-redhat-linux/14/../../../../lib64/libwebkit2gtk-4.0.so: undefined reference to `g_once_init_leave_pointer'
          /usr/bin/ld: /usr/lib/gcc/x86_64-redhat-linux/14/../../../../lib64/libwebkit2gtk-4.0.so: undefined reference to `g_once_init_enter_pointer'
          collect2: error: ld returned 1 exit status

  = note: some `extern` functions couldn't be found; some native libraries may need to be installed or have their path specified
  = note: use the `-l` flag to specify native libraries to link
  = note: use the `cargo:rustc-link-lib` directive to specify the native libraries to link with Cargo (see https://doc.rust-lang.org/cargo/reference/build-scripts.html#rustc-link-lib)

error: could not compile `nout` (bin "nout") due to 1 previous error

Additional context
I followed the guide on: https://tauri.app/v1/guides/getting-started/prerequisites
I ran this command:

-> sudo dnf install webkit2gtk4.0-devel
openssl-devel
curl
wget
file
libappindicator-gtk3-devel
librsvg2-devel
Output:
Last metadata expiration check: 5:38:29 ago on Thu 27 Jun 2024 05:20:16 PM -03.
Package webkit2gtk4.0-devel-2.44.1-2.fc40.x86_64 is already installed.
Package openssl-devel-1:3.2.1-2.fc40.x86_64 is already installed.
Package curl-8.6.0-8.fc40.x86_64 is already installed.
Package wget2-wget-2.1.0-9.fc40.x86_64 is already installed.
Package file-5.45-4.fc40.x86_64 is already installed.
Package libappindicator-gtk3-devel-12.10.1-4.fc40.x86_64 is already installed.
Package librsvg2-devel-2.57.1-6.fc40.x86_64 is already installed.
Dependencies resolved.
Nothing to do.
Complete!

and this command:

-> sudo dnf group install "C Development Tools and Libraries"
Output:
Last metadata expiration check: 5:40:51 ago on Thu 27 Jun 2024 05:20:16 PM -03.
Dependencies resolved.
===================================================================================================
Package                     Architecture               Version                      Repository                   Size
===================================================================================================
Installing Groups:
C Development Tools and Libraries

Transaction Summary
Is this ok [y/N]: y
Complete!
But the app also doesn't compile

Same here!
linking with `cc` failed: exit status: 1
 = note: /usr/bin/ld: /usr/lib/gcc/x86_64-redhat-linux/14/../../../../lib64/libwebkit2gtk-4.1.so: undefined reference to `gst_video_info_dma_drm_from_caps'
          /usr/bin/ld: /usr/lib/gcc/x86_64-redhat-linux/14/../../../../lib64/libwebkit2gtk-4.1.so: undefined reference to `gst_video_is_dma_drm_caps'
          collect2: error: ld returned 1 exit status

Fedora 40 latest
gnome 46 wayland
Linux 6.8.5-301.fc40.x86_64

Same here, but on Manjaro!
error: linking with `cc` failed: exit status: 1

...

= note: /usr/bin/ld: warning: libicui18n.so.75, needed by /usr/lib/gcc/x86_64-pc-linux-gnu/13.2.1/../../../../lib/libwebkit2gtk-4.1.so, not found (try using -rpath or -rpath-link)
          /usr/bin/ld: warning: libicuuc.so.75, needed by /usr/lib/gcc/x86_64-pc-linux-gnu/13.2.1/../../../../lib/libwebkit2gtk-4.1.so, not found (try using -rpath or -rpath-link)
          /usr/bin/ld: warning: libjxl.so.0.11, needed by /usr/lib/gcc/x86_64-pc-linux-gnu/13.2.1/../../../../lib/libwebkit2gtk-4.1.so, not found (try using -rpath or -rpath-link)
          /usr/bin/ld: /usr/lib/gcc/x86_64-pc-linux-gnu/13.2.1/../../../../lib/libjavascriptcoregtk-4.1.so: undefined reference to `uloc_forLanguageTag_75'
          /usr/bin/ld: /usr/lib/gcc/x86_64-pc-linux-gnu/13.2.1/../../../../lib/libjavascriptcoregtk-4.1.so: undefined reference to `unumsys_openByName_75'

          ...

          /usr/bin/ld: /usr/lib/gcc/x86_64-pc-linux-gnu/13.2.1/../../../../lib/libwebkit2gtk-4.1.so: undefined reference to `JxlDecoderGetICCProfileSize@JXL_0'
          /usr/bin/ld: /usr/lib/gcc/x86_64-pc-linux-gnu/13.2.1/../../../../lib/libjavascriptcoregtk-4.1.so: undefined reference to `ucal_getTimeZoneDisplayName_75'
          /usr/bin/ld: /usr/lib/gcc/x86_64-pc-linux-gnu/13.2.1/../../../../lib/libwebkit2gtk-4.1.so: undefined reference to `udat_toPattern_75'
          /usr/bin/ld: /usr/lib/gcc/x86_64-pc-linux-gnu/13.2.1/../../../../lib/libjavascriptcoregtk-4.1.so: undefined reference to `ucfpos_constrainCategory_75'
          /usr/bin/ld: /usr/lib/gcc/x86_64-pc-linux-gnu/13.2.1/../../../../lib/libjavascriptcoregtk-4.1.so: undefined reference to `u_tolower_75'
          collect2: error: ld returned 1 exit status

  = note: some `extern` functions couldn't be found; some native libraries may need to be installed or have their path specified
  = note: use the `-l` flag to specify native libraries to link
  = note: use the `cargo:rustc-link-lib` directive to specify the native libraries to link with Cargo (see https://doc.rust-lang.org/cargo/reference/build-scripts.html#rustc-link-lib)
          /usr/bin/ld: /usr/lib/gcc/x86_64-pc-linux-gnu/13.2.1/../../../../lib/libjavascriptcoregtk-4.1.so: undefined reference to `ucal_getAttribute_75'
          /usr/bin/ld: /usr/lib/gcc/x86_64-pc-linux-gnu/13.2.1/../../../../lib/libwebkit2gtk-4.1.so: undefined reference to `unum_open_75'
          /usr/bin/ld: /usr/lib/gcc/x86_64-pc-linux-gnu/13.2.1/../../../../lib/libjavascriptcoregtk-4.1.so: undefined reference to `unorm2_getNFKCInstance_75'
          /usr/bin/ld: /usr/lib/gcc/x86_64-pc-linux-gnu/13.2.1/../../../../lib/libjavascriptcoregtk-4.1.so: undefined reference to `ucol_strcollUTF8_75'

Manjaro Linux 1.18.0
GNOME 46
Wayland
Linux 6.1.71-1-MANJARO


TFLiteConverter: ConvertError: loc("Func/StatefulPartitionedCall/input/_0"): requires all operands and results to have compatible element types

System information

OS Platform and Distribution: Manjaro running Ubuntu 18.04 under Docker (using the tensorflow/tensorflow:2.2.0-gpu-jupyter image)
TensorFlow installed from (source or binary): Using official docker image, actually not sure if it's source or binary.
TensorFlow version (or github SHA if from source): 2.2.0

Command used to run the converter or code if you’re using the Python API
If possible, please share a link to Colab/Jupyter/any notebook.
import sys
import os

import tensorflow as tf

def usage():
    proggie = os.path.basename(sys.argv[0])
    print(f"""\
Usage: {proggie} <input_saved_model_dir> <output>

Example: {proggie} output_inference_graph_v1.pb/saved_model converted_model.tflite""")

if __name__ == "__main__":
    if len(sys.argv) != 3 or '-h' in sys.argv or '--help' in sys.argv:
        usage()
        sys.exit(1)

    saved_model_dir, outfile = sys.argv[1:]
    converter = tf.lite.TFLiteConverter.from_saved_model(saved_model_dir)
    tflite_model = converter.convert()
    with tf.io.gfile.GFile('model.tflite', 'wb') as f:
        f.write(tflite_model)
    print(f"{outfile} written")

The output from the converter invocation
docker exec -ti tf2 \
        bash -c \
        "cd /tf/routespotter/training/routesv3/ && python /tf/routespotter/scripts/convert_to_tflite.py trained-inference-graphs/output/saved_model trained-inference-graphs/output/converted_model.tflite"
2020-07-29 21:30:35.933784: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcudart.so.10.1
2020-07-29 21:30:37.541131: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcuda.so.1
2020-07-29 21:30:37.554309: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1716] Found device 0 with properties:
pciBusID: 0000:65:00.0 name: GeForce GTX 1070 computeCapability: 6.1
coreClock: 1.835GHz coreCount: 15 deviceMemorySize: 7.93GiB deviceMemoryBandwidth: 238.66GiB/s
2020-07-29 21:30:37.554340: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcudart.so.10.1
2020-07-29 21:30:37.555786: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcublas.so.10
2020-07-29 21:30:37.557191: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcufft.so.10
2020-07-29 21:30:37.557467: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcurand.so.10
2020-07-29 21:30:37.558961: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcusolver.so.10
2020-07-29 21:30:37.559781: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcusparse.so.10
2020-07-29 21:30:37.562688: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcudnn.so.7
2020-07-29 21:30:37.563390: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1858] Adding visible gpu devices: 0
2020-07-29 21:30:37.563659: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN)to use the following CPU instructions in performance-critical operations:  AVX2 AVX512F FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
2020-07-29 21:30:37.569752: I tensorflow/core/platform/profile_utils/cpu_utils.cc:104] CPU Frequency:<PHONE_NUMBER> Hz
2020-07-29 21:30:37.571232: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0xaf61e40 initialized for platform Host (this does not guarantee that XLA will be used). Devices:
2020-07-29 21:30:37.571276: I tensorflow/compiler/xla/service/service.cc:176]   StreamExecutor device (0): Host, Default Version
2020-07-29 21:30:37.718561: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0xafcdab0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices:
2020-07-29 21:30:37.718596: I tensorflow/compiler/xla/service/service.cc:176]   StreamExecutor device (0): GeForce GTX 1070, Compute Capability 6.1
2020-07-29 21:30:37.719275: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1716] Found device 0 with properties:
pciBusID: 0000:65:00.0 name: GeForce GTX 1070 computeCapability: 6.1
coreClock: 1.835GHz coreCount: 15 deviceMemorySize: 7.93GiB deviceMemoryBandwidth: 238.66GiB/s
2020-07-29 21:30:37.719308: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcudart.so.10.1
2020-07-29 21:30:37.719337: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcublas.so.10
2020-07-29 21:30:37.719357: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcufft.so.10
2020-07-29 21:30:37.719375: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcurand.so.10
2020-07-29 21:30:37.719394: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcusolver.so.10
2020-07-29 21:30:37.719406: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcusparse.so.10
2020-07-29 21:30:37.719422: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcudnn.so.7
2020-07-29 21:30:37.720408: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1858] Adding visible gpu devices: 0
2020-07-29 21:30:37.720450: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcudart.so.10.1
2020-07-29 21:30:38.075379: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1257] Device interconnect StreamExecutor with strength 1 edge matrix:
2020-07-29 21:30:38.075416: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1263]      0
2020-07-29 21:30:38.075422: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1276] 0:   N
2020-07-29 21:30:38.076193: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1402] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 7091 MB memory) -> physical GPU (device: 0, name: GeForce GTX 1070, pci bus id: 0000:65:00.0, compute capability: 6.1)
2020-07-29 21:30:47.046860: I tensorflow/core/grappler/devices.cc:69] Number of eligible GPUs (core count >= 8, compute capability >= 0.0): 1
2020-07-29 21:30:47.046987: I tensorflow/core/grappler/clusters/single_machine.cc:356] Starting new session
2020-07-29 21:30:47.047691: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1716] Found device 0 with properties:
pciBusID: 0000:65:00.0 name: GeForce GTX 1070 computeCapability: 6.1
coreClock: 1.835GHz coreCount: 15 deviceMemorySize: 7.93GiB deviceMemoryBandwidth: 238.66GiB/s
2020-07-29 21:30:47.047721: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcudart.so.10.1
2020-07-29 21:30:47.047745: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcublas.so.10
2020-07-29 21:30:47.047755: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcufft.so.10
2020-07-29 21:30:47.047765: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcurand.so.10
2020-07-29 21:30:47.047775: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcusolver.so.10
2020-07-29 21:30:47.047788: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcusparse.so.10
2020-07-29 21:30:47.047798: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libcudnn.so.7
2020-07-29 21:30:47.048149: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1858] Adding visible gpu devices: 0
2020-07-29 21:30:47.048174: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1257] Device interconnect StreamExecutor with strength 1 edge matrix:
2020-07-29 21:30:47.048181: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1263]      0
2020-07-29 21:30:47.048188: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1276] 0:   N
2020-07-29 21:30:47.048560: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1402] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 7091 MB memory) -> physical GPU (device: 0, name: GeForce GTX 1070, pci bus id: 0000:65:00.0, compute capability: 6.1)
2020-07-29 21:30:47.229748: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:816] Optimization results for grappler item: graph_to_optimize
2020-07-29 21:30:47.229790: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:818]   function_optimizer: Graph size after: 4275 nodes (3787), 4874 edges (4379), time = 107.259ms.
2020-07-29 21:30:47.229795: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:818]   function_optimizer: function_optimizer did nothing. time = 3.916ms.
2020-07-29 21:30:51.658251: W tensorflow/compiler/mlir/lite/python/tf_tfl_flatbuffer_helpers.cc:313] Ignored output_format.
2020-07-29 21:30:51.658289: W tensorflow/compiler/mlir/lite/python/tf_tfl_flatbuffer_helpers.cc:316] Ignored drop_control_dependency.
loc("Func/StatefulPartitionedCall/input/_0"): error: requires all operands and results to have compatible element types
Traceback (most recent call last):
  File "/usr/local/lib/python3.6/dist-packages/tensorflow/lite/python/convert.py", line 199, in toco_convert_protos
    enable_mlir_converter)
  File "/usr/local/lib/python3.6/dist-packages/tensorflow/lite/python/wrap_toco.py", line 38, in wrapped_toco_convert
    enable_mlir_converter)
Exception: <unknown>:0: error: loc("Func/StatefulPartitionedCall/input/_0"): requires all operands and results to have compatible element types
<unknown>:0: note: loc("Func/StatefulPartitionedCall/input/_0"): see current operation: %1 = "tf.Identity"(%arg0) {device = ""} : (tensor<1x?x?x3x!tf.quint8>) -> tensor<1x?x?x3xui8>

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/tf/routespotter/scripts/convert_to_tflite.py", line 22, in <module>
    tflite_model = converter.convert()
  File "/usr/local/lib/python3.6/dist-packages/tensorflow/lite/python/lite.py", line 1076, in convert
    return super(TFLiteConverterV2, self).convert()
  File "/usr/local/lib/python3.6/dist-packages/tensorflow/lite/python/lite.py", line 900, in convert
    self).convert(graph_def, input_tensors, output_tensors)
  File "/usr/local/lib/python3.6/dist-packages/tensorflow/lite/python/lite.py", line 633, in convert
    **converter_kwargs)
  File "/usr/local/lib/python3.6/dist-packages/tensorflow/lite/python/convert.py", line 574, in toco_convert_impl
    enable_mlir_converter=enable_mlir_converter)
  File "/usr/local/lib/python3.6/dist-packages/tensorflow/lite/python/convert.py", line 202, in toco_convert_protos
    raise ConverterError(str(e))
tensorflow.lite.python.convert.ConverterError: <unknown>:0: error: loc("Func/StatefulPartitionedCall/input/_0"): requires all operands and results to have compatible element types
<unknown>:0: note: loc("Func/StatefulPartitionedCall/input/_0"): see current operation: %1 = "tf.Identity"(%arg0) {device = ""} : (tensor<1x?x?x3x!tf.quint8>) -> tensor<1x?x?x3xui8>

Also, please include a link to the saved model or GraphDef
Custom trained model based on ssd_resnet50_v1_fpn_640x640_coco17_tpu-8 by following the tensorflow-object-detection-api-tutorial. I know my custom trained model works because I've run it through the object_detection_tutorial using test images from my dataset and I get successful detections. Not sure if I'm just using an unsupported operand for tflite? Having a hard time deciphering the error message...
https://drive.google.com/file/d/1O_c12RAALroTomEvDaH8gwukYzNZDegq/view?usp=sharing

Failure details

Conversion process fails

RNN conversion support
If converting TF RNN to TFLite fused RNN ops, please prefix [RNN] in the title. :x:
Any other info / logs
See traceback above.

@mgalgs,
Looks like the issue has been resolved in the latest TF-nightly. I was able to convert the model successfully after adding the below lines to the code.
converter = tf.lite.TFLiteConverter.from_saved_model(saved_model_dir,signature_keys=['serving_default'])
converter.optimizations = [tf.lite.Optimize.DEFAULT]
converter.experimental_new_converter = True
converter.target_spec.supported_ops = [tf.lite.OpsSet.TFLITE_BUILTINS, tf.lite.OpsSet.SELECT_TF_OPS]

Please check this gist for reference. Thanks!

@amahendrakar awesome, that worked! Getting an error when I actually try to load the model on the mobile side but I think that might be a separate issue... I'll open another issue after some more debugging. Thanks again.

Same issue on ssd_mobilenet_v1_fpn_640x640_coco17_tpu-8 with tf v2.3

After installing tf-nightly, another issue occurs:

It seems like I can't import tf-nightly successfully.
Device info: Nvidia V100 on Azure.
Driver info:
+-----------------------------------------------------------------------------+
| NVIDIA-SMI 440.64.00    Driver Version: 440.64.00    CUDA Version: 10.2     |
|-------------------------------+----------------------+----------------------+
| GPU  Name        Persistence-M| Bus-Id        Disp.A | Volatile Uncorr. ECC |
| Fan  Temp  Perf  Pwr:Usage/Cap|         Memory-Usage | GPU-Util  Compute M. |
|===============================+======================+======================|
|   0  Tesla V100-PCIE...  On   | 00000001:00:00.0 Off |                    0 |
| N/A   27C    P0    24W / 250W |      0MiB / 16160MiB |      0%      Default |
+-------------------------------+----------------------+----------------------+

+-----------------------------------------------------------------------------+
| Processes:                                                       GPU Memory |
|  GPU       PID   Type   Process name                             Usage      |
|=============================================================================|
|  No running processes found                                                 |
+-----------------------------------------------------------------------------+

@DjangoPeng,
Could you please submit a new issue from this link and fill in the template, so that we can track the issue there. Thanks!

@amahendrakar I have done all the steps, using the cpu docker tensorflow
running::
import sys
import os
import tensorflow as tf
saved_model_dir = "/tmp/ssd_mobilenet_v2_fpnlite_640x640_coco17_tpu-8/saved_model/"
outfile = "/tmp/ssd_mobilenet_v2_fpnlite_640x640_coco17_tpu-8/saved_model/"
converter = tf.lite.TFLiteConverter.from_saved_model(saved_model_dir,signature_keys=['serving_default'])
converter.optimizations = [tf.lite.Optimize.DEFAULT]
converter.experimental_new_converter = True
converter.target_spec.supported_ops = [tf.lite.OpsSet.TFLITE_BUILTINS, tf.lite.OpsSet.SELECT_TF_OPS]
tflite_model = converter.convert()
with tf.io.gfile.GFile('model.tflite', 'wb') as f:
f.write(tflite_model)
print(f"{outfile} written")
the output is :
/tmp/ssd_mobilenet_v2_fpnlite_640x640_coco17_tpu-8/saved_model/ written
but there is no file written, what can be the problem?`

The issue still exists in TF 2.3.0. Is anyone still facing the same problem?

@mgalgs @smohan10 For converting SSD TF2 models to TFLite, could you see this comment? We are tracking TFLite support for TF2 ODAPI models there.


Adding an AllPromotableByGroundName for study promotions

This changes are being done in https://github.com/Mind-Sports-Games/strategygames/tree/464-support-studies


[Fix] no-unknown-property: properly recognise unknown HTML/DOM attributes

Closes #757 by...

renaming an old error message (unknownProp to unknownPropWithStandardName), since it reports an unknown property that is close (one lower/higher case letter) to an allowed (standard) name
adding a new error message (unknownProp) that is used when an unknown property (without a
listing all one word and multiple word valid HTML/DOM attributes, and aria-* attributes
adding a function that checks if attribute name is a valid data-* attribute
adding more unit test cases
moving one test that should have failed, from valid to invalid tests
updating rule documentation

What was not implemented in this PR:

mapping element specific tags to ATTRIBUTE_TAGS_MAP (e.g. attributes optimum, high and low should be used only on <meter> element)

While implementing these changes, I felt like I cannot be sure that this PR catches all valid HTML/DOM attributes. There are some listing on MDN and on React documentation, but I could still find attributes that weren't on these listing that I felt would be beneficial to be listed in this rule (for example, the Safari/Apple related autoCorrect and autoSave, and React related ref and defaultValue). So, I'm sure there will be cases that this PR has missed, and the community will find them if these changes are merged and published.
Feel free to tag some who knows HTML/DOM attributes well and can help with reviewing and possibly suggesting more new unit test cases.

Thanks!

I'm commenting here, because I think this is the best place to do it. I'm aware of the issues and errors that these changes caused. When making this PR, I was sure that I have missed some common scenarios that the community would find, and I was wondering should I ask or comment that could you @ljharb as a maintainer run some additional checks (like the smoke test) before releasing this. Being still a new contributor, I was shy and didn't dare to ask. Looking back now, I should have asked, and I will so better in the future.
Also, I am on another timezone than you are, so I wasn't awake when you released this and tagged me to the first issue. I'm happy that someone else from the community provided a quick fix 🛠 🤗

Hi! I want to say huge thanks for writing this change — it spotted some cases in our codebase that we would've never gotten to find without the help of this linter!
I figured it's nice to also hear some encouraging words and not merely bug reports :smile: I for one am thankful for the work you've done here 💞

Hi! I want to say huge thanks for writing this change — it spotted some cases in our codebase that we would've never gotten to find without the help of this linter!
I figured it's nice to also hear some encouraging words and not merely bug reports 😄 I for one am thankful for the work you've done here 💞

Thank you so much @valscion! Yes, it is nice to hear that it helped find bugs 🐛 💕 And I really appreciate you taking the time to write this comment, it really made my day 🤗


Delete 'Parallel Statement Execution'.

Fixes #4885.

This change is

Online preview: http://cockroach-docs-review.s3-website-us-east-1.amazonaws.com/990c06fcadd7b4eb4b0ea5b07ec9bb60858da213/

Online preview: http://cockroach-docs-review.s3-website-us-east-1.amazonaws.com/92f7f6a2953c8effe1e94f67410d02a1db332872/
Edited pages:

v19.2/create-sequence.md
v19.2/sql-feature-support.md

@nvanbenschoten this is "just" deleting the parallel stmt execution page (and all references, etc.) from the 19.2 docs.
AFAICT from looking at your PR, this is a straight-up removal.  Please let me know if you think any additional docs work is needed due to some nuance I don't understand on this.

The syntax is still supported, it just has no effect. So there are no real backward compat issues.

Ok. Thanks for that clarification, Nathan.


Expanding unit tests - mocking / stubbing / patching

With @agazso we discussed that there is a need for extended unit testing that would not really on the external Bee node but would be able to cover some test cases without that.
I suggested to start using library like spy or @fluffy-spoon/substitute. This could be introduced when working on the #197 issue.

Jest has built-in support for mock/spies: https://jestjs.io/docs/mock-function-api
It would be good to evaluate that to see if it works for our use-case.


Tile stats

TODO:

[ ] break out tile size improvements into separate PRs or issues
[ ] what data to emit? Could be:

tile-level (z,x,y->tile size)
deduped-tile-level (z,x,y->id, id->tile sizes)
layer-level (z,x,y,layer->layer sizes)
or layer/attribute level (z,x,y,layer,attr->size that attribute contributes to layer)

[x] what format to emit it in? allow to choose tsv.gz or json.gz (newline-delimited)
[ ] opt-into getting a tile-stats output file and its location
[ ] have a separate thread writing the stats files?
[ ] improve archive readers for full-scans
[ ] are there any top-level summaries that are consistently useful to emit? possibilities: top 10 biggest tiles, weighted average tile size, layer x zoom max layer size table, layer x zoom weighted average layer size table

Sounds good to me. Any thoughts on the formats?  Most recently I've been generated a single tsv.gz with columns:

z
x
y
hilbert
tile_bytes
gzipped_tile_bytes
deduped_tile_id
layer
features
layer_bytes
layer_attr_bytes
layer_attr_values
min_lon (these duplicate z,x,y data but make it easier to generate debug URLs to look at a tile, or filter within a bounding box)
max_lon
min_lat
max_lat

You can either split them out into 2 tables (z,x,y->id, and id,layer->stats) or duplicate all of the z,x,y tile IDs into one denormalized table.  Split makes it easy to query tile-level stats but duckdb struggles with joining to use tile coordinates with layer-level stats (too big to add an index), and denormalized makes it easier to work with layer-level stats, but duckdb struggles grouping by tile ID to get tile level stats.

And in terms of outputting a high-level summary, the most useful ones have been:

a single "weighted average tile size" (raw and gzipped)  number based on weighting tile sizes by top n most-visited osm tiles
the total archive size
a table of max layer size by layer and zoom
a list of the top N biggest tiles, along with which layers cause them to be big and z/lat/lon to generate a link to visually inspect them (there's probably overlap between biggest tiles and tiles with biggest layers - might want to merge the lists or something)

min_lon (these duplicate z,x,y data but make it easier to generate debug URLs to look at a tile, or filter within a bounding box)

Can we solve this via a DuckDB function definition instead of repeating information in the stats?

min_lon (these duplicate z,x,y data but make it easier to generate debug URLs to look at a tile, or filter within a bounding box)

Can we solve this via a DuckDB function definition instead of repeating information in the stats?

Yeah, it looks like that could work - would just need to put it in documentation somewhere for people to copy/paste:
D create or replace macro lat(z,y) as round((180/pi())*atan(0.5*(exp(pi()-2*pi()*(y/(2**z)))-exp(-(pi()-2*pi()*(y/(2**z)))))), 5);
D create or replace macro lon(z,x) as (180/pi())*atan(0.5*(exp(pi()-2*pi()*(y/(2**z)))-exp(-(pi()-2*pi()*(y/(2**z))))));
D create or replace macro url(z,x,y) as concat('https://onthegomap.github.io/planetiler-demo/#', z+0.5, '/', lat(z,y+0.5), '/', lon(z,x+0.5));
D select z,x,y,layer,round(layer_bytes/1000) as kbs, url(z,x,y) from stats order by layer_bytes desc limit 10;

returns:
┌───────┬───────┬───────┬─────────────┬────────┬───────────────────────────────────────────────────────────────────────┐
│   z   │   x   │   y   │    layer    │  kbs   │                             url(z, x, y)                              │
│ int64 │ int64 │ int64 │   varchar   │ double │                                varchar                                │
├───────┼───────┼───────┼─────────────┼────────┼───────────────────────────────────────────────────────────────────────┤
│    14 │ 13722 │  7013 │ housenumber │ 2412.0 │ https://onthegomap.github.io/planetiler-demo/#14.5/25.05575/121.51978 │
│    14 │ 13723 │  7014 │ housenumber │ 1850.0 │ https://onthegomap.github.io/planetiler-demo/#14.5/25.03584/121.54175 │
│    14 │ 13723 │  7013 │ housenumber │ 1827.0 │ https://onthegomap.github.io/planetiler-demo/#14.5/25.05575/121.54175 │
│    14 │  6435 │  8361 │ building    │ 1761.0 │ https://onthegomap.github.io/planetiler-demo/#14.5/-3.72175/-38.59497 │
│    14 │ 13724 │  7014 │ housenumber │ 1626.0 │ https://onthegomap.github.io/planetiler-demo/#14.5/25.03584/121.56372 │
│    14 │ 13667 │  7134 │ housenumber │ 1597.0 │ https://onthegomap.github.io/planetiler-demo/#14.5/22.62415/120.31128 │
│    14 │  6435 │  8364 │ building    │ 1550.0 │ https://onthegomap.github.io/planetiler-demo/#14.5/-3.78752/-38.59497 │
│    14 │  6435 │  8363 │ building    │ 1510.0 │ https://onthegomap.github.io/planetiler-demo/#14.5/-3.7656/-38.59497  │
│    14 │ 13683 │  7058 │ housenumber │ 1472.0 │ https://onthegomap.github.io/planetiler-demo/#14.5/24.15678/120.66284 │
│    14 │ 13724 │  7013 │ housenumber │ 1460.0 │ https://onthegomap.github.io/planetiler-demo/#14.5/25.05575/121.56372 │
├───────┴───────┴───────┴─────────────┴────────┴───────────────────────────────────────────────────────────────────────┤
│ 10 rows                                                                                6 columns │
└──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┘

There's a benefit to having it persisted in parquet file to allow efficient bbox filtering, but if you're going to go through duckdb to create a parquet file you could just add it there.

@bdon what do you think about the different format options?

tile-level (z,x,y->tile size)
deduped-tile-level (z,x,y->id, id->tile sizes)
layer-level (z,x,y,layer->layer sizes)
or layer/attribute level (z,x,y,layer,attr->size that attribute contributes to layer)

I don't think we care about deduplicated data, since deduped data is uninteresting for stats 99.9% of the time
layer/attribute level is the most interesting, and the most useful for situations like we're doing in protomaps/basemaps where many types of things are combined into the landuse, pois and roads layer

so #4 would be great (though unclear to me what the TSV looks like),  then #3, #1, #2

OK that makes sense. Would you omit "deduped_tile_id" column as well? Or "hilbert"?
I was thinking 4 would be something like: z, x, y, layer, attribute/geom, size so you could see the size contributed by geometry vs. individual attributes. It would be expensive to compute and large, but might make sense if you're looking at a small number of tiles or low-zoom area. But it sound like maybe you're looking for total size of features that have certain attributes set?
Unfortunately it's hard to get tile-level stats from 3 since duckdb runs out of memory on the huge "group by" unless you limit to a small set of tiles first.
One other route to go might be to have a row per tile, and included nested data in it... for example if you import a file:
{"id":1,"layers":[{"id":"layer1","size":100}, {"id":"layer2","size":200}]}
{"id":2,"layers":[{"id":"layer2","size":300}, {"id":"layer3","size":400}]}

Then you can do:
D select * from stats;
┌───────┬────────────────────────────────────────────────────────────┐
│  id   │                           layers                           │
│ int64 │             struct(id varchar, size bigint)[]              │
├───────┼────────────────────────────────────────────────────────────┤
│     1 │ [{'id': layer1, 'size': 100}, {'id': layer2, 'size': 200}] │
│     2 │ [{'id': layer2, 'size': 300}, {'id': layer3, 'size': 400}] │
└───────┴────────────────────────────────────────────────────────────┘
select id, unnest(layers).id, unnest(layers).size from stats;
┌───────┬─────────────────────┬───────────────────────┐
│  id   │ (unnest(layers)).id │ (unnest(layers)).size │
│ int64 │       varchar       │         int64         │
├───────┼─────────────────────┼───────────────────────┤
│     1 │ layer1              │                   100 │
│     1 │ layer2              │                   200 │
│     2 │ layer2              │                   300 │
│     2 │ layer3              │                   400 │
└───────┴─────────────────────┴───────────────────────┘

I'm not sure how performant querying that would be though, might be worth a test.

I tried outputting newline-delimited json that looks like:
{"z":0,"x":0,"y":0,"hilbert":0,"total_bytes":142374,"gzipped_bytes":82957,"layers":[{"name":"water","features":2,"total_bytes":8435,"attr_bytes":18,"attr_values":2},{"name":"landcover","features":11,"total_bytes":1578,"attr_bytes":27,"attr_values":2},{"name":"place","features":42,"total_bytes":115614,"attr_bytes":82249,"attr_values":4363},{"name":"water_name","features":6,"total_bytes":7042,"attr_bytes":5541,"attr_values":238},{"name":"boundary","features":32,"total_bytes":9689,"attr_bytes":807,"attr_values":37}]}
{"z":1,"x":0,"y":0,"hilbert":1,"total_bytes":103276,"gzipped_bytes":64171,"layers":[{"name":"water","features":2,"total_bytes":4139,"attr_bytes":18,"attr_values":2},{"name":"landcover","features":3,"total_bytes":468,"attr_bytes":27,"attr_values":2},{"name":"place","features":29,"total_bytes":68351,"attr_bytes":47302,"attr_values":2493},{"name":"water_name","features":7,"total_bytes":7136,"attr_bytes":5562,"attr_values":245},{"name":"boundary","features":13,"total_bytes":23165,"attr_bytes":277,"attr_values":14}]}
{"z":1,"x":0,"y":1,"hilbert":2,"total_bytes":38635,"gzipped_bytes":24721,"layers":[{"name":"water","features":2,"total_bytes":1340,"attr_bytes":18,"attr_values":2},{"name":"landcover","features":8,"total_bytes":982,"attr_bytes":27,"attr_values":2},{"name":"place","features":10,"total_bytes":25423,"attr_bytes":17164,"attr_values":915},{"name":"water_name","features":3,"total_bytes":3102,"attr_bytes":2431,"attr_values":97},{"name":"boundary","features":5,"total_bytes":7772,"attr_bytes":37,"attr_values":5}]}
{"z":1,"x":1,"y":1,"hilbert":3,"total_bytes":91365,"gzipped_bytes":52859,"layers":[{"name":"water","features":2,"total_bytes":2206,"attr_bytes":18,"attr_values":2},{"name":"landcover","features":1,"total_bytes":521,"attr_bytes":27,"attr_values":2},{"name":"place","features":23,"total_bytes":66179,"attr_bytes":48121,"attr_values":2174},{"name":"water_name","features":4,"total_bytes":6010,"attr_bytes":4716,"attr_values":196},{"name":"boundary","features":6,"total_bytes":16432,"attr_bytes":66,"attr_values":6}]}
{"z":1,"x":1,"y":0,"hilbert":4,"total_bytes":275506,"gzipped_bytes":166904,"layers":[{"name":"water","features":2,"total_bytes":3647,"attr_bytes":18,"attr_values":2},{"name":"place","features":76,"total_bytes":191026,"attr_bytes":129687,"attr_values":7421},{"name":"water_name","features":5,"total_bytes":5869,"attr_bytes":4640,"attr_values":193},{"name":"boundary","features":55,"total_bytes":74950,"attr_bytes":1212,"attr_values":55}]}

The raw json.gz file was 3.3GB, duckdb file was 1.8GB and exported parquet file was 1.4GB.  You can query tile-level stats instantly:
select z,x,y,gzipped_bytes from 'nested_stats.parquet' order by gzipped_bytes desc limit 10;

But a layer-level query takes 40 seconds:
select z,x,y,unnest(layers).name,unnest(layers).total_bytes from stats order by unnest(layers).total_bytes desc limit 10;

vs. this query which is instant with option 3:
select z,x,y,layer,layer_bytes from flat order by layer_bytes desc limit 10;

But if you know you are going to be doing layer-level  analysis you could create an unnested table once (~60 seconds), then use it for instant layer-level queries afterwards:
create table unnested as (select z,x,y,unnest(layers) layer from stats); -- ~60 seconds
select z,x,y,layer.name,layer.total_bytes from unnested order by layer.total_bytes desc limit 10; -- instant

@msbarry I would omit both of those, and simply not include any tile that occurs more than once in the statistics (anything I'm missing here?)
My PoC is here: https://github.com/protomaps/go-pmtiles/pull/75
for now it just outputs a .tsv.gz with z,x,y,compressed_length contents
next steps:

should we decide on a naming convention for these files? if I run pmtiles stats foo.pmtiles it will create the sidecar foo.pmtiles.stats.tsv.gz
How do you determine the bytes by each layer, by looking at the protobuf message length? I'm using https://github.com/paulmach/orb which unmarshals MVT straight to GeoJSON-like Simple Features, so I may need to use the raw protobuf-generated functions
would it make sense for the duckdb utility functions and rough spec to live in the planetiler repo at a dir like /stats? if so I can make go-pmtiles just follow that.

should we decide on a naming convention for these files? if I run pmtiles stats foo.pmtiles it will create the sidecar foo.pmtiles.stats.tsv.gz

That sounds good to me, I could foresee wanting different flavors of stats so maybe foo.pmtiles.tilestats.tsv.gz or foo.pmtiles.layerstats.tsv.gz ?

How do you determine the bytes by each layer, by looking at the protobuf message length? I'm using https://github.com/paulmach/orb which unmarshals MVT straight to GeoJSON-like Simple Features, so I may need to use the raw protobuf-generated functions

Yeah you need to parse raw protobuf.  I'm pretty sure the tile is just a series of concatenated layers, and the java library at least lets you get the serialized byte length of a parsed proto struct.  You could probably also decompress with a very simple schema to only separate the layers (it just passes through all the unrecognized fields)
message Tile {
  message Layer {
    required string name = 1;
  }
  repeated Layer layers = 3;
}

would it make sense for the duckdb utility functions and rough spec to live in the planetiler repo at a dir like /stats? if so I can make go-pmtiles just follow that.

Yeah, anywhere common would work but would definitely be useful to have some common queries listed out (especially the z/x/y -> lat/lon macro)

I realized the term "tilestats" is taken by https://github.com/mapbox/mapbox-geostats and well used by default output from tippecanoe so we should go with "layerstats"
I prefer we have one omnibus stats file instead of multiple flavors, as long is it's fast in DuckDB
maybe we could have .layerstats imply .tsv.gz? I don't think the .gz bit is useful if we're not expanding this in Finder (it would be really big) - so just planet.pmtiles.layerstats
If gzipping is the bottleneck maybe we should use zstd, lzw or lzma? prefer something that's in the go stdlib (lzw, gzip) but open to others

I realized the term "tilestats" is taken by https://github.com/mapbox/mapbox-geostats and well used by default output from tippecanoe so we should go with "layerstats"

👍

I prefer we have one omnibus stats file instead of multiple flavors, as long is it's fast in DuckDB

Sounds good, after more testing I think layer to tile grouping should be reasonably fast enough. Just thinking if we went down to attribute stats that would be a lot bigger?

maybe we could have .layerstats imply .tsv.gz? I don't think the .gz bit is useful if we're not expanding this in Finder (it would be really big) - so just planet.pmtiles.layerstats

The benefit of naming .tsv.gz is that it tells duckdb how to parse it without any explicit instructions (select * from 'planet.pmtiles.layerstats.tsv.gz')

If gzipping is the bottleneck maybe we should use zstd, lzw or lzma? prefer something that's in the go stdlib (lzw, gzip) but open to others

Gzipping takes ~3m for the planet, maybe less with a smaller format so probably not a big enough deal to worry about...

For the actual stats format I think we definitely need:

z
x
y
gzipped_tile_bytes
layer
layer_bytes

then maybe:

hilbert ID
layer_attr_bytes
features
tile_bytes (can be derived from sum(layer_bytes))
layer_attr_values
deduped_tile_id (or tile hash, something to indicate deduplication)

then I think we can skip the {min,max}_{lon,lat} values
Are there any "maybes" you think would also be useful to include @bdon ?

If we have deduped_tile_id it should be an opaque type not not necessarily a hash (I will use offset uint64)

more notes while implementing:

instead of gzipped_tile_bytes why not archived_bytes,  that makes it clear it is the size of the tile at-rest in the archive, not the result of gzipping the raw tile data which might be different depending on gzip params and implementation
should we sort the layers alphabetically? it would be ideal if the output of planetiler and go-pmtiles was identical

Ran on the planet with these settings used by openstreetmap-americana
https://github.com/ZeLonewolf/planetiler-scripts/blob/2c2c7e3a9f045b1e44e31226b1b2e5d6b4412510/local/render_once.sh#L30-L37

The output tsv.gz file was 2.8GB


Create dataset loader for Thai Toxicity Tweet Corpus

Dataloader name: thai_toxicity_tweet/thai_toxicity_tweet.py
DataCatalogue: http://seacrowd.github.io/seacrowd-catalogue/card.html?thai_toxicity_tweet

Dataset
thai_toxicity_tweet

Description
Thai Toxicity Tweet Corpus contains 3,300 tweets (506 tweets with texts missing) annotated by humans with guidelines including a 44-word dictionary. The author acquired 2,027 toxic and 1,273 non-toxic tweets, which were manually labeled by three annotators. Toxicity is defined by the author as any message conveying harmful, damaging, or negative intent, in accordance with their defined criteria for toxicity.

Subsets
-

Languages
tha

Tasks
Text Classification

License
Creative Commons Attribution Non Commercial 4.0 (cc-by-nc-4.0)

Homepage
https://github.com/tmu-nlp/ThaiToxicityTweetCorpus/

HF URL
https://huggingface.co/datasets/thai_toxicity_tweet

Paper URL
https://www.ta-cos.org/sites/ta-cos.org/files/1_W32.pdf

#self-assign

@holylovenia Not sure if any of the current tasks suit this dataset, maybe adding something like HATE_CLASSIFICATION or TOXICITY_CLASSIFICATION would work?


absorbing boundary for electromagnetic scattering problem: BoundaryIntegrator query

Hello, I am trying an electromagnetic scattering problem (in complex alg and time harmonic) using Nedelec finite elements. I use first-order absorbing boundary conditions for truncation, which in the weak form turns to be like: (n x V, n x E) on the boundary. V , E are the test and trial functions respectively, and n the normal vector. Are there any examples where this has been dealt before ?
Or can anyone suggest me with how to implement this in MFEM.
Thanks in advance

Hi, @tomathew ,
I don't think we have an example of this in the master branch of MFEM yet but we have been working on this.  Have a look at hertz_solver in the hertz-dev branch.  It's surprisingly simple.  You just need to add a mass matrix, with an appropriate coefficient, to the imaginary part of your system matrix.
Best wishes,
Mark

Thank you very much. I should say with regrets, that I am new to this platform (in fact I came across this website yesterday). I am really flattered by the fact that you have seamless Hypre integration, (especially the AMS). I can see from your last reply (thanks !) the impedance matching type applied to the 'transient' case, but as I said I am working with the time-harmonic form, where the weak form (shown in complex alg, but I will be working with 2x2 block real form) here.

As you can see, there is a bilinear contribution from (n x V, n x E) on the boundary \Gamma. As similar to CurlCurlIntegrator which takes care of (\nabla x V, \nabla x E) in mfem, I was looking for the former's equivalent one (with unit normal boundary vector). Do I need to make a new integrator for this ?
Thanks again,very much looking forward to try this platform
Best

Hi, @tomathew ,
Our transient solver is called maxwell but I was in fact referring to our time-harmonic solver named hertz.   The time-harmonic solver should be available at the link I sent.  If that's not working the answer is simple enough.  The bilinear form (n x V, n x E)_Gamma is equivalent to (V, E)_Gamma because Nedelec basis functions which are not tangent to the boundary integrate to zero on the boundary by construction.  Consequently we can use a VectorFEMassIntegrator to integrate this term on the boundary by adding it to the BilinearForm like this:
ParBilinearForm ai(fes); \\ bilinear form for the imaginary portion of the operator
ai.AddBoundaryIntegrator(new VectorFEMassIntegrator(impedCoef));

Adding this integrator as a "boundary" integrator rather than a "domain" integrator essentially plays the same role as using "n x" in each slot of the bilinear form.
Best wishes,
Mark

Thank you very much. Sorry, my bad to think of hertz in time domain (out of bed :), and I was also looking for ABC in your examples/miniapp/electromagnetics page, and got carried away). So, the basis functions takes care of everything, nice !. Now, this is clear ! ( the current platform I am working doesn't have these robust Nedelec basis meanings at boundary). Thank you very much ! Looks like I'll be back with another query soon !


docs: removed navigation title from sidebar to docs dropdown

Please answer these questions before submitting a pull request

Why submit this pull request?

[ ] Bugfix

[x] New feature provided

[ ] Improve performance

[ ] Backport patches

Related issues
#360 from apisix-website

Bugfix

Description
to remove navigation title from sidebar to docs dropdown
How to fix?

New feature or improvement

Describe the details and related test reports.

Backport patches

Why need to backport?

Source branch
nav

Related commits and pull requests

Target branch
master

cc @juzhiyuan PTAL


pycryptodome dependency

Getting Following error on installation

Have you tried removing pycryptodome completely and reinstalling the compatible version?

Yes, I uninstall completely and install 3.18, hence frappe also give compatibality error as Frappe require 3.10 and payment need 3.18

Thanks
The issue is sorted in Frappe latest update v14.49.0


Force failing mocha tests to return a exit code of 1

Fixes #651

Coverage remained the same at 68.708% when pulling 03d26e39c71d82e2b2a1acacbb200adcb3accd26 on Tyriar:651_fix_travis_fail into 64d3c089a20ed6533cb7518fbfb66a4c57df4fd1 on sourcelair:master.


Fixed --check-env Functionality

Something got moved preventing --check-env working for certain toolchains. This was easily fixed by importing have_exec to those toolchain's python files.

@ryancj14 Merged, thanks for the fix.


Add more states to the tracker status enum

May I make a suggestion. Currently you have following TrackerStates:
public enum TrackerState
{
Ok,
Offline,
InvalidResponse
}
Could you also add Unknown and connecting Connecting.
Looks like here is the right place to set tracker state now.
All trackers should start with Unknown state, once you start connecting, you change it to Connencting.
If connection succeed, you change it to Ok, if fails - to Offline or InvalidResponse.

Thanks!!!


Vault token renewal error

Describe the problem
After long running period bank-baults library can't renew token.
Expected Behavior
Flawless token renewal
Actual Behavior
Vault token renewal error: Error making API request.

URL: PUT http://cp-launcher-vault:8200/v1/auth/token/renew-self
Code: 400. Errors:

* lease expired
Received new Vault token
Renewed Vault Token
Vault token renewal error: Error making API request.

Nice template, thank you for reporting this!


feat: add an option to have bcc recipient for emails sent through proposal status actions

Description
Add an option to have bcc recipient for emails sent through proposal status actions.
Motivation and Context
In STFC emails that we send, we need to include option to have bcc recipients.
How Has This Been Tested
Manually, Tests
Fixes
https://github.com/UserOfficeProject/issue-tracker/issues/1120
Changes
apps/backend/src/eventHandlers/MailService/SMTPMailService.ts
apps/backend/src/models/Settings.ts
apps/backend/db_patches/0158_BccRecipientAppSetting.sql
Tests included/Docs Updated?

[ ] I have added tests to cover my changes.
[ ] All relevant doc has been updated

It looks like a generic solution based on the BCC_EMAIL and the description; however, it is not. I am considering two options: the first is that BCC_EMAIL should be SMTP_BCC_EMAIL. In this case, we could say that this is a special setting which works in a specific case (SMTPMailService). The other solution could be to use the BCC in the SparkPost service as well.
Additionally, the BCC will be used when CALL_CREATED or PROPOSAL_SUBMITTED events occur, not just when "proposal status actions" happen. Is this okay?

Sure, I can change the name to SMTP_BCC_EMAIL. Yes, we need to add bcc for all set of mails. Gradually planning to move everything from handler to proposal status actions.


Suggestion: sticks from the I Like Wood mod get lit in the campfire as well

Please support I Like Wood sticks as well.

This is the response I've got from the 'I Like Wood' dev on GitHub on this issue:

This could easily be done by adding sticks to the Forge tag for sticks. Unfortunately, nothing I can do right now on my end

Ha, that was actually my comment on the I Like Wood page. So, like I said, we will have to wait for the I Like Wood dev to make a Forge tag for sticks

owwww! you were on their GitHub! xD

ok sorry


Generic "edit content wrapper" permission at front end

Added generic permission #8506

Given our needs, we decided to close the pr and implement the functionality in one of our modules.


Command fails with: property 'AdditionalProperties' does not exist on type  'microsoft.management..'

i'm working on this script to export policies from one Microsoft tenant and re create them in another tenant.
the script is as follows:
$compliancePolicies = Get-MgDeviceManagementDeviceCompliancePolicy
$configurationProfiles = Get-MgBetaDeviceManagementDeviceConfiguration
$exportcompliancePolicies = $compliancePolicies | Export-Clixml -Path $compliancePoliciesPath
$exportconfigurationProfiles = $configurationProfiles | Export-Clixml -Path $configurationProfilesPath
Disconnect-MgGraph
$importcompliancePolicies = Import-Clixml -Path $compliancePoliciesPath
$importconfigurationProfiles = Import-Clixml -Path $configurationProfilesPath
Connect-MgGraph -Scopes DeviceManagementConfiguration.ReadWrite.All
$importcompliancePolicies | New-MgDeviceManagementDeviceCompliancePolicy
the last command fails with this error:
New-MgDeviceManagementDeviceCompliancePolicy : The property 'AdditionalProperties' does not exist on type  'microsoft.management.services.api.deviceComplianceDeviceOverview'. Make sure to only use property names that are defined by the type. Status: 400 (BadRequest) ErrorCode: ModelValidationFailure
which is a bit puzzeling since your documentation has [-AdditionalProperties <Hashtable>] as the first option for the command.
if i check the "AdditionalProperties" for type, i get this:
$importcompliancePolicies[0].AdditionalProperties.GetType()
IsPublic IsSerial Name                                     BaseType
True     True     Hashtable                                System.Object
which seems to be in lien with what the documentation is asking for.
let me know what other information i can provide.
I've tried the beta version of graph and it fails with the exact error.
it also fails creating the configuration profiles (New-MgBetaDeviceManagementDeviceConfiguration)

Transferring issue to the SDK repo as it's not docs related.


[proposal] Show Dart version in "Flutter SDK releases"

I could not find this in search, so asking here.
I have a problem with the current 'stable' channel Dart SDK version and want to try the more recent flutter dev builds.
Before I start spending time on that I need to check if the dev build Dart SDK is the version where my problem was already fixed (namely 2.3.1-dev.0.0).
Where can I see which version of the Dart SDK is included in each flutter dev build?
E.g. Flutter v1.6.0 - Dart 2.3.0, etc?

@duzenko
Revisiting this issue, if you check the flutter sdk release documentation: https://docs.flutter.dev/development/tools/sdk/releases?tab=macos
Here, it shows the version along with Dart version as below:

Does this help to answer your proposal ?


WIP

About this change - What it does

References: #xxxxx
Why this way

We decided to reimplement the parsing part in Go, too big as an effort to not resolving completely all the issues in the parser. A rewrite its needed


Synthesis failed for redis

Hello! Autosynth couldn't regenerate redis. :broken_heart:
Please investigate and fix this issue within 5 business days.  While it remains broken,
this library cannot be updated with changes to the redis API, and the library grows
stale.
See https://github.com/googleapis/synthtool/blob/master/autosynth/TroubleShooting.md
for trouble shooting tips.
Here's the output from running synth.py:
 release-please.yml if it already exists (#1059)
2021-04-27 03:07:19,887 autosynth [DEBUG] > Running: git checkout e7d77d65f0e05ce584c1a824c7ecab53b411498b
Note: checking out 'e7d77d65f0e05ce584c1a824c7ecab53b411498b'.

You are in 'detached HEAD' state. You can look around, make experimental
changes and commit them, and you can discard any commits you make in this
state without impacting any branches by performing another checkout.

If you want to create a new branch to retain commits you create, you may
do so (now or later) by using -b with the checkout command again. Example:

  git checkout -b <new-branch-name>

HEAD is now at e7d77d65 fix: specify valid go_package option
2021-04-27 03:07:19,902 autosynth [DEBUG] > Running: git branch -f autosynth-redis-322
2021-04-27 03:07:19,907 autosynth [DEBUG] > Running: git checkout autosynth-redis-322
Switched to branch 'autosynth-redis-322'
2021-04-27 03:07:19,935 autosynth [INFO] > Running synthtool
2021-04-27 03:07:19,935 autosynth [INFO] > ['/tmpfs/src/github/synthtool/env/bin/python3', '-m', 'synthtool', '--metadata', 'synth.metadata', 'synth.py', '--']
2021-04-27 03:07:19,935 autosynth [DEBUG] > log_file_path: /tmpfs/src/logs/Redis/322/sponge_log.log
2021-04-27 03:07:19,937 autosynth [DEBUG] > Running: /tmpfs/src/github/synthtool/env/bin/python3 -m synthtool --metadata synth.metadata synth.py --
2021-04-27 03:07:20,170 synthtool [DEBUG] > Executing /home/kbuilder/.cache/synthtool/google-cloud-php/Redis/synth.py.
On branch autosynth-redis-322
nothing to commit, working tree clean
2021-04-27 03:07:20,340 synthtool [DEBUG] > Ensuring dependencies.
DEBUG:synthtool:Ensuring dependencies.
2021-04-27 03:07:20,350 synthtool [DEBUG] > Using precloned repo /home/kbuilder/.cache/synthtool/synthtool
DEBUG:synthtool:Using precloned repo /home/kbuilder/.cache/synthtool/synthtool
2021-04-27 03:07:20,355 synthtool [DEBUG] > Cloning googleapis.
DEBUG:synthtool:Cloning googleapis.
2021-04-27 03:07:20,355 synthtool [DEBUG] > Using precloned repo /home/kbuilder/.cache/synthtool/googleapis
DEBUG:synthtool:Using precloned repo /home/kbuilder/.cache/synthtool/googleapis
2021-04-27 03:07:20,359 synthtool [DEBUG] > Which version of bazel will I run?
DEBUG:synthtool:Which version of bazel will I run?
bazel 3.0.0
2021-04-27 03:07:20,363 synthtool [DEBUG] > Generating code for: //google/cloud/redis/v1beta1:google-cloud-redis-v1beta1-php.
DEBUG:synthtool:Generating code for: //google/cloud/redis/v1beta1:google-cloud-redis-v1beta1-php.
2021-04-27 03:07:20,626 synthtool [ERROR] > Failed executing bazel --max_idle_secs=240 build //google/cloud/redis/v1beta1:google-cloud-redis-v1beta1-php:

Loading:
Loading: 0 packages loaded
DEBUG: /home/kbuilder/.cache/bazel/_bazel_kbuilder/a732f932c2cbeb7e37e1543f189a2a73/external/rules_python/python/pip.bzl:61:5: DEPRECATED: the pip_repositories rule has been replaced with pip_install, please see rules_python 0.1 release notes
Analyzing: target //google/cloud/redis/v1beta1:google-cloud-redis-v1beta1-php (1 packages loaded, 0 targets configured)
ERROR: /home/kbuilder/.cache/bazel/_bazel_kbuilder/a732f932c2cbeb7e37e1543f189a2a73/external/upb/bazel/upb_proto_library.bzl:257:29: aspect() got unexpected keyword argument 'incompatible_use_toolchain_transition'
ERROR: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/redis/v1beta1/BUILD.bazel:183:1: error loading package '@com_github_grpc_grpc//src/compiler': in /home/kbuilder/.cache/bazel/_bazel_kbuilder/a732f932c2cbeb7e37e1543f189a2a73/external/com_github_grpc_grpc/bazel/grpc_build_system.bzl: Extension file 'bazel/upb_proto_library.bzl' has errors and referenced by '//google/cloud/redis/v1beta1:redis_php_grpc'
ERROR: Analysis of target '//google/cloud/redis/v1beta1:google-cloud-redis-v1beta1-php' failed; build aborted: error loading package '@com_github_grpc_grpc//src/compiler': in /home/kbuilder/.cache/bazel/_bazel_kbuilder/a732f932c2cbeb7e37e1543f189a2a73/external/com_github_grpc_grpc/bazel/grpc_build_system.bzl: Extension file 'bazel/upb_proto_library.bzl' has errors
INFO: Elapsed time: 0.249s
INFO: 0 processes.
FAILED: Build did NOT complete successfully (3 packages loaded, 0 targets configured)
FAILED: Build did NOT complete successfully (3 packages loaded, 0 targets configured)

ERROR:synthtool:Failed executing bazel --max_idle_secs=240 build //google/cloud/redis/v1beta1:google-cloud-redis-v1beta1-php:

Loading:
Loading: 0 packages loaded
DEBUG: /home/kbuilder/.cache/bazel/_bazel_kbuilder/a732f932c2cbeb7e37e1543f189a2a73/external/rules_python/python/pip.bzl:61:5: DEPRECATED: the pip_repositories rule has been replaced with pip_install, please see rules_python 0.1 release notes
Analyzing: target //google/cloud/redis/v1beta1:google-cloud-redis-v1beta1-php (1 packages loaded, 0 targets configured)
ERROR: /home/kbuilder/.cache/bazel/_bazel_kbuilder/a732f932c2cbeb7e37e1543f189a2a73/external/upb/bazel/upb_proto_library.bzl:257:29: aspect() got unexpected keyword argument 'incompatible_use_toolchain_transition'
ERROR: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/redis/v1beta1/BUILD.bazel:183:1: error loading package '@com_github_grpc_grpc//src/compiler': in /home/kbuilder/.cache/bazel/_bazel_kbuilder/a732f932c2cbeb7e37e1543f189a2a73/external/com_github_grpc_grpc/bazel/grpc_build_system.bzl: Extension file 'bazel/upb_proto_library.bzl' has errors and referenced by '//google/cloud/redis/v1beta1:redis_php_grpc'
ERROR: Analysis of target '//google/cloud/redis/v1beta1:google-cloud-redis-v1beta1-php' failed; build aborted: error loading package '@com_github_grpc_grpc//src/compiler': in /home/kbuilder/.cache/bazel/_bazel_kbuilder/a732f932c2cbeb7e37e1543f189a2a73/external/com_github_grpc_grpc/bazel/grpc_build_system.bzl: Extension file 'bazel/upb_proto_library.bzl' has errors
INFO: Elapsed time: 0.249s
INFO: 0 processes.
FAILED: Build did NOT complete successfully (3 packages loaded, 0 targets configured)
FAILED: Build did NOT complete successfully (3 packages loaded, 0 targets configured)

Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 102, in <module>
    main()
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 829, in __call__
    return self.main(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 782, in main
    rv = self.invoke(ctx)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 1066, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 610, in invoke
    return callback(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 94, in main
    spec.loader.exec_module(synth_module)  # type: ignore
  File "<frozen importlib._bootstrap_external>", line 678, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/kbuilder/.cache/synthtool/google-cloud-php/Redis/synth.py", line 29, in <module>
    bazel_target='//google/cloud/redis/v1beta1:google-cloud-redis-v1beta1-php',
  File "/tmpfs/src/github/synthtool/synthtool/gcp/gapic_bazel.py", line 66, in php_library
    return self._generate_code(service, version, "php", clean_build, **kwargs)
  File "/tmpfs/src/github/synthtool/synthtool/gcp/gapic_bazel.py", line 204, in _generate_code
    shell.run(bazel_run_args)
  File "/tmpfs/src/github/synthtool/synthtool/shell.py", line 39, in run
    raise exc
  File "/tmpfs/src/github/synthtool/synthtool/shell.py", line 33, in run
    encoding="utf-8",
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 438, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['bazel', '--max_idle_secs=240', 'build', '//google/cloud/redis/v1beta1:google-cloud-redis-v1beta1-php']' returned non-zero exit status 1.
2021-04-27 03:07:20,679 autosynth [ERROR] > Synthesis failed
2021-04-27 03:07:20,679 autosynth [DEBUG] > Running: git reset --hard HEAD
HEAD is now at 7b571cd4 feat: Allow RequestWrapperTrait to use its auth cache when fetching ADC (#3959)
2021-04-27 03:07:20,722 autosynth [DEBUG] > Running: git checkout autosynth-redis
Switched to branch 'autosynth-redis'
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 356, in <module>
    main()
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 191, in main
    return _inner_main(temp_dir)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 336, in _inner_main
    commit_count = synthesize_loop(x, multiple_prs, change_pusher, synthesizer)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 68, in synthesize_loop
    has_changes = toolbox.synthesize_version_in_new_branch(synthesizer, youngest)
  File "/tmpfs/src/github/synthtool/autosynth/synth_toolbox.py", line 259, in synthesize_version_in_new_branch
    synthesizer.synthesize(synth_log_path, self.environ)
  File "/tmpfs/src/github/synthtool/autosynth/synthesizer.py", line 120, in synthesize
    synth_proc.check_returncode()  # Raise an exception.
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 389, in check_returncode
    self.stderr)
subprocess.CalledProcessError: Command '['/tmpfs/src/github/synthtool/env/bin/python3', '-m', 'synthtool', '--metadata', 'synth.metadata', 'synth.py', '--']' returned non-zero exit status 1.

Google internal developers can see the full log here.

Autosynth is still having trouble generating redis. :sob:
Please investigate and fix this issue within 5 business days.  While it remains broken,
this library cannot be updated with changes to the redis API, and the library grows
stale.
See https://github.com/googleapis/synthtool/blob/master/autosynth/TroubleShooting.md
for trouble shooting tips.
Here's the output from running synth.py:
ning: git checkout ef119e7aa2eee147ecf854e5154c93351ed7de25
Note: checking out 'ef119e7aa2eee147ecf854e5154c93351ed7de25'.

You are in 'detached HEAD' state. You can look around, make experimental
changes and commit them, and you can discard any commits you make in this
state without impacting any branches by performing another checkout.

If you want to create a new branch to retain commits you create, you may
do so (now or later) by using -b with the checkout command again. Example:

  git checkout -b <new-branch-name>

HEAD is now at ef119e7a feat: Expose supported languages of the agent; feat: add export / import flow API docs: Update docs on Pages, Session, Version, etc.
2021-04-28 03:07:29,490 autosynth [DEBUG] > Running: git branch -f autosynth-redis-334
2021-04-28 03:07:29,494 autosynth [DEBUG] > Running: git checkout autosynth-redis-334
Switched to branch 'autosynth-redis-334'
2021-04-28 03:07:29,525 autosynth [INFO] > Running synthtool
2021-04-28 03:07:29,525 autosynth [INFO] > ['/tmpfs/src/github/synthtool/env/bin/python3', '-m', 'synthtool', '--metadata', 'synth.metadata', 'synth.py', '--']
2021-04-28 03:07:29,525 autosynth [DEBUG] > log_file_path: /tmpfs/src/logs/Redis/334/sponge_log.log
2021-04-28 03:07:29,528 autosynth [DEBUG] > Running: /tmpfs/src/github/synthtool/env/bin/python3 -m synthtool --metadata synth.metadata synth.py --
2021-04-28 03:07:29,769 synthtool [DEBUG] > Executing /home/kbuilder/.cache/synthtool/google-cloud-php/Redis/synth.py.
On branch autosynth-redis-334
nothing to commit, working tree clean
2021-04-28 03:07:29,952 synthtool [DEBUG] > Ensuring dependencies.
DEBUG:synthtool:Ensuring dependencies.
2021-04-28 03:07:29,965 synthtool [DEBUG] > Using precloned repo /home/kbuilder/.cache/synthtool/synthtool
DEBUG:synthtool:Using precloned repo /home/kbuilder/.cache/synthtool/synthtool
2021-04-28 03:07:29,971 synthtool [DEBUG] > Cloning googleapis.
DEBUG:synthtool:Cloning googleapis.
2021-04-28 03:07:29,972 synthtool [DEBUG] > Using precloned repo /home/kbuilder/.cache/synthtool/googleapis
DEBUG:synthtool:Using precloned repo /home/kbuilder/.cache/synthtool/googleapis
2021-04-28 03:07:29,977 synthtool [DEBUG] > Which version of bazel will I run?
DEBUG:synthtool:Which version of bazel will I run?
bazel 3.0.0
2021-04-28 03:07:29,981 synthtool [DEBUG] > Generating code for: //google/cloud/redis/v1beta1:google-cloud-redis-v1beta1-php.
DEBUG:synthtool:Generating code for: //google/cloud/redis/v1beta1:google-cloud-redis-v1beta1-php.
2021-04-28 03:07:30,260 synthtool [ERROR] > Failed executing bazel --max_idle_secs=240 build //google/cloud/redis/v1beta1:google-cloud-redis-v1beta1-php:

Loading:
Loading: 0 packages loaded
DEBUG: /home/kbuilder/.cache/bazel/_bazel_kbuilder/a732f932c2cbeb7e37e1543f189a2a73/external/rules_python/python/pip.bzl:61:5: DEPRECATED: the pip_repositories rule has been replaced with pip_install, please see rules_python 0.1 release notes
Analyzing: target //google/cloud/redis/v1beta1:google-cloud-redis-v1beta1-php (1 packages loaded, 0 targets configured)
ERROR: /home/kbuilder/.cache/bazel/_bazel_kbuilder/a732f932c2cbeb7e37e1543f189a2a73/external/upb/bazel/upb_proto_library.bzl:257:29: aspect() got unexpected keyword argument 'incompatible_use_toolchain_transition'
ERROR: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/redis/v1beta1/BUILD.bazel:183:1: error loading package '@com_github_grpc_grpc//src/compiler': in /home/kbuilder/.cache/bazel/_bazel_kbuilder/a732f932c2cbeb7e37e1543f189a2a73/external/com_github_grpc_grpc/bazel/grpc_build_system.bzl: Extension file 'bazel/upb_proto_library.bzl' has errors and referenced by '//google/cloud/redis/v1beta1:redis_php_grpc'
ERROR: Analysis of target '//google/cloud/redis/v1beta1:google-cloud-redis-v1beta1-php' failed; build aborted: error loading package '@com_github_grpc_grpc//src/compiler': in /home/kbuilder/.cache/bazel/_bazel_kbuilder/a732f932c2cbeb7e37e1543f189a2a73/external/com_github_grpc_grpc/bazel/grpc_build_system.bzl: Extension file 'bazel/upb_proto_library.bzl' has errors
INFO: Elapsed time: 0.264s
INFO: 0 processes.
FAILED: Build did NOT complete successfully (2 packages loaded, 0 targets configured)
FAILED: Build did NOT complete successfully (2 packages loaded, 0 targets configured)

ERROR:synthtool:Failed executing bazel --max_idle_secs=240 build //google/cloud/redis/v1beta1:google-cloud-redis-v1beta1-php:

Loading:
Loading: 0 packages loaded
DEBUG: /home/kbuilder/.cache/bazel/_bazel_kbuilder/a732f932c2cbeb7e37e1543f189a2a73/external/rules_python/python/pip.bzl:61:5: DEPRECATED: the pip_repositories rule has been replaced with pip_install, please see rules_python 0.1 release notes
Analyzing: target //google/cloud/redis/v1beta1:google-cloud-redis-v1beta1-php (1 packages loaded, 0 targets configured)
ERROR: /home/kbuilder/.cache/bazel/_bazel_kbuilder/a732f932c2cbeb7e37e1543f189a2a73/external/upb/bazel/upb_proto_library.bzl:257:29: aspect() got unexpected keyword argument 'incompatible_use_toolchain_transition'
ERROR: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/redis/v1beta1/BUILD.bazel:183:1: error loading package '@com_github_grpc_grpc//src/compiler': in /home/kbuilder/.cache/bazel/_bazel_kbuilder/a732f932c2cbeb7e37e1543f189a2a73/external/com_github_grpc_grpc/bazel/grpc_build_system.bzl: Extension file 'bazel/upb_proto_library.bzl' has errors and referenced by '//google/cloud/redis/v1beta1:redis_php_grpc'
ERROR: Analysis of target '//google/cloud/redis/v1beta1:google-cloud-redis-v1beta1-php' failed; build aborted: error loading package '@com_github_grpc_grpc//src/compiler': in /home/kbuilder/.cache/bazel/_bazel_kbuilder/a732f932c2cbeb7e37e1543f189a2a73/external/com_github_grpc_grpc/bazel/grpc_build_system.bzl: Extension file 'bazel/upb_proto_library.bzl' has errors
INFO: Elapsed time: 0.264s
INFO: 0 processes.
FAILED: Build did NOT complete successfully (2 packages loaded, 0 targets configured)
FAILED: Build did NOT complete successfully (2 packages loaded, 0 targets configured)

Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 102, in <module>
    main()
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 829, in __call__
    return self.main(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 782, in main
    rv = self.invoke(ctx)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 1066, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 610, in invoke
    return callback(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 94, in main
    spec.loader.exec_module(synth_module)  # type: ignore
  File "<frozen importlib._bootstrap_external>", line 678, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/kbuilder/.cache/synthtool/google-cloud-php/Redis/synth.py", line 29, in <module>
    bazel_target='//google/cloud/redis/v1beta1:google-cloud-redis-v1beta1-php',
  File "/tmpfs/src/github/synthtool/synthtool/gcp/gapic_bazel.py", line 66, in php_library
    return self._generate_code(service, version, "php", clean_build, **kwargs)
  File "/tmpfs/src/github/synthtool/synthtool/gcp/gapic_bazel.py", line 204, in _generate_code
    shell.run(bazel_run_args)
  File "/tmpfs/src/github/synthtool/synthtool/shell.py", line 39, in run
    raise exc
  File "/tmpfs/src/github/synthtool/synthtool/shell.py", line 33, in run
    encoding="utf-8",
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 438, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['bazel', '--max_idle_secs=240', 'build', '//google/cloud/redis/v1beta1:google-cloud-redis-v1beta1-php']' returned non-zero exit status 1.
2021-04-28 03:07:30,313 autosynth [ERROR] > Synthesis failed
2021-04-28 03:07:30,313 autosynth [DEBUG] > Running: git reset --hard HEAD
HEAD is now at 7b571cd4 feat: Allow RequestWrapperTrait to use its auth cache when fetching ADC (#3959)
2021-04-28 03:07:30,358 autosynth [DEBUG] > Running: git checkout autosynth-redis
Switched to branch 'autosynth-redis'
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 356, in <module>
    main()
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 191, in main
    return _inner_main(temp_dir)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 336, in _inner_main
    commit_count = synthesize_loop(x, multiple_prs, change_pusher, synthesizer)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 68, in synthesize_loop
    has_changes = toolbox.synthesize_version_in_new_branch(synthesizer, youngest)
  File "/tmpfs/src/github/synthtool/autosynth/synth_toolbox.py", line 259, in synthesize_version_in_new_branch
    synthesizer.synthesize(synth_log_path, self.environ)
  File "/tmpfs/src/github/synthtool/autosynth/synthesizer.py", line 120, in synthesize
    synth_proc.check_returncode()  # Raise an exception.
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 389, in check_returncode
    self.stderr)
subprocess.CalledProcessError: Command '['/tmpfs/src/github/synthtool/env/bin/python3', '-m', 'synthtool', '--metadata', 'synth.metadata', 'synth.py', '--']' returned non-zero exit status 1.

Google internal developers can see the full log here.

Autosynth is still having trouble generating redis. :sob:
Please investigate and fix this issue within 5 business days.  While it remains broken,
this library cannot be updated with changes to the redis API, and the library grows
stale.
See https://github.com/googleapis/synthtool/blob/master/autosynth/TroubleShooting.md
for trouble shooting tips.
Here's the output from running synth.py:
pendency google-api-core to v1.26.3 (#996)
2021-04-29 03:07:26,729 autosynth [DEBUG] > Running: git checkout 5deb21826a6645d278010dc384a8d5dd942dfebd
Note: checking out '5deb21826a6645d278010dc384a8d5dd942dfebd'.

You are in 'detached HEAD' state. You can look around, make experimental
changes and commit them, and you can discard any commits you make in this
state without impacting any branches by performing another checkout.

If you want to create a new branch to retain commits you create, you may
do so (now or later) by using -b with the checkout command again. Example:

  git checkout -b <new-branch-name>

HEAD is now at 5deb2182 feat: publish protos for Google Ads API v7
2021-04-29 03:07:26,745 autosynth [DEBUG] > Running: git branch -f autosynth-redis-352
2021-04-29 03:07:26,749 autosynth [DEBUG] > Running: git checkout autosynth-redis-352
Switched to branch 'autosynth-redis-352'
2021-04-29 03:07:26,775 autosynth [INFO] > Running synthtool
2021-04-29 03:07:26,775 autosynth [INFO] > ['/tmpfs/src/github/synthtool/env/bin/python3', '-m', 'synthtool', '--metadata', 'synth.metadata', 'synth.py', '--']
2021-04-29 03:07:26,776 autosynth [DEBUG] > log_file_path: /tmpfs/src/logs/Redis/352/sponge_log.log
2021-04-29 03:07:26,778 autosynth [DEBUG] > Running: /tmpfs/src/github/synthtool/env/bin/python3 -m synthtool --metadata synth.metadata synth.py --
2021-04-29 03:07:27,007 synthtool [DEBUG] > Executing /home/kbuilder/.cache/synthtool/google-cloud-php/Redis/synth.py.
On branch autosynth-redis-352
nothing to commit, working tree clean
2021-04-29 03:07:27,173 synthtool [DEBUG] > Ensuring dependencies.
DEBUG:synthtool:Ensuring dependencies.
2021-04-29 03:07:27,184 synthtool [DEBUG] > Using precloned repo /home/kbuilder/.cache/synthtool/synthtool
DEBUG:synthtool:Using precloned repo /home/kbuilder/.cache/synthtool/synthtool
2021-04-29 03:07:27,188 synthtool [DEBUG] > Cloning googleapis.
DEBUG:synthtool:Cloning googleapis.
2021-04-29 03:07:27,188 synthtool [DEBUG] > Using precloned repo /home/kbuilder/.cache/synthtool/googleapis
DEBUG:synthtool:Using precloned repo /home/kbuilder/.cache/synthtool/googleapis
2021-04-29 03:07:27,192 synthtool [DEBUG] > Which version of bazel will I run?
DEBUG:synthtool:Which version of bazel will I run?
bazel 3.0.0
2021-04-29 03:07:27,195 synthtool [DEBUG] > Generating code for: //google/cloud/redis/v1beta1:google-cloud-redis-v1beta1-php.
DEBUG:synthtool:Generating code for: //google/cloud/redis/v1beta1:google-cloud-redis-v1beta1-php.
2021-04-29 03:07:27,365 synthtool [ERROR] > Failed executing bazel --max_idle_secs=240 build //google/cloud/redis/v1beta1:google-cloud-redis-v1beta1-php:

Loading:
Loading: 0 packages loaded
DEBUG: /home/kbuilder/.cache/bazel/_bazel_kbuilder/a732f932c2cbeb7e37e1543f189a2a73/external/rules_python/python/pip.bzl:61:5: DEPRECATED: the pip_repositories rule has been replaced with pip_install, please see rules_python 0.1 release notes
Analyzing: target //google/cloud/redis/v1beta1:google-cloud-redis-v1beta1-php (1 packages loaded, 0 targets configured)
ERROR: /home/kbuilder/.cache/bazel/_bazel_kbuilder/a732f932c2cbeb7e37e1543f189a2a73/external/upb/bazel/upb_proto_library.bzl:257:29: aspect() got unexpected keyword argument 'incompatible_use_toolchain_transition'
ERROR: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/redis/v1beta1/BUILD.bazel:184:1: error loading package '@com_github_grpc_grpc//src/compiler': in /home/kbuilder/.cache/bazel/_bazel_kbuilder/a732f932c2cbeb7e37e1543f189a2a73/external/com_github_grpc_grpc/bazel/grpc_build_system.bzl: Extension file 'bazel/upb_proto_library.bzl' has errors and referenced by '//google/cloud/redis/v1beta1:redis_php_grpc'
ERROR: Analysis of target '//google/cloud/redis/v1beta1:google-cloud-redis-v1beta1-php' failed; build aborted: error loading package '@com_github_grpc_grpc//src/compiler': in /home/kbuilder/.cache/bazel/_bazel_kbuilder/a732f932c2cbeb7e37e1543f189a2a73/external/com_github_grpc_grpc/bazel/grpc_build_system.bzl: Extension file 'bazel/upb_proto_library.bzl' has errors
INFO: Elapsed time: 0.157s
INFO: 0 processes.
FAILED: Build did NOT complete successfully (2 packages loaded, 0 targets configured)
FAILED: Build did NOT complete successfully (2 packages loaded, 0 targets configured)

ERROR:synthtool:Failed executing bazel --max_idle_secs=240 build //google/cloud/redis/v1beta1:google-cloud-redis-v1beta1-php:

Loading:
Loading: 0 packages loaded
DEBUG: /home/kbuilder/.cache/bazel/_bazel_kbuilder/a732f932c2cbeb7e37e1543f189a2a73/external/rules_python/python/pip.bzl:61:5: DEPRECATED: the pip_repositories rule has been replaced with pip_install, please see rules_python 0.1 release notes
Analyzing: target //google/cloud/redis/v1beta1:google-cloud-redis-v1beta1-php (1 packages loaded, 0 targets configured)
ERROR: /home/kbuilder/.cache/bazel/_bazel_kbuilder/a732f932c2cbeb7e37e1543f189a2a73/external/upb/bazel/upb_proto_library.bzl:257:29: aspect() got unexpected keyword argument 'incompatible_use_toolchain_transition'
ERROR: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/redis/v1beta1/BUILD.bazel:184:1: error loading package '@com_github_grpc_grpc//src/compiler': in /home/kbuilder/.cache/bazel/_bazel_kbuilder/a732f932c2cbeb7e37e1543f189a2a73/external/com_github_grpc_grpc/bazel/grpc_build_system.bzl: Extension file 'bazel/upb_proto_library.bzl' has errors and referenced by '//google/cloud/redis/v1beta1:redis_php_grpc'
ERROR: Analysis of target '//google/cloud/redis/v1beta1:google-cloud-redis-v1beta1-php' failed; build aborted: error loading package '@com_github_grpc_grpc//src/compiler': in /home/kbuilder/.cache/bazel/_bazel_kbuilder/a732f932c2cbeb7e37e1543f189a2a73/external/com_github_grpc_grpc/bazel/grpc_build_system.bzl: Extension file 'bazel/upb_proto_library.bzl' has errors
INFO: Elapsed time: 0.157s
INFO: 0 processes.
FAILED: Build did NOT complete successfully (2 packages loaded, 0 targets configured)
FAILED: Build did NOT complete successfully (2 packages loaded, 0 targets configured)

Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 102, in <module>
    main()
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 829, in __call__
    return self.main(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 782, in main
    rv = self.invoke(ctx)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 1066, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 610, in invoke
    return callback(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 94, in main
    spec.loader.exec_module(synth_module)  # type: ignore
  File "<frozen importlib._bootstrap_external>", line 678, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/kbuilder/.cache/synthtool/google-cloud-php/Redis/synth.py", line 29, in <module>
    bazel_target='//google/cloud/redis/v1beta1:google-cloud-redis-v1beta1-php',
  File "/tmpfs/src/github/synthtool/synthtool/gcp/gapic_bazel.py", line 66, in php_library
    return self._generate_code(service, version, "php", clean_build, **kwargs)
  File "/tmpfs/src/github/synthtool/synthtool/gcp/gapic_bazel.py", line 204, in _generate_code
    shell.run(bazel_run_args)
  File "/tmpfs/src/github/synthtool/synthtool/shell.py", line 39, in run
    raise exc
  File "/tmpfs/src/github/synthtool/synthtool/shell.py", line 33, in run
    encoding="utf-8",
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 438, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['bazel', '--max_idle_secs=240', 'build', '//google/cloud/redis/v1beta1:google-cloud-redis-v1beta1-php']' returned non-zero exit status 1.
2021-04-29 03:07:27,409 autosynth [ERROR] > Synthesis failed
2021-04-29 03:07:27,410 autosynth [DEBUG] > Running: git reset --hard HEAD
HEAD is now at 7b571cd4 feat: Allow RequestWrapperTrait to use its auth cache when fetching ADC (#3959)
2021-04-29 03:07:27,453 autosynth [DEBUG] > Running: git checkout autosynth-redis
Switched to branch 'autosynth-redis'
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 356, in <module>
    main()
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 191, in main
    return _inner_main(temp_dir)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 336, in _inner_main
    commit_count = synthesize_loop(x, multiple_prs, change_pusher, synthesizer)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 68, in synthesize_loop
    has_changes = toolbox.synthesize_version_in_new_branch(synthesizer, youngest)
  File "/tmpfs/src/github/synthtool/autosynth/synth_toolbox.py", line 259, in synthesize_version_in_new_branch
    synthesizer.synthesize(synth_log_path, self.environ)
  File "/tmpfs/src/github/synthtool/autosynth/synthesizer.py", line 120, in synthesize
    synth_proc.check_returncode()  # Raise an exception.
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 389, in check_returncode
    self.stderr)
subprocess.CalledProcessError: Command '['/tmpfs/src/github/synthtool/env/bin/python3', '-m', 'synthtool', '--metadata', 'synth.metadata', 'synth.py', '--']' returned non-zero exit status 1.

Google internal developers can see the full log here.

Autosynth passed, closing! :green_heart:


Added Face detection using Harrcascades to the Repo

Related Issues or bug
Added basic code with documentation on how to use it.
Fixes: #1148

Okay, made the necessary changes and updated README.md to ensure proper working.


Daytona Wordpress fails

Describe the bug
After running the creation of the workspace (wordpress repo) the server fails and user can't even check daytona server logs.
Screenshots

Desktop (please complete the following information):

OS: macOs 14.5
Daytona Version: v0.17.0

errorlogs.txt

Please share the repo URL.

https://github.com/WordPress/wordpress-develop

It works on amd64. Probably it's not configured to work on arm64. I'll test it or arm in a few moments.

@vedranjukic no need. He forgot to apply breaking changes from 0.17.0. That's most likely the issue. Waiting for confirmation.

@nkkko since this doesn't seem related to the Wordpress repo, please open up a new issue detailing the issue at hand. We discussed that the issue might be related to computer standbys.


UI Ideas

I thought it would make sense to discuss UI ideas in one place and break them off into separate issues if people were interested in pursuing them.

vertical UI: looking into this. I think this would also allow us to minimize the number of clicks needed.
dropbox: @brishin was looking into this earlier
drag n' drop from desktop: some links - http://stackoverflow.com/questions/2657653/drag-and-drop-file-upload-in-google-chrome-chromium-and-safari, http://stackoverflow.com/questions/1663741/is-there-a-good-jquery-drag-and-drop-file-upload-plugin, http://aquantum-demo.appspot.com/file-upload, http://www.plupload.com/

Let's look into these.  I always want to figure out the UI for a feature before I start coding it.

I like the changes in the ui-cleanup, it's all very solid.  I'll do some cross-browser testing and see what comes up.  I haven't gotten a chance to get to the ui-redesign branch yet.  The only concern of mine is not including js in the head.  Google actually discourages placing js towards the end, they describe it as "sub-optimal" in their Page Speed tips.  Details here: http://code.google.com/speed/page-speed/docs/mobile.html#DeferParsingJS

It seems like the Google page is comparing putting the JS at the end with deferring the JS or passing it as a string and then evaling it later. I think that putting it at the end is still better than putting it in the head.

While it is trying to get you to defer the parsing of javascript, it specifically mentions to avoid putting script tags at the end of the page as this blocks the page load indicator from indicating a full page load.

But loading JS blocks parallel downloads of other things, so I think it's still worse to put it in the head.

True, but given that the stylesheets are currently placed in front of the the scripts, parallel downloading of the stylesheets can continue and then block for the 1 script tag.  Google has an excellent write-up about this here: http://code.google.com/speed/page-speed/docs/rtt.html#PutStylesBeforeScripts

This part makes it sound like it might be talking about cases in which the JS must in the head for other reasons: "Therefore, since stylesheets should always be specified in the head of a document for better performance, it's important, where possible, that any external JS files that must be included in the head (such as those that write to the document) follow the stylesheets, to prevent delays in download time."
If you want to put it in the head, that's fine. The difference either way is going to be pretty small.

Yah it's going to be a small difference either way. Let's put it in the head for now and then re-evaluate in the future if the  Javascript becomes much larger.


NodeJS answers

Pushed the wrong way earlier. Corrections made.

Do you really need a HTTP server for this?
I find that I have to give the program's input on the server, then get feedback on the client.
Why not run each answer as just a CLI program?
E.g. for 01-name-concatenation.js:
const readlineSync = require("readline-sync");
function nameConcatenation() {
  let firstName = readlineSync.question("First Name: ");
  let lastName = readlineSync.question("last name: ");
  let yearOfBirth = readlineSync.questionInt("Year of birth: ");
  let gender = readlineSync.question("binary gender (M/F): ");
  let today = new Date();
  let currentYear = today.getFullYear();
  let age = currentYear - yearOfBirth;
  return !isNaN(age)
    ? `Welcome, ${firstName.toUpperCase()} ${
        gender.toLowerCase() == "m"
          ? "Son"
          : gender.toLowerCase() == "f"
          ? "Daughter"
          : ""
      } of  ${lastName.toUpperCase()}  ${age} years old`
    : " ";
}
console.log(nameConcatenation())

Made a new commit.


hard coding problem of max sequence length

Due to this line, even if I run the code below, I still got max_seq_length fixed at 512.
model.max_seq_length = 1024
Is it because I can't change the max_seq_length?
If not, it would be right to erase this line.

oh.... This line tricked me into believing that max_seq_length is 512...
I got a 1024 when I ran print(model.max_seq_length) and it's actually right.

Yes, the line you mentioned is only for the initialization, and you can change the maximum sequence length by overriding it.


git-node: add core-validate-commit to dependencies

This also includes a commit to fix git-node on Windows (did not work at all before)

updated to use npx

Merged after squashing third commit as 03c1ff528fd68ec53b544cf8681af973ababe2bf and 75f2b210d59d28a52a6bbd3c5f6df0c546af65e8, Thanks everyone!


Update support for fax.net

#1582 adds support for URLs like http://www.faz.net/multimedia/videos/...
Please add support for URLs following these schemas, all pointing the same article:

http://www.faz.net/aktuell/politik/berlin-gabriel-besteht-zerreissprobe-ueber-datenspeicherung-13659345.html.
http://www.faz.net/berlin-gabriel-besteht-zerreissprobe-ueber-datenspeicherung-13659345.html
http://www.faz.net/-13659345.html
http://www.faz.net/aktuell/politik/-13659345.html
http://www.faz.net/foobarblafasel-13659345.html

The same extractor can be used, it's only the _VALID_URL pattern that needs to be updated.
Thanks!

This issue will be fixed in the next version. Thanks for the report.

Wow, this was a quick reaction :-)