Master and slave are running on different ports

Hello,
I am getting following error on orchestrator logs.
ERROR ReadTopologyInstance(host:XXXX) show variables like 'maxscale%': dial tcp host:XXXX: getsockopt: connection refused

Digging into more, I have noticed that Orchestrator only throws above error for the slaves which are running on different ports then their respective masters. DiscoverByShowSlaveHosts is disabled in Orchestrator configs that means Orchestrator would use SHOW PROCESSLIST to find out slave(s) for given master.
Per below code, it looks like slave is picking master's port.
https://github.com/github/orchestrator/blob/master/go/inst/instance_dao.go#L575
Any help would be appreciated.

There is no way for orchestrator to infer the replica's port via show processlist. Therefore, you would need to:

configure `"DiscoverByShowSlaveHosts": true,"
make sure report_host and report_port are correctly set in all of your servers.
unfortunately those variables are not dynamic and require a server restart.

Thanks for the prompt response. I was thinking that with SHOW PROCESSLIST you wouldn't be able to find slave's port but just wanted to get your thoughts on that.
I guess this is something to be aware of while using different ports for master and slave(s)
Thanks,
Ashok


Dashboard: Add a page for uniform glyph sets

There's a high priority set of work to fix fonts in families to be uniform glyph sets across the collection... so, a 2nd step after #1232 is to make something similar to the Missing Codepoints spreadsheet in the dashboard so we can burn down progress against that check.

Migrating to fontbakery-dashboard issue tracker per #1383


Fix more if_python undefined behaviors in casting function pointers

Fix remaining issues in the if_python code in casting incompatible function pointers leading to Clang 17 giving runtime errors during UBSAN.

thanks. I actually did run the various python tests yesterday with a clang-17 compiled with sanitizer flags and it did not complain about any thing :/

I hope this is the last patch we need for clang-17 to run on CI Environment.


jsonPatch not working as expected

Version<EMAIL_ADDRESS>I encountered an unexpected behavior while using the jsonPatch operation. Instead of the anticipated outcome, I had to resort to manually parsing the JSON from the raw string content.

Resolved in https://github.com/EthanThatOneKid/codemod/commit/e42d6936b50ddcf63c8e1d6be971915cef329ebb.


nsPopover with ng-keyup

Hello,
I'm trying to using the directive nspopover inside an input, it works fine, but when I add an ng-keyup event for example into the input, the event inside the ng-keyup is ignored, is that normal? How could I use angualrjs directives with nspopover ?
Regards,

@AIstanbul
I suspect that has been addresses in #54. Please pull latest sources and use the new option (ns-popover-trigger-prevent="false") to cause nsPopover NOT to prevent default for the event.


Update defender-for-office-365.md

Made changes to the roadmap link to reflect Microsoft defender for office 365 to get accurate results

@Kateyanne  Please merge this PR. Thanks


opt let lead and lag type coersion behavior same with MySQL

What problem does this PR solve?
Problem Summary:
For input and default are numeric types, use below priority

DecimalV3
DecimalV2
Double
Float
LargeInt
BigInt
Int
SmallInt
TinyInt

For input and default are Date or DateTime types, user below priority

DateTimeV2
DateTime
DateV2
Date

other wise, use String
Release note
Change the signature matching behavior of Lead and Lag to make it more intuitive.
Check List (For Author)

Test

[ ] Regression test
[ ] Unit Test
[ ] Manual test (add detailed scripts or steps below)
[x] No need to test or manual test. Explain why:

[ ] This is a refactor/code format and no logic has been changed.
[x] Previous test can cover this change.
[ ] No code files have been changed.
[ ] Other reason

Behavior changed:

[ ] No.
[x] Yes.

Does this need documentation?

[x] No.
[ ] Yes.

Check List (For Reviewer who merge this PR)

[ ] Confirm the release note
[ ] Confirm test cases
[ ] Confirm document
[ ] Add branch pick label

run buildall

run buildall


Enable Serial Communication between TTGO-TCall and Orange-Pi

Solution I like
As module always listening to Serial port so if it receives executable command from Orange-Pi then it should perform the required task.
Additional context
This new feature is also added in Orange-Pi project, and I'll attach discussion link as well which include idea of how to work with this requirement.

#118 shows how to communicate these two modules.


devices/raw-flash: add missing ubifsmount in u-boot-integration section

Fixes: [MEN #1515]
Changelog: none
Signed-off-by: Maciej Borzecki<EMAIL_ADDRESS>@drewmoseley @eysteins @kacf

Thanks.  Looks good.  I'll cherry pick back to 1.2.x as well.


Add TencentARC PhotoMaker support

Hi, this is an implementation of TencentARC PhotoMaker. I am putting it in draft mode for now to get feedbacks.

~The results are not quite as good as the official version and I have to turn on vae tiling because of 8GB GPU mem limit and vae tiling has seam issues visible.~
ID fidelity has been improved and an option to offload VAE latent decode to cpu was added. Now quality is much better.
Note: this requires an upstream fix in GGML.

yes yes yes! thank u so much for ur hard work, with this and upcoming inpainting and svd in future sd cpp will be the best sd of all!

Great job! Could you merge the changes in the master branch? I just merged a PR(https://github.com/leejet/stable-diffusion.cpp/pull/159) that introduces GGMLBlock, making it more convenient to implement neural networks using ggml.

Great job! Could you merge the changes in the master branch? I just merged a PR(#159) that introduces GGMLBlock, making it more convenient to implement neural networks using ggml.

@leejet, sounds good. Now I need to merge with master and resolve conflicts first.
Note: to test the functionality, ggml must be updated to the latest which contains some bug fixes and missing/updated functions. I will also need to put a safetensor version of the photomaker model file I converted somewhere, maybe on huggingface.

I really wished I could have done this development after updating to your merge (those are really some fundamental changes)!  @leejet , are you sure the newly added CLIPVision model is working? The implementation of photomaker highly depends on it.

Note: to test the functionality, ggml must be updated to the latest which contains some bug fixes and missing/updated functions.

I have updated the ggml in the master branch to the latest commit. To adapt to the latest commit, I had to make some changes.

are you sure the newly added CLIPVision model is working? The implementation of photomaker highly depends on it.

I tested with the weights of clip vision from the stable video diffusion, and in some cases, I encountered NaN issues. This seems to be related to certain operators within ggml. I have now updated ggml to the latest commit, but I'm not sure if this issue has been resolved. I'll verify it later when I have some free time. I believe the overall network structure implementation in clip vision is sound because my clip vision implementation reuses most of the clip text structure, which has been validated and found to be correct.

@leejet, I finally made it. Now PhotoMaker is fully working so I pull this PR out from draft.
I had to make some changes (add two new classes) to CLIP and MultiHeadAttention for my implementation and fixed a couple bugs along the way. Maybe we can resolve the differences during teh review.
Anyway,  I don't want to wait too long to deal with another big merge. The bottom line is it didn't break other modes.
README.md is also updated with instructions so anyone can try it.

@bssrdf DGGML_CUDA_FORCE_MMQ Is this option strictly necessary?

@bssrdf DGGML_CUDA_FORCE_MMQ Is this option strictly necessary?
pmid.h has a lot of commented code.

OOps, that option is only for older GPUs without tensor cores. I have removed it and also cleaned up comments in pmid.hpp.
Thanks for reviewing.

Great! I'll find time in the next few days to review your changes.

I have reviewed the entire architectural changes and made some improvements. Everything is okay, but there are some code portions that I think can be reused. I will finish the modifications shortly, and then we can merge. Thank you for your amazing work.

I have reviewed the entire architectural changes and made some improvements. Everything is okay, but there are some code portions that I think can be reused. I will finish the modifications shortly, and then we can merge. Thank you for your amazing work.

Sounds good. Thanks for the code reusing updates. Let me know if you find CLIPVisionModel can be customized/shared so CLIPVisionModel2 can be removed.

@bssrdf I have completed the code reuse for the CLIPVisionModel and LoraModel. I have tested it on my machine, and everything is working well. Could you please take some time to test it as well? If there are no issues, I will proceed to merge this pull request.

@bssrdf I have completed the code reuse for the CLIPVisionModel and LoraModel. I have tested it on my machine, and everything is working well. Could you please take some time to test it as well? If there are no issues, I will proceed to merge this pull request.

Thanks, @leejet. Appreciate your time consolidating CLIPVisionModel and LoraModel.
My first try of running PhotoMaker crashed with segfault and cuda OOM during building PM's lora model  :
ggml_init_cublas: GGML_CUDA_FORCE_MMQ:   no
ggml_init_cublas: CUDA_USE_TENSOR_CORES: yes
ggml_init_cublas: found 1 CUDA devices:
  Device 0: NVIDIA GeForce GTX 1070, compute capability 6.1, VMM: yes
[INFO ] stable-diffusion.cpp:158  - loading model from '../models/RealVisXL_V3.0.safetensors'
[INFO ] model.cpp:705  - load ../models/RealVisXL_V3.0.safetensors using safetensors format
[INFO ] stable-diffusion.cpp:181  - Stable Diffusion XL
[INFO ] stable-diffusion.cpp:187  - Stable Diffusion weight type: f16
[WARN ] stable-diffusion.cpp:193  - !!!It looks like you are using SDXL model. If you find that the generated images are completely black, try specifying SDXL VAE FP16 Fix with the --vae parameter. You can find it here: https://huggingface.co/madebyollin/sdxl-vae-fp16-fix/blob/main/sdxl_vae.safetensors
[INFO ] stable-diffusion.cpp:233  - VAE Autoencoder: Using CPU backend
[INFO ] model.cpp:705  - load ../models/photomaker-v1.safetensors using safetensors format
[INFO ] lora.hpp:38   - loading LoRA from '../models/photomaker-v1.safetensors'
ggml_backend_cuda_buffer_type_alloc_buffer: allocating 354.38 MiB on device 0: cudaMalloc failed: out of memory
[ERROR] ggml_extend.hpp:873  - lora alloc params backend buffer failed
[ERROR] model.cpp:1390 - read tensor data failed: '../models/photomaker-v1.safetensors'
Segmentation fault

@bssrdf I tried your latest commit 16c9da0ccadcb0be94ee1dad7e48dc5abf5fba81 and my latest commit df28af9c70aa685d7ecac62f72788b9f30f5b030. Looking at the logs, there doesn't seem to be much difference in VRAM usage between the two. Could it be that there were other processes on your system using a significant amount of VRAM at that time and causing insufficient availability?
16c9da0ccadcb0be94ee1dad7e48dc5abf5fba81
[INFO ] stable-diffusion.cpp:157  - loading model from '..\..\stable-diffusion-webui\models\Stable-diffusion\sd_xl_base_1.0.safetensors'
[INFO ] model.cpp:676  - load ..\..\stable-diffusion-webui\models\Stable-diffusion\sd_xl_base_1.0.safetensors using safetensors format
[DEBUG] model.cpp:742  - init from '..\..\stable-diffusion-webui\models\Stable-diffusion\sd_xl_base_1.0.safetensors'
[INFO ] stable-diffusion.cpp:168  - loading vae from '..\..\stable-diffusion-webui\models\VAE\sdxl_vae-fp16-fix.safetensors'
[INFO ] model.cpp:676  - load ..\..\stable-diffusion-webui\models\VAE\sdxl_vae-fp16-fix.safetensors using safetensors format
[DEBUG] model.cpp:742  - init from '..\..\stable-diffusion-webui\models\VAE\sdxl_vae-fp16-fix.safetensors'
[INFO ] stable-diffusion.cpp:181  - Stable Diffusion XL
[INFO ] stable-diffusion.cpp:187  - Stable Diffusion weight type: f16
[DEBUG] stable-diffusion.cpp:188  - ggml tensor size = 432 bytes
[DEBUG] ggml_extend.hpp:881  - clip params backend buffer size =  1564.36 MB (713 tensors)
[DEBUG] ggml_extend.hpp:881  - unet params backend buffer size =  4900.07 MB (1680 tensors)
[DEBUG] ggml_extend.hpp:881  - vae params backend buffer size =  94.47 MB (140 tensors)
[INFO ] model.cpp:676  - load ..\models\photomaker-v1.safetensors using safetensors format
[DEBUG] model.cpp:742  - init from '..\models\photomaker-v1.safetensors'
[INFO ] pmid.hpp:405  - loading LoRA from '..\models\photomaker-v1.safetensors'
[DEBUG] model.cpp:1315 - loading tensors from ..\models\photomaker-v1.safetensors
[DEBUG] ggml_extend.hpp:881  - lora_pmid params backend buffer size =  354.38 MB (10240 tensors)
[DEBUG] model.cpp:1315 - loading tensors from ..\models\photomaker-v1.safetensors
[DEBUG] pmid.hpp:450  - finished loaded lora
[INFO ] stable-diffusion.cpp:266  - loading stacked ID embedding (PHOTOMAKER) model file from '..\models\photomaker-v1.safetensors'
[INFO ] model.cpp:676  - load ..\models\photomaker-v1.safetensors using safetensors format
[DEBUG] model.cpp:742  - init from '..\models\photomaker-v1.safetensors'
[DEBUG] ggml_extend.hpp:881  - pmid params backend buffer size =  1243.48 MB (407 tensors)

df28af9c70aa685d7ecac62f72788b9f30f5b030
[INFO ] stable-diffusion.cpp:158  - loading model from '..\..\stable-diffusion-webui\models\Stable-diffusion\sd_xl_base_1.0.safetensors'
[INFO ] model.cpp:705  - load ..\..\stable-diffusion-webui\models\Stable-diffusion\sd_xl_base_1.0.safetensors using safetensors format
[DEBUG] model.cpp:771  - init from '..\..\stable-diffusion-webui\models\Stable-diffusion\sd_xl_base_1.0.safetensors'
[INFO ] stable-diffusion.cpp:169  - loading vae from '..\..\stable-diffusion-webui\models\VAE\sdxl_vae-fp16-fix.safetensors'
[INFO ] model.cpp:705  - load ..\..\stable-diffusion-webui\models\VAE\sdxl_vae-fp16-fix.safetensors using safetensors format
[DEBUG] model.cpp:771  - init from '..\..\stable-diffusion-webui\models\VAE\sdxl_vae-fp16-fix.safetensors'
[INFO ] stable-diffusion.cpp:181  - Stable Diffusion XL
[INFO ] stable-diffusion.cpp:187  - Stable Diffusion weight type: f16
[DEBUG] stable-diffusion.cpp:188  - ggml tensor size = 432 bytes
[DEBUG] ggml_extend.hpp:878  - clip params backend buffer size =  1564.36 MB (713 tensors)
[DEBUG] ggml_extend.hpp:878  - unet params backend buffer size =  4900.07 MB (1680 tensors)
[DEBUG] ggml_extend.hpp:878  - vae params backend buffer size =  94.47 MB (140 tensors)
[INFO ] model.cpp:705  - load ..\models\photomaker-v1.safetensors using safetensors format
[DEBUG] model.cpp:771  - init from '..\models\photomaker-v1.safetensors'
[INFO ] lora.hpp:38   - loading LoRA from '..\models\photomaker-v1.safetensors'
[DEBUG] model.cpp:1343 - loading tensors from ..\models\photomaker-v1.safetensors
[DEBUG] ggml_extend.hpp:878  - lora params backend buffer size =  354.38 MB (10240 tensors)
[DEBUG] model.cpp:1343 - loading tensors from ..\models\photomaker-v1.safetensors
[DEBUG] lora.hpp:74   - finished loaded lora
[INFO ] stable-diffusion.cpp:264  - loading stacked ID embedding (PHOTOMAKER) model file from '..\models\photomaker-v1.safetensors'
[INFO ] model.cpp:705  - load ..\models\photomaker-v1.safetensors using safetensors format
[DEBUG] model.cpp:771  - init from '..\models\photomaker-v1.safetensors'
[DEBUG] ggml_extend.hpp:878  - pmid params backend buffer size =  1243.48 MB (407 tensors)

I added a parameter, --clip-on-cpu, to run CLIP on the CPU. This should reduce VRAM usage by ~2GB for PhotoMaker.
no --clilp-on-cpu
[INFO ] stable-diffusion.cpp:414  - total params memory size = 7182.38MB (VRAM 7182.38MB, RAM 0.00MB): clip 1564.36MB(VRAM), unet 4900.07MB(VRAM), vae 94.47MB(VRAM), controlnet 0.00MB(VRAM), pmid 623.48MB(VRAM)

--clilp-on-cpu
[INFO ] stable-diffusion.cpp:414  - total params memory size = 7182.38MB (VRAM 4994.54MB, RAM 2187.84MB): clip 1564.36MB(RAM), unet 4900.07MB(VRAM), vae 94.47MB(VRAM), controlnet 0.00MB(VRAM), pmid 623.48MB(RAM)

@bssrdf I tried your latest commit 16c9da0 and my latest commit df28af9. Looking at the logs, there doesn't seem to be much difference in VRAM usage between the two. Could it be that there were other processes on your system using a significant amount of VRAM at that time and causing insufficient availability?
16c9da0
[INFO ] stable-diffusion.cpp:157  - loading model from '..\..\stable-diffusion-webui\models\Stable-diffusion\sd_xl_base_1.0.safetensors'
[INFO ] model.cpp:676  - load ..\..\stable-diffusion-webui\models\Stable-diffusion\sd_xl_base_1.0.safetensors using safetensors format
[DEBUG] model.cpp:742  - init from '..\..\stable-diffusion-webui\models\Stable-diffusion\sd_xl_base_1.0.safetensors'
[INFO ] stable-diffusion.cpp:168  - loading vae from '..\..\stable-diffusion-webui\models\VAE\sdxl_vae-fp16-fix.safetensors'
[INFO ] model.cpp:676  - load ..\..\stable-diffusion-webui\models\VAE\sdxl_vae-fp16-fix.safetensors using safetensors format
[DEBUG] model.cpp:742  - init from '..\..\stable-diffusion-webui\models\VAE\sdxl_vae-fp16-fix.safetensors'
[INFO ] stable-diffusion.cpp:181  - Stable Diffusion XL
[INFO ] stable-diffusion.cpp:187  - Stable Diffusion weight type: f16
[DEBUG] stable-diffusion.cpp:188  - ggml tensor size = 432 bytes
[DEBUG] ggml_extend.hpp:881  - clip params backend buffer size =  1564.36 MB (713 tensors)
[DEBUG] ggml_extend.hpp:881  - unet params backend buffer size =  4900.07 MB (1680 tensors)
[DEBUG] ggml_extend.hpp:881  - vae params backend buffer size =  94.47 MB (140 tensors)
[INFO ] model.cpp:676  - load ..\models\photomaker-v1.safetensors using safetensors format
[DEBUG] model.cpp:742  - init from '..\models\photomaker-v1.safetensors'
[INFO ] pmid.hpp:405  - loading LoRA from '..\models\photomaker-v1.safetensors'
[DEBUG] model.cpp:1315 - loading tensors from ..\models\photomaker-v1.safetensors
[DEBUG] ggml_extend.hpp:881  - lora_pmid params backend buffer size =  354.38 MB (10240 tensors)
[DEBUG] model.cpp:1315 - loading tensors from ..\models\photomaker-v1.safetensors
[DEBUG] pmid.hpp:450  - finished loaded lora
[INFO ] stable-diffusion.cpp:266  - loading stacked ID embedding (PHOTOMAKER) model file from '..\models\photomaker-v1.safetensors'
[INFO ] model.cpp:676  - load ..\models\photomaker-v1.safetensors using safetensors format
[DEBUG] model.cpp:742  - init from '..\models\photomaker-v1.safetensors'
[DEBUG] ggml_extend.hpp:881  - pmid params backend buffer size =  1243.48 MB (407 tensors)

df28af9
[INFO ] stable-diffusion.cpp:158  - loading model from '..\..\stable-diffusion-webui\models\Stable-diffusion\sd_xl_base_1.0.safetensors'
[INFO ] model.cpp:705  - load ..\..\stable-diffusion-webui\models\Stable-diffusion\sd_xl_base_1.0.safetensors using safetensors format
[DEBUG] model.cpp:771  - init from '..\..\stable-diffusion-webui\models\Stable-diffusion\sd_xl_base_1.0.safetensors'
[INFO ] stable-diffusion.cpp:169  - loading vae from '..\..\stable-diffusion-webui\models\VAE\sdxl_vae-fp16-fix.safetensors'
[INFO ] model.cpp:705  - load ..\..\stable-diffusion-webui\models\VAE\sdxl_vae-fp16-fix.safetensors using safetensors format
[DEBUG] model.cpp:771  - init from '..\..\stable-diffusion-webui\models\VAE\sdxl_vae-fp16-fix.safetensors'
[INFO ] stable-diffusion.cpp:181  - Stable Diffusion XL
[INFO ] stable-diffusion.cpp:187  - Stable Diffusion weight type: f16
[DEBUG] stable-diffusion.cpp:188  - ggml tensor size = 432 bytes
[DEBUG] ggml_extend.hpp:878  - clip params backend buffer size =  1564.36 MB (713 tensors)
[DEBUG] ggml_extend.hpp:878  - unet params backend buffer size =  4900.07 MB (1680 tensors)
[DEBUG] ggml_extend.hpp:878  - vae params backend buffer size =  94.47 MB (140 tensors)
[INFO ] model.cpp:705  - load ..\models\photomaker-v1.safetensors using safetensors format
[DEBUG] model.cpp:771  - init from '..\models\photomaker-v1.safetensors'
[INFO ] lora.hpp:38   - loading LoRA from '..\models\photomaker-v1.safetensors'
[DEBUG] model.cpp:1343 - loading tensors from ..\models\photomaker-v1.safetensors
[DEBUG] ggml_extend.hpp:878  - lora params backend buffer size =  354.38 MB (10240 tensors)
[DEBUG] model.cpp:1343 - loading tensors from ..\models\photomaker-v1.safetensors
[DEBUG] lora.hpp:74   - finished loaded lora
[INFO ] stable-diffusion.cpp:264  - loading stacked ID embedding (PHOTOMAKER) model file from '..\models\photomaker-v1.safetensors'
[INFO ] model.cpp:705  - load ..\models\photomaker-v1.safetensors using safetensors format
[DEBUG] model.cpp:771  - init from '..\models\photomaker-v1.safetensors'
[DEBUG] ggml_extend.hpp:878  - pmid params backend buffer size =  1243.48 MB (407 tensors)

@leejet, yes, the segfault and OOM error are caused by my WSL instance. Restarting it fixed the issue. My test of Photomaker runs ok. I think it is ready for the final merge. Many thanks.

Great! Thank you for your contribution.


Hebrew language file - he.json

This is json file contains hebrew translations for the vue-cal component.

Hi @netanelwebninja, thanks for your contribution, but before I merge can you please correct the months line which seems to be malformed?

Hi @netanelwebninja, thanks for your contribution, but before I merge can you please correct the months line which seems to be malformed?

Its fine, I test it.

That's right the content is actually fine sorry, in the Github website diff it's malformed here: https://github.com/antoniandre/vue-cal/pull/90/commits/4633e69699be8a585e76152a82bde132f16acc5d#diff-8484e0fd194984896bc9cadedde8ada3R3
It's now merged and available in version 1.49.0!


importPod fails w/ 'TypeError: Cannot read property 'custom' of undefined' if directory ends w/ '.md'

Please select the area your bug applies to. (Multiple selections are Possible. You can leave blank if you're not sure.)

[ ] Workspace.  VSCode workspace, vaults, Intellisense/autocomplete, Dendron settings
[ ] Lookup.  Dendron's Lookup Command
[ ] Views.  Dendron Preview, Tree View, Side Panels in the UI
[ ] Schema.  Dendron Schemas
[x] Pod.  Data import from / export to Dendron
[ ] Publish.  External Site Publish
[ ] Markdown.  Markdown features, such as syntax support and features

Describe the bug
When running dendron importPod on a directory that has a name ending with ".md", dendron crashes with an error message like
TypeError: Cannot read property 'custom' of undefined
    at /usr/local/lib/node_modules/@dendronhq/dendron-cli/node_modules/@dendronhq/pods-core/lib/builtin/MarkdownPod.js:208:42
    at Array.forEach (<anonymous>)
    at MarkdownImportPod.hDict2Notes (/usr/local/lib/node_modules/@dendronhq/dendron-cli/node_modules/@dendronhq/pods-core/lib/builtin/MarkdownPod.js:205:26)
    at MarkdownImportPod.plant (/usr/local/lib/node_modules/@dendronhq/dendron-cli/node_modules/@dendronhq/pods-core/lib/builtin/MarkdownPod.js:343:28)
    at processTicksAndRejections (internal/process/task_queues.js:97:5)
    at async ImportPodCLICommand.execute (/usr/local/lib/node_modules/@dendronhq/dendron-cli/lib/src/commands/importPod.js:36:9)
    at async Object.CLICommand.eval [as handler] (/usr/local/lib/node_modules/@dendronhq/dendron-cli/lib/src/commands/base.js:58:25)

To Reproduce
Steps to reproduce the behavior:
# in import dir
mkdir test.md
cd test.md
touch test01.md
echo "# Header 1 \n\n ## Header 2 \nThis is just for testing." > test01.md
dendron importPod --podId dendron.markdown --wsRoot #your root here

Expected behavior
Dendron shall either import the directory or fail with an error message that it cannot import directories ending with ".md".
Desktop (please complete the following information)

OS: macOS 12.4
Browser N/A
Versions

Dendron Extension: 0.115.1
VS Code version: VSCodium 1.71.2
Dendron CLI: 0.115.1

Dendron Log file
Please attach the output of > Dendron:Dev: Open Logs here => N/A

Thanks for reporting the bug. I can repro this. We will update you when this gets fixed 🙏


C# patterns reference: var pattern and parentheses

Contributes to #20584

@BillWagner after this is merged, could you please merge the main branch into the patterns branch (I don't know if I have rights to do that)? Then, I will be able to add the links to the record reference.

@pkulikov
I just merged the main branch into the patterns feature branch. You should be go to go.

@BillWagner thank you!


C# Signals with custom parameter type do not appear in inspector

Godot version:
3.2.2 Stable
OS/device including version:

Ubuntu 20.20
AMD Ryzen 5 3600
Radeon RX550
GLES3

Issue description:
When I create a signal in C# where the passed parameter in the delegate has a type of a custom class I have created in the project, then the signal does not appear in the inspector after recompile.
If I change the parameter type to a custom enum type or a build-in class type from godot then the signal appears properly in the inspector.
Steps to reproduce:

Create C# project
Add a class to the project:
public class Test { public int Value { get; set; } }
Create a spatial node and attach a c# script
Add the following signal to the script:
[Signal] public delegate void MyCustomEvent(Test test);
Hit compile
Check Inspector -> signal not present.
Change delegate Parameter type in script to e.g. Node:
[Signal] public delegate void MyCustomEvent(Node test);
Compile.
Check inspector -> signal is there.

Minimal reproduction project:
EDIT: As someone from discord asked for a test project, here is a small project for 3.2.2 with a single scene: one node has a script with working signal and the other is not, see script implementations: signal_test.zip

I think there's another issue about this but can't search it as I'm on my phone for a few days.
Right now, only Godot.Object derived types can interact with the engine (being exported, used in signals, etc).

Only found #19868 which seems at least related to the topic. Furthermore primitive Types and enums are already an exception - they do not derive from Godot.Object either.

The MRP declares a signal with a parameter of type Test, the Test type is defined as a class that inherits from System.Object which is not valid, Godot only supports marshable types to be used with the engine (this means any of the types compatible with Variant).

Furthermore primitive Types and enums are already an exception - they do not derive from Godot.Object either and work in signals properly.

Only the types supported by the Variant class are supported. To know which types are supported you can take a look at the Variant.Type enum.
If the Test type is modified to inherit from Godot.Object instead (which makes it compatible with Variant), the signal shows up in the editor when I tested this in Godot 3.5.1.
Since this sounds more like a proposal than a bug I'll close it in favor of https://github.com/godotengine/godot-proposals/issues/997. To avoid splitting the conversation throughout multiple issues.


refactor: ruff fixes and remove / reflow commented code

Remove apparently redundant literal union (https://docs.astral.sh/ruff/rules/redundant-literal-union/)
Switch to list comprehension in tests/fixtures/git_repo.py
Shift around or remove some commented code to make ruff happy.
Some auto-formatting (placing ... on the next line in methods)

From some of the changes you are adding here, I think ruff is not reading our configuration. Or if it is than your version of pre-commit does not match the ruff version in pyproject.toml. The reason I say this is that in the lint job it is running ruff but it hasn't been an issue lately. The ... in the type definitions is one of the things that ruff has gone back and forth with. First it was on a new line and a few versions back I had to move it all to inline.

Let me make sure I have the right version - should have installed the one in the project config, but maybe there’s a discrepancy somewhere?

FWIW:
% ruff --version
ruff 0.4.4

https://github.com/python-semantic-release/python-semantic-release/blob/67971bf454b8ac56345cc51e939a00aa391d9117/pyproject.toml#L77

Maybe the updates in #957 will help? I notice that it's got the formatting one pinned back, though maybe now the two can be consolidated?
Either way, I think the more usual default of the ruff pre-commit hook is to only operate on the changed files vs. all files as it's currently configured.

@codejedi365 see if you like this better - got rid of all the autoformatting. If these two don't make sense, also feel free to just close.

I agree it should operate on only the changed files


DX-878 Migration from api-ref to Basiq-docs in Basiqio-oss

Updated the deployment from api-ref to Basiq-docs 🔗.

No Review required.


data_loader.ex does not use If-Modified-Since

Hi,
I'm writing to suggest complementing or replacing the existing Content-Length checks in data_loader.ex with an If-Modified-Since header, commonly used by web browsers to avoid the delay of a download operation.
% nc -C www.iana.org 80
GET /time-zones/repository/tzdata-latest.tar.gz HTTP/1.1
Host: www.iana.org
User-Agent: https://github.com/lau/tzdata
If-Modified-Since: Tue, 28 Feb 2017 21:18:44 GMT

HTTP/1.1 304 Not Modified
Date: Thu, 09 Mar 2017 04:33:21 GMT
Last-Modified: Tue, 28 Feb 2017 21:18:44 GMT

I would like to have attached a patch, but I'm not familiar enough with Erlang/Hackney to quickly create one to use this If-Modified-Since method. However, I'm interested enough in seeing this feature exist I'd hack up a diff after a day's research if that's what I have to do.
I hope this suggestion can perhaps simplify the operation: Instead of a combination of GETs and HEADs the fetch could become just GETs, with the difference between an unmodified GET or modified GET revealed by the empty 304 or normal 200 response.
Thanks,

Hi. Thank you for the suggestion. I'm planning to implement a solution that uses the Last-Modified headers. The solution in 0.5.11 is a stop gap solution that was caused by IANA serving the files differently. Look out for a 0.5.12 release :)

0.5.12 released


Containerize using Docker

The problem to solve
The current codebase requires the user to set up all required packages manually. When the package will grow, the number of dependencies will increase and the installation steps will become more time-consuming,
Proposed solution
We should add Docker support.

Closing this ticket as Sirji is now a VS Code Extension.


[Feature request] Display menu at text cursor position

I was wondering if it was possible to add an option to display the menu at the text cursor position instead of the mouse pointer position.
I find it quite confusing that Clipy displays the menu at the mouse pointer position, which usually is in some random spot in the screen when writing.
That's the way ClipMenu used to work b.t.w. (I may be mistaken about that though ;-) )
P.S. Thanks for maintaining this app, it's really wonderful!!

@luispinadev Thank you for a wonderful suggestion.
I would like to realize this, but it is difficult to get the position of the text cursor in the current macOS system. I will investigate in the future whether it is feasible, but it seems to be difficult soon.
Thank you for using Clipy. I will do my best to make Clipy better 😄


Disable content link when result count is zero

Fixes

Fixes #1699 by @panchovm
Description

This PR disables the vcontent links when the result count is zero by:

Removing their href
Setting aria-disabled to true

This PR adds basic unit tests for this functionality and removes tests that no longer match the structure of the component. A previous version used radio buttons which was reflected in those tests.
The styling is a placeholder, waiting for design work from @panchovm. It currently sets the entire button's opacity to .5.
Screenshot

Testing Instructions

Checklist

[x] My pull request has a descriptive title (not a vague title like Update index.md).
[x] My pull request targets the default branch of the repository (main) or a parent feature branch.
[x] My commit messages follow best practices.
[x] My code follows the established code style of the repository.
[x] I added or updated tests for the changes I made (if applicable).
[x] I added or updated documentation (if applicable).
[x] I tried running the project locally and verified that there are no visible errors.

Developer Certificate of Origin

Developer Certificate of Origin
Developer Certificate of Origin
Version 1.1

Copyright (C) 2004, 2006 The Linux Foundation and its contributors.
1 Letterman Drive
Suite D4700
San Francisco, CA, 94129

Everyone is permitted to copy and distribute verbatim copies of this
license document, but changing it is not allowed.

Developer's Certificate of Origin 1.1

By making a contribution to this project, I certify that:

(a) The contribution was created in whole or in part by me and I
    have the right to submit it under the open source license
    indicated in the file; or

(b) The contribution is based upon previous work that, to the best
    of my knowledge, is covered under an appropriate open source
    license and I have the right under that license to submit that
    work with modifications, whether created in whole or in part
    by me, under the same open source license (unless I am
    permitted to submit under a different license), as indicated
    in the file; or

(c) The contribution was provided directly to me by some other
    person who certified (a), (b) or (c) and I have not modified
    it.

(d) I understand and agree that this project and the contribution
    are public and that a record of the contribution (including all
    personal information I submit with it, including my sign-off) is
    maintained indefinitely and may be redistributed consistent with
    this project or the open source license(s) involved.

@dhruvkb I was going to draft this 😄. I wanted to get the logic in place and encourage the design work. I also think the priority should be high because it's a bug and is related to the audio beta milestone that we'd like to complete this week.

Here is a version I like that is consistent with other components' disabled states.
In the example below, the 3D models link is disabled. Content icon and internal texts are dark-charcoal-40, the button has a dark-charcoal-20 border, and results label changes to "No results".

What do you think?

@panchovm that looks perfect.

I updated the styles, so this is also now ready for review @panchovm

It looks excellent ✨ Here is the Figma component updated with this new state.
I think I have seen a pointer style change when hovering a disabled element. I might be wrong but it is like the example below.

Are we applying a similar pointer change for the disabled elements?

Good suggestion @panchovm, I've added that cursor style to the button.

Wonderful. It looks great ✨


LeapPad/Leapster MIDI loop support

A ton of LeapFrog MIDIs recently got sent to me and I've been working on a recreation of the soundfont. Some of the MIDIs feel a bit incomplete without at least 1 loop, so it'd be nice to have support added for looping these.
The commands are the following:
Control 110 (sets the start of the loop and the loop count. The max loop count is 127.)
Control 111 (sets the end of the loop. Does nothing else.)
Some example MIDIs (and the work in progress soundfont so your ears don't get blasted with high pitched sounds on a few of these):
LF MIDIs.zip

Oh, and the Match-A-Morphosis one (matchamorphisis.mid) desyncs on real hardware. If that MIDI has desync issues, that's normal.

Have you looked at all the looping options? EMIDI/XMI are already supported.

I've mostly reverse engineered the SYN format they used on the Leapster and the locations of track commands 0x8E and 0x8F (both loop commands) line up perfectly with the locations of CC 110 and CC 111 in the source MIDIs.
Oh, and in case it's needed, here's a hardware capture of a full loop of one of these songs:
matchamorphisisloop_Hardware.zip

Oh, one last thing I might've forgotten to mention:
Tracks loop independently of each other. I don't know if the other loops support this, but I tried it with the EMIDI ones (edited in over CC 110 and 111) and I'm pretty sure they all looped at the same time (despite one of the markers being moved as a test).

Looping separate tracks is a sequencer-practice, not something you'd encounter in MIDI files. Besides the current engine does not support it: all tracks are merged into one stream of events.

@BLiNXthetimesweeperGOD
have a look at https://github.com/stuerp/foo_midi/releases/tag/v<IP_ADDRESS>-alpha8

Will do! Thanks.

Released as v<IP_ADDRESS>.


Incremental compilation wipes out aggregating processor file in Gradle 6.7

When you alter a java class that does not participate in the creation of file generated by an aggregating annotation processor the generated file is deleted. This behaviour did not occur in 6.6
See https://github.com/micronaut-projects/micronaut-core/issues/4277 for steps to reproduce.
Expected Behavior
The file should not be deleted.
Current Behavior
The file is deleted.
Context
This has broken incremental compilation support in Micronaut and is a critical issue for us. See https://github.com/micronaut-projects/micronaut-core/issues/4277
Steps to Reproduce
See https://github.com/micronaut-projects/micronaut-core/issues/4277
Your Environment
Operating System: macOs
Micronaut Version: 2.1.0
Gradle: 6.7 rc4
JDK Version: openjdk version "11.0.2" 2019-01-15

Fixed in #14813


Update dependencies to latest

Current coverage is 79.85% (diff: 100%)

Merging #457 into master will increase coverage by 0.33%

@@             master       #457   diff @@
==========================================
  Files            18         18
  Lines          2075       2169    +94
  Methods         372        372
  Messages          0          0
  Branches        181        181
==========================================
+ Hits           1650       1732    +82
- Misses          425        437    +12
  Partials          0          0

Powered by Codecov. Last update 8ec6ac5...444c236

test this

test this

test this

test this

test this

test this


optional fields

match output from ts-proto as discussed in https://github.com/confio/cosmjs-types/pull/40

The proto of this is:
message ExistenceProof {
    bytes key = 1;
    bytes value = 2;
    LeafOp leaf = 3;
    repeated InnerOp path = 4;
}

but nested messages should be nullable by default if I recall correctly. This is described in detail here: https://github.com/protocolbuffers/protobuf/blob/main/docs/field_presence.md.
The nullable = false option of gogoproto exists because nullable is the default for messages. But it also comes with a warning:

Warning about nullable: According to the Protocol Buffer specification, you should be able to tell whether a field is set or unset. With the option nullable=false this feature is lost, since your non-nullable fields will always be set. It can be seen as a layer on top of Protocol Buffers, where before and after marshalling all non-nullable fields are set and they cannot be unset.


fix: RND-93: Fix response schema for delete_all_tasks

Response schema without content for delete_all_tasks()

Bypassing the rules as it only introduces schema fix


hidden_states = model(inputs)[0] # [1, sequence_length, 768]-- Is the second dimension really the sequence length?

Thank you so much~

I think it is the sequence that processed by tokenizer


4x6 mod - questions (wip)

Hello. I'm in the process of making a 4x6 mod of your wonderful board. I have some questions during the process I hope that you might help with.
At the moment i've mostly redone the body and i'm in the process of redoing the baseplate. Is there any reason these two lines are not parallel?

Or is it bc. you weren't familiar with external geometry in sketches when doing the baseplate? (i'm learning freecad while doing this btw).
Kind regards
Bjørn Wiegell

I've made extra space for another row on the baseplate like this:


Add itemExist function and test

Find whether there is an existing item in the datamanager

Codecov Report

Merging #30 into master will decrease coverage by -0.16%.
The diff coverage is 60%.

@@             Coverage Diff              @@
##             master      #30      +/-   ##
============================================
- Coverage     92.34%   92.18%   -0.16%
- Complexity      376      378       +2
============================================
  Files            22       22
  Lines          1032     1037       +5
  Branches        180      181       +1
============================================
+ Hits            953      956       +3
- Misses           22       23       +1
- Partials         57       58       +1

Impacted Files
Coverage Δ
Complexity Δ

...in/java/com/wayfair/brickkit/BrickDataManager.java
85.83% <60%> (-0.37%)
110 <2> (+2)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 99d509b...4a0d256. Read the comment docs.


[CH] TPCDS Q9 Logic error with spark 3.3

Describe the bug
The error message is
···text
Logical error: 'Invalid Field get from type Float64 to type Int64'.
···
The plan HashAggregateTransformer in spark 3.2 is output  output=[sum#632, count#633L]
But in spark 3.3 is output=[count#619L, sum#630, count#631L, sum#632, count#633L]
To Reproduce
Run tcpds in spark3.3, and backend build type is debug.

Fixed in #1827


proxy support for Junyper

Just finished adding proxy support to the glue script. My development HASS is running in a docker container inside a VM on my NAS. In this case networking tends to get suprisingly complex real quick so I had to install and run Junyper inside the HASS container.
Now an installed SSH server and a SOCKS5 tunnel using DynamicForward does the trick. Hopefully I didn't shuffle around too much code ;)

Just checking if you saw my comments inline.

Yes, I saw them. Just haven't had time to do the changes.


Pods hang in pending state indefinitely

When trying to start pods in my CoreOS cluster, they stay in a Pending state indefinitely and I cannot see any sign that the docker containers are being downloaded or anything else that would indicate that it is doing something to activate the controller. I am not sure if the problem is with my configuration but I thought I'd ask to see if someone else had encountered this problem.
Here is one of the controllers that I have been trying to run.
id: elasticsearch-data
kind: ReplicationController
apiVersion: v1beta1
desiredState:
    replicas: 1
    replicaSelector:
        component: elasticsearch
        role: data
    podTemplate:
        desiredState:
            manifest:
                version: v1beta1
                id: elasticsearch-data
                containers:
                    - name: elasticsearch-data
                      image: quay.io/heytrav/elasticsearch:v0.0.8-data
                      ports:
                          - name: transport
                            containerPort: 9300
                      volumeMounts:
                          - name: es-persistent-storage
                            mountPath: "/data"
                            readOnly: false
                volumes:
                    - name: es-persistent-storage
                      source:
                          emptyDir: {}
        labels:
            component: elasticsearch
            role: data

I'm not really seeing much in the logs to indicate that there is something wrong, but the pod hangs in a Pending state:
core@bart ~/staging $ kubectl get pods
POD                        IP                  CONTAINER(S)         IMAGE(S)                                    HOST                LABELS                              STATUS
elasticsearch-data-gziey                       elasticsearch-data   quay.io/heytrav/elasticsearch:v0.0.8-data   <IP_ADDRESS>/     component=elasticsearch,role=data   Pending

I initially tried this on a 3 node cluster at Digital Ocean and now currently on just a single node.
Here are the binaries that I'm running
core@bart ~ $ kube-controller-manager --version
Kubernetes v0.11.0-dirty
core@bart ~ $ kube-kubelet --version
-bash: kube-kubelet: command not found
core@bart ~ $ kubelet --version
Kubernetes v0.11.0-dirty
core@bart ~ $ kube-proxy --version
Kubernetes v0.11.0-dirty
core@bart ~ $ kube-scheduler --version
Kubernetes v0.11.0-dirty
core@bart ~ $ kube-api-server
-bash: kube-api-server: command not found
core@bart ~ $ kube-apiserver --version
Kubernetes v0.11.0-dirty

Any help debugging this would be appreciated

Can you run kubectl get events?

core@bart ~ $ kubectl get pods
POD                        IP                  CONTAINER(S)         IMAGE(S)                                    HOST                LABELS                              STATUS
elasticsearch-data-gziey                       elasticsearch-data   quay.io/heytrav/elasticsearch:v0.0.8-data   <IP_ADDRESS>/     component=elasticsearch,role=data   Pending

core@bart ~ $ kubectl get events
FIRSTSEEN                         LASTSEEN                          COUNT               NAME                       KIND                SUBOBJECT           REASON              SOURCE                    MESSAGE
Fri, 27 Feb 2015 01:46:57 +0000   Fri, 27 Feb 2015 01:46:57 +0000   1                   <IP_ADDRESS>              Minion                                  starting            {kubelet <IP_ADDRESS>}   Starting kubelet.
Fri, 27 Feb 2015 06:59:02 +0000   Fri, 27 Feb 2015 06:59:02 +0000   1                   rabbitmq-fplln             Pod                                     scheduled           {scheduler }              Successfully assigned rabbitmq-fplln to <IP_ADDRESS>
Fri, 27 Feb 2015 08:45:52 +0000   Fri, 27 Feb 2015 08:45:52 +0000   1                   <IP_ADDRESS>              Minion                                  starting            {kubelet <IP_ADDRESS>}   Starting kubelet.
Fri, 27 Feb 2015 09:07:57 +0000   Fri, 27 Feb 2015 09:07:57 +0000   1                   elasticsearch-data-gziey   Pod                                     scheduled           {scheduler }              Successfully assigned elasticsearch-data-gziey to <IP_ADDRESS>
Fri, 27 Feb 2015 09:24:05 +0000   Fri, 27 Feb 2015 09:24:05 +0000   1                   <IP_ADDRESS>              Minion                                  starting            {kubelet <IP_ADDRESS>}   Starting kubelet.
Fri, 27 Feb 2015 09:24:20 +0000   Fri, 27 Feb 2015 09:24:20 +0000   1                   elasticsearch-data-gziey   Pod                                     scheduled           {scheduler }              Successfully assigned elasticsearch-data-gziey to <IP_ADDRESS>

I am seeing a similar but slightly different issue where pods and nodes are always reporting an "Unknown" status.  I can see when I create a pod that it is scheduled, and when I describe the pod, I can see the containers were pulled and started, but the actual status is not changing to running.

@dchen1107 @davidopp who have been looking at the state-setting logic

@derekwaynecarr Which version you are running into this issue? I fixed an Unknown status issue (#4188) a while back by

Kubelet generates PodStatus when node is reachable
Adding error handling to system when docker API calls failed.

But there is still an issue when a node status is not-reachable, all bounded pods on that node will be reset to Unknown. Please run kubectl get nodes to see the status of node.
@heytrav From what you posted above, it looks like kubelet doesn't know pod is scheduled to the node since there are no events coming from kubelet except starting ones.

This was on HEAD this morning.
Sent from my iPhone

On Feb 27, 2015, at 12:37 PM, Dawn Chen<EMAIL_ADDRESS>wrote:
@derekwaynecarr Which version you are running into this issue? I fixed an Unknown status issue (#4188) a while back by

Kubelet generates PodStatus when node is reachable
Adding error handling to system when docker API calls failed.

But there is still an issue when a node status is not-reachable, all bounded pods on that node will be reset to Unknown. Please run kubectl get nodes to see the status of node.
@heytrav From what you posted above, it looks like kubelet doesn't know pod is scheduled to the node since there are no events coming from kubelet except starting ones.
—
Reply to this email directly or view it on GitHub.

@derekwaynecarr Can you run kubectl get nodes when Unknown issue occurs?

@dchen1107 I've suspected that it is something like that, but am not sure if I configured something incorrectly or if there is indeed a bug. Any advice how I can diagnose this?

@heytrav   Can I have the command how you run kubelet? Also can you run kubelet with --v=4 and post the log somewhere I can take a look?

I am about to fly but I will report back if I see the issue later.
Sent from my iPhone

On Feb 27, 2015, at 12:46 PM, Dawn Chen<EMAIL_ADDRESS>wrote:
@derekwaynecarr Can you run kubectl get nodes when Unknown issue occurs?
—
Reply to this email directly or view it on GitHub.

Most always this is caused by hostname / machine flag mismatch between the
master and kubelet.  You may need to set --hostname-override on the kubelet
binary.
Brendan
On Feb 27, 2015 1:07 PM, "Derek Carr"<EMAIL_ADDRESS>wrote:

I am about to fly but I will report back if I see the issue later.
Sent from my iPhone

On Feb 27, 2015, at 12:46 PM, Dawn Chen<EMAIL_ADDRESS>wrote:
@derekwaynecarr Can you run kubectl get nodes when Unknown issue occurs?
—
Reply to this email directly or view it on GitHub.

—
Reply to this email directly or view it on GitHub
https://github.com/GoogleCloudPlatform/kubernetes/issues/4891#issuecomment-76471779
.

@dchen1107  here's what I'm running (I just added --v=4, but the rest is the same)
[Service]
EnvironmentFile=/etc/network-environment
ExecStartPre=/usr/bin/wget -N -P /opt/bin https://storage.googleapis.com/kubernetes-release/release/v0.11.0/bin/linux/amd64/kubelet
ExecStartPre=/usr/bin/chmod +x /opt/bin/kubelet
ExecStart=/opt/bin/kubelet \
--v=4 \
--address=<IP_ADDRESS> \
--api_servers=http://<IP_ADDRESS>:8080 \
--port=10250 \
--hostname_override=<IP_ADDRESS> \
--logtostderr=true
Restart=always
RestartSec=10

The log output is here. I tried resizing the replication controller down to 0 and back to 1 again and didn't see any effect.

What is the IP address of your node?  You are setting --address=<IP_ADDRESS>
but setting --hostname_override=<IP_ADDRESS>
I would expect them to be equal.
Also, what are you specifying for the --machines=<...> param for
kube-controller-manager?
Or are you using the CoreOS tool that discovers machines from fleet?
--brendan
On Fri, Feb 27, 2015 at 1:11 PM, William Travis Holton <
<EMAIL_ADDRESS>wrote:

@dchen1107 https://github.com/dchen1107 here's what I'm running (I just
added --v=4, but the rest is the same)
[Service]
EnvironmentFile=/etc/network-environment
ExecStartPre=/usr/bin/wget -N -P /opt/bin https://storage.googleapis.com/kubernetes-release/release/v0.11.0/bin/linux/amd64/kubelet
ExecStartPre=/usr/bin/chmod https://storage.googleapis.com/kubernetes-release/release/v0.11.0/bin/linux/amd64/kubeletExecStartPre=/usr/bin/chmod +x /opt/bin/kubelet
ExecStart=/opt/bin/kubelet
--v=4
--address=<IP_ADDRESS>
--api_servers=http://<IP_ADDRESS>:8080
--port=10250
--hostname_override=<IP_ADDRESS>
--logtostderr=true
Restart=always
RestartSec=10
The log output is here https://paste.nothing.net.nz/e824fd. I tried
resizing the replication controller down to 0 and back to 1 again and
didn't see any effect.
—
Reply to this email directly or view it on GitHub
https://github.com/GoogleCloudPlatform/kubernetes/issues/4891#issuecomment-76472359
.

@brendandburns I think that was it actually! I changed the --hostname_override to <IP_ADDRESS> and that seemed to fix it.
This solves my particular issue. Thanks a lot for the tip!

I am closing the issue based on the last updates from @heytrav
@derekwaynecarr please file an issue when you saw the error next time. Thanks!


Add chromium and lutris to the bentoo version

That need to be requested on Bentoo overlay.
here is just the configuration, not ebuilds
https://github.com/lucascouts/bentoo

I wanted to say, add it to the default set of packages

Chomium take few hours to compile, so Firefox is the default browser installed and lutris is already added, the stage version will be available tomorrow.
the Chromium and the others packages out of the default world will be added in a secondary binhost.

Thanks.


Unable to configure Customizable Header in system configure

Jenkins and plugins versions report
After install of customizable-header plugin, it is not possible to configure the customizable header in system config.
The plugin has been successfully installed and configured on several systems (5 so far).
However, we have 2 systems that do not display customizable header configuration fields after plugin install:
Controller 1:
OS: Red Hat Enterprise Linux 9.2
Jenkins version (LTS):  2.426.1-1.1                                                                              @
customizable-header version: 61.v9c97c69b_7ee3
Controller 2:
OS: Red Hat Enterprise Linux 9.2
Jenkins version (Weekly): 2.430
customizable-header version: 61.v9c97c69b_7ee3
A jenkins log recorder was configured for 'io.jenkins.plugins.customizable_header' with both all and finest levels but no log output was observed in the recorder.
No log statements for customizable_header observed in journalctl.
Any diagnostic tips are appreciated.
What Operating System are you using (both controller, and any agents involved in the problem)?
Red Hat Enterprise Linux 9.2
Reproduction steps

Install plugin customizable-header.
Reload, service restart, host reboot all unsuccessful.

Expected Results
Able to configure Customizable header at http://JENKINS_CONTROLLER_URL/manage/configure link.
Actual Results
Unable to configure Customizable Header via http://JENKINS_CONTROLLER_URL/manage/configure link
/var/lib/jenkins/io.jenkins.plugins.customizable_header.CustomHeaderConfiguration.xml not present
Anything else?
Workaround:
If I manually copy/edit the io.jenkins.plugins.customizable_header.CustomHeaderConfiguration.xml from another system and restart the Jenkins service, the banner is properly displayed.
Are you interested in contributing a fix?
I can assist in debugging if provided some guidance.

With Jenkins 2.426.1 the plugin is configured in the Appearance category. This is an own link under "Manage Jenkins"
http://JENKINS_CONTROLLER_URL/manage/appearance

Alright, I missed a peek at the release notes that mentioned the change and was relying on my prior experience.
Perhaps the documentation can be updated with guidance to Navigate to Manage Jenkins > Appearance to edit the Customizable Header


Intellisense pop-up opens erroneously & does not closes itself (since 1-2 release)

VSCode Version: Code 1.17.1 (1e9d36539b0ae51ac09b9d4673ebea4e447e5353, 2017-10-10T14:10:17.189Z)
OS Version: Darwin x64 17.0.0
Extensions:

Extension
Author (truncated)
Version

material-icon-theme
PKi
2.2.2

vscode-docker
Pet
0.0.18

Bookmarks
ale
0.16.0

npm-intellisense
chr
1.3.0

path-intellisense
chr
1.4.2

tslint
eg2
1.0.10

expand-region
let
0.1.1

string-manipulation
mar
0.2.0

code-beautifier
mic
1.7.2

dotenv
mik
1.0.0

vscode-scss
mrm
0.6.2

cpptools
ms-
0.13.1

csharp
ms-
1.12.1

sublime-keybindings
ms-
2.9.1

team
ms-
1.122.0

Lodash
oys
1.0.0

sass-indented
rob
1.4.2

vscode-todo-highlight
way
0.5.11

blade-runner
yuk
1.0.0

(1 theme extensions excluded)

Steps to Reproduce:

Write any Object in TypeScript
When Completed first parameter and its value then after pressing comma, the auto complete popup appears to complete wrapping function parameters, that doesn't closes until I close it by pressing escape (annoying)
You can Check below attached image

Reproduces without extensions: Yes

You can try to use "editor.parameterHints": false

@bsvipas Thanks but I want to have suggestions turned on but to not open on every comma "," entered

Duplicate of #35806


Netlify CMS 'Pattern' ERROR

I get this error when trying to access the Netlify CMS admin:

I also have tried adding another item to the array but then the build fails and returns an error with the createPages function in the gatsby-node file

Actually, I have just resolved this. My node version was 14.5.0 so I specified a version in the .nvmrc and netlify.toml file that was compatible with all my packages and the environment it was specifying.


Support interface types in ProvidedTypeBuilder.MakeGenericType.

When using ProvidedTypeBuilder.MakeGenericType with an interface BaseType can be null and a NullReferenceException will be thrown in convType.
I'm not sure if we want both changes, please tell me if I should remove one of them.
I noticed this in: https://github.com/fsprojects/FSharp.Configuration/pull/53

Hi @matthid ! Thanks for this.
If you have a chance, it would be awesome to have a small example of this feature for testing - see https://github.com/fsprojects/FSharp.TypeProviders.StarterPack/tree/master/examples for examples and http://blog.mavnn.co.uk/testing-providedtype-dot-fs/ for instructions on how to hook up the build.
I'm happy to do the hooking up the build part if you can provide an example in matching format.
Thanks!

Not sure what exactly I should test. The NullReferenceException was thrown somewhere deep in the framework (not sure which component wanted to access the BaseType property).
However to test the fix itself should be pretty straightforward:
assert (ProvidedTypeBuilder.MakeGenericType(typedefof<seq<_>>, [typeof<obj>]).BaseType = null)


Adds script for checking the difference between two AB lifetime prices

Coverage remained the same at 56.999% when pulling e7ff2b773e52bf4c26c16f5bdd3b24a96aa6f99e on Zerrien:lifetime-price-test into 8e9d3f8ed22560202ce4345490b6fb5421625135 on codecombat:master.


Edit Key

Edit key from the details page routes to the key's list.
I think it should stay on the details page for that key as edit key is no longer available from the actions column of the list

Routing seems ok now. Closing issue


Folders

Hi
There's still an issue in EmulationStation I believe could be improved:
The setting to "show folders of only if they have multiple files", should be improved to "show folders of only if they have multiple visible files".
Thanks

What?

I closed this issue because I believe this is an edge case almost nobody has. Thanks


Sending "subject" in send_transactional_template update the template not send an email

This payload sends the email
message = {
          "id" => '1',
          'to' =><EMAIL_ADDRESS>          'from' =><EMAIL_ADDRESS>}

result = mailin_instance.send_transactional_template(message)

But if I add subject to it
message = {
          "id" => '1',
          'to' =><EMAIL_ADDRESS>          'from' =><EMAIL_ADDRESS>          'subject' => 'hello there',
}

I'm just getting
=> {"code"=>"success", "message"=>"Updated the Template.", "data"=>[]}

So it means I can't send a subject when using send_transactional_template?
Thanks!

It seems that using 'to_field' => 'My Name' also produces an update on the template not it does not send an email.

Hello Mustela ,
Thank you for contacting us.
Yes, you can not send a subject when using send_transactional_template because it is an invalid input parameter for this API.
Please refer Apidoc to check all valid input parameters.
Regards,
SendinBlue Team


Retry pushing single messages on failure

Rebased to clean up commit history and solved request_t copying by using a shared_ptr.


Ensure the root url path ("/") is properly routed

Negate the need to navigate to :/wdrax/
(Combine with hostname #23 )

Fixed in d9f37ea


M1.5: Add warning to the test "Incorrect Query with configuration using only specifickey with wrong value type"

We need to add a warning in this test case.
{

    description:
      "Test: Incorrect Query with configuration using only specifickey with wrong value type",
    query:
      "https://dash.akamaized.net/akamai/bbb_30fps/bbb_30fps_3840x2160_12000k/bbb_30fps_3840x2160_12000k_0.m4v?CMCD=qualabs-br%3Dfalse%2Ccid%3D%2221cf726cfe3d937b5f974f72bb5bd06a%22%2Cot%3Di%2Csf%3Dd%2Csid%3D%22b248658d-1d1a-4039-91d0-8c08ba597da5%22%2Cst%3Dv%2Csu%3D23",
    config: {
      specificKey: ["su", "sid"],
    },
    output: {
      valid: false,
      errors: [
        {
          description: "Value type is incorrect",
          key: "su",
          type: "wrong-type-value",
          value: "23",
        },
      ],
      warnings: [],
      parsedData: undefined,
      rawData:
        "https://dash.akamaized.net/akamai/bbb_30fps/bbb_30fps_3840x2160_12000k/bbb_30fps_3840x2160_12000k_0.m4v?CMCD=qualabs-br%3Dfalse%2Ccid%3D%2221cf726cfe3d937b5f974f72bb5bd06a%22%2Cot%3Di%2Csf%3Dd%2Csid%3D%22b248658d-1d1a-4039-91d0-8c08ba597da5%22%2Cst%3Dv%2Csu%3D23",
    },
}

Although in this case the library must report errors of the su and sid keys, it should also report a warning since the qualabs-br key does not belong to the standard.

This ticket is unblocked since #126 is done

Maybe we need to think again over this issue, when we solve #126 ticket, the warning with the customKey declared is now working.

We discuss with the team and we decided no to do this because we think that the library only need to report errors and warnings of the specific key.


how can I make it work on udp and tcp at the same time

Checklist

[x] I read the README
[x] I read the FAQ
[x] I searched the issues
[x] My issue is about the script, and not OpenVPN itself

Is your feature request related to a problem? Please describe.
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]
Describe the solution you'd like
A clear and concise description of what you want to happen.
Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.
Additional context
Add any other context or screenshots about the feature request here.

if possible, add this to the script

Assuming you did an IPv4 only installation with UDP:

cd /etc/openvpn
cp server.conf server2.conf
edit the proto option in server2.conf to use TCP
systemctl enable openvpn@server2 and systemctl restart openvpn@server2 if you use Debian or Ubuntu.
systemctl enable openvpn-server@server2 and systemctl restart openvpn-server@server2 if you use Fedora, CentOS or Arch.
duplicate the line containing UDP (it should be the last one) inside /etc/iptables/add-openvpn-rules.sh and change it to use TCP
do the same with the file /etc/iptables/rm-openvpn-rules.sh
systemctl restart iptables-openvpn

This should be all, let me know if it worked for you.

can I make one port tcp and udp

Yes you can, do the installation by choosing UDP and then follow the steps above to also make TCP work.

@angristan Hello I have a question!
I did what was described but there's an issue, my client connects successfully but does NOT have internet access. What solved the issue was to stop the openvpn@server and only have openvpn@server2 running, then the client had internet access, I was using 2 different ports btw.
It'd be great if there was a way to run both TCP and UDP at the same time.


client-side-validation flag support

replay of https://github.com/Azure/autorest/pull/2490

@olydis,
Thanks for your contribution as a Microsoft full-time employee or intern. You do not need to sign a CLA.
Thanks,
Microsoft Pull Request Bot

Reopened https://github.com/Azure/autorest.go/pull/11


Added cholesky

Added cholesky decomposition with additional functions in new linalg file

This change is

First thank you for your contribution!
Since we want all operations to be fast and utilize the GPU via WebGL, we won't be accepting this since it is using plain javascript.


Some questions about the docs and code

hi, I'm a new team member of cnv-qe, also a part-time reviewer/maintainer of kubernetes  : )
I took a look of the kubevirt code and docs briefly yesterday and have three questions here:

about VMs, do we currently have a load balancer mechanism for VMs ?  just like service vs pod in kubernetes cluster.

about virt-launcher: it used for provide the cgroups and namespaces for launching VMs, but here's the situation, what if a node which a pod being scheduled on it is not having enough resource to launching VMs, is that a problem ? do we having some mechanism to make sure every pod being scheduled is also eligible to launch a VMs on it's hosted node ? is that controlled by the filed of this part in vm definition file?

spec:
  terminationGracePeriodSeconds: 0
  domain:
    resources:
      requests:
        memory: 64M

about virt-dhcp do we have any docs about that part ?

@fabiand @rmohr @vladikr thanks!!
/kind question

I take a look of the docs and code again, I think I already found the answer, thanks anyway.


Example not working

I copied your example and used a ngFor to make ngx-item. everything works except interval and loop.
Do I need more to do this ?
@angular/cli: 1.4.9
node: 8.6.0
os: linux x64
@angular/animations: 4.4.6
@angular/common: 4.4.6
@angular/compiler: 4.4.6
@angular/core: 4.4.6
@angular/forms: 4.4.6
@angular/http: 4.4.6
@angular/platform-browser: 4.4.6
@angular/platform-browser-dynamic: 4.4.6
@angular/router: 4.4.6
@angular/cli: 1.4.9
@angular/compiler-cli: 4.4.6
@angular/language-service: 4.4.6
typescript: 2.3.4

this issue is fixed in build v1.3.1.update to this build


[1.18.2] XP orbs stay inside Kiln until the block is broken

XP is not given when removing output items.
The only way to retrieve XP orbs that are generated is to break the Kiln.

I'll take a look into it


Harvesting vernacular names and images from wikidata

The image and vernacular names on OneZoom come from EoL. The harvester that pings the EoL API needs a re-write, but we may also want to get images and vernacular names from wikimedia commons. We decided that this could be done by looking at images selected for a taxon on wikidata. Many taxa on wikidata have an "exemplar" image, e.g.
https://www.wikidata.org/wiki/Q140  has this one
We could probably use the trimmed-down WD json dump to grab the image URL, and save that image (or a trimmed down version) under the name of the wikidata Q-id, e.g. for the lion we would harvest that image under static/FinalOutputs/img/20/140/140.jpg (because 20 is the numerical ID I arbitrarily chose to represent images from wiki sites (see here). If we use the Q-id for the image name, it means that we can match it up to an OTT later. Note that this does mean that we would need to match up URLs to work out when the image on wikidata has been changed.
We decided that we probably want to take the original image, shrink it to a jpg of something like 150k max size (or maybe so that the vertical dimension or the horizontal dimension is a max of (say) 500px), and we could embed the copyright holder, licence, and original URL in the EXIF or IMPC metadata. We can then decide in a separate step how to crop down the image to something more suitable for thumbnails.

Look good. Quick thought: we might want to somewhat decouple the vernacular from the image harvesting, since images are language agnostic, while vernacular names are not.

Good point. Although the vernacular names are all stored in the same JSON file. I linked them together previously because both were returned from the same EoL API call. If we are using a Wikidata download dump, that doesn't matter.

Also, I just realised that I might have opened this issue in the wrong repo! But I guess we could template it here and move the harvesting code over, if necessary?

I can start here, if only to do initial investigation, and we can then decide where it belongs.

Looking at the wikidata dump, one challenge is that I'm not seeing the image licence info in there. The reason might be that the licence info is on wikimedia.org rather than wikidata (e.g. on https://commons.wikimedia.org/wiki/File:Lion_waiting_in_Namibia.jpg). If that's the case, we would not be able to embed the licence in the EXIF based solely on the wikidata dump.
Here is the relevant chunk that has the primary Lion image:
        "P18": [
            {
                "mainsnak": {
                    "snaktype": "value",
                    "property": "P18",
                    "datavalue": {
                        "value": "Lion waiting in Namibia.jpg",
                        "type": "string"
                    },
                    "datatype": "commonsMedia"
                },
                "type": "statement",
                "qualifiers": {
                    "P21": [
                        {
                            "snaktype": "value",
                            "property": "P21",
                            "hash": "0576a008261e5b2544d1ff3328c94bd529379536",
                            "datavalue": {
                                "value": {
                                    "entity-type": "item",
                                    "numeric-id": 44148,
                                    "id": "Q44148"
                                },
                                "type": "wikibase-entityid"
                            },
                            "datatype": "wikibase-item"
                        }
                    ],
                    "P276": [
                        {
                            "snaktype": "value",
                            "property": "P276",
                            "hash": "443b9d8de4c1e34c63279ab2adf551ccbe2f2898",
                            "datavalue": {
                                "value": {
                                    "entity-type": "item",
                                    "numeric-id": 1030,
                                    "id": "Q1030"
                                },
                                "type": "wikibase-entityid"
                            },
                            "datatype": "wikibase-item"
                        }
                    ]
                },
                "qualifiers-order": [
                    "P21",
                    "P276"
                ],
                "id": "q140$5903FDF3-DBBD-4527-A738-450EAEAA45CB",
                "rank": "normal"
            }
        ]

The reason might be that the licence info is on wikimedia.org rather than wikidata

Ah, yes indeed. We would need to harvest this information too. But we could probably do that using an API query. Are the hashes in there hashes of the image (in which case we would know when it changed), or something else?
Even if not, we could probably rely on the fact that the names are "unique enough" so that if the filename changes we re-download the image info.

Are the hashes in there hashes of the image (in which case we would know when it changed), or something else?

I don't think they are hashes of the image. Instead, they are part of the 'qualifiers' of the image. P21 is the gender (in this case set to male orgamism, while P276 is the location (in this case Namibia). I don't know exactly what the hashes are, but they somehow relate to these qualifiers, and are likely of no use to us.
Instead, the standard way to get resource hashes is via etags. e.g. here if you request https://upload.wikimedia.org/wikipedia/commons/7/73/Lion_waiting_in_Namibia.jpg, you will see this response header:
Etag: 8f0c085eacb04f598d19798e3622e179

If the resource were to change, so would the etag.

we could probably do that using an API query, as there won't be huge numbers of these images, I think (maybe 50k?)

Yes, let's explore this approach.
We should be able to use async I/O to avoid blocking on every web request, which will speed things up (basically you request many at once). This goes both for downloading the image itself, and for any API calls. I've done this in C#, but it seems Python now supports it.

Looking at this some more, I think what we really need is a flavor of EoLQueryPicsNames.py that works with Wikimedia instead of EoL. i.e. it needs to not only download the images, but also update the DB (images_by_ott).
The general flow to get images looks like this (with Lion as an example):

Get the wiki ID from the OTT. e.g. select wikidata from ordered_leaves where ott='563151';
From the wiki ID, get the images info. This can be done in 2 ways:

Using our wiki dump, if we modify it to have the image info. Then look at claim P18 (as in my previous comment).
By calling the wikidata API to get the same info: https://www.wikidata.org/w/api.php?action=wbgetentities&ids=Q140&format=json. Since we have to make multiple wiki API calls anyway, I'd actually recommend this rather than relying on our dump.

For a given image, call https://api.wikimedia.org/w/api.php?action=query&prop=imageinfo&iiprop=extmetadata&titles=File%3ALion_waiting_in_Namibia.jpg&format=json&iiextmetadatafilter=License to get the license info (in this case cc-by-2.0). If needed, we can ask for other fiels like UsageTerms or LicenseUrl.
For a given image (with an acceptable license), call Wikimedia to get the URL to the image (it gives multiple for different sizes). e.g. https://api.wikimedia.org/core/v1/commons/file/File:Lion_waiting_in_Namibia.jpg.
Download the actual image and save it, e.g. under static/FinalOutputs/img/20/140/140.jpg (though we might need a better scheme to avoid having one folder per species).
Update images_by_ott with this image info.

Let's discuss in the next meeting.

Use our DB to get the wiki ID from the OTT.

The API/otts2identifiers API does this if we don't want to plug directly into the DB:
https://www.onezoom.org/API/otts2identifiers?key=0&otts=770315,244265,542509

From the wiki ID, get the images info. This can be done in 2 ways:

I see what you mean about using the wikipedia API. However, I can think of two reasons to use the dump:

We won't know beforehand if a Wikidata item has an image, so we are potentially checking every species with a Wikidata number in the OneZoom DB. This could run into the millions, which is a lot of API requests to hit Wikimedia (we could get banned).
We want a continuous algorithm that checks for new images that are arriving. Obviously we can't check all the X million species every day via the API. But we can check against all species whenever we download a new JSON dump file.

There are eol_inspected and eol_updated fields which we could repurpose to indicate when we last checked a species on either eol or wikipedia. So we could also take an indirect route, and run a script against the WD JSON dump which places a flag in one of those tables to indicate that this species needs updating via a check to the Wikidata API?
I think this harvester is an important thing to discuss at an online meeting?

Yep, I think that makes sense. So if we go off of the dump, then in theory there is no need to run a continuous updater, right? i.e. new dump, new batch of image updates (most will of course be unchanged) and we stay with them till the next dump. That's assuming we can fully rely on wikidata and not have to also use EOL.
Note that we'll still need to call the wikimedia API to get the licence info and image URL. But you make a great point that we can avoid any API calls for wikidata entries that don't have any images (presumably a large percentage).
Sounds good to discuss further in a meeting.

if we go off of the dump, then in theory there is no need to run a continuous updater, right?

Exactly.

Some stats using latest wiki dump:

There are 3,848,846 entries in OneZoom_latest-all.json. Basically, these are all the wikidata entries that are taxa or vernaculars.
Out of those, 303,652 have a P18 property, meaning they have at least one image.

So that's about 8%, and at most we need to make ~300K wikimedia API calls to get images for one dump.
In practice, we can probably assume that if we already have an image by the same name as what's in the dump, we can just stay with it and not make any API calls. e.g. images have names like "002 The lion king Snyggve in the Serengeti National Park Photo by Giles Laurent.jpg". I suppose that in theory, the image could be updated while preserving its name, but I suspect that's rare.
With that simplifying assumption, the number of entries that need to be processed when we get a new dump should be quite small. Mostly:

entries that didn't use to any images and now have one
entries where we had an image but it's no longer there, and there is a new one instead

@hyanwong how many entries have images today based on EoL?

Great, really useful stats, thanks @davidebbo. I agree that we can probably assume that if the name is the same, it hasn't changed (I guess we could have a flag to force an individual re-load if necessary.

how many entries have images today based on EoL?

We have 105461 images for 85828 OTTs. So it looks like we could do pretty well if we took the wikipedia images.
Three slight issues

the wikipedia images don't have a quality rating, but I suspect they are mostly hand-picked, and we can assume the rating is pretty good. We might want to allow the old EoL ones with a rating of e.f. above 45000 (max is 50000, default is 25000) to take priority. We can also change the wiki image score by hand if e.g. we want to percolate specific images up the tree, as representative ones.
The wikipedia images will need to be cropped square. Sometimes this cuts stuff off strangely. I wonder if we want to be able to specify a crop region (e.g. in the database). This would presumably have a default, but we could override it.
We flag the images into 3 overlapping categories: "any", "verified" and "public domain" (a good PD image of the correct species would have all 3 flags set). I guess we can probably treat all the wikipedia images as "verified" and "any", assuming they have the right license (e.g. we usually only take CC-licences, and not e.g. ones that are solely licensed under GPL). We would only flag them as "pd" if they had a PD licence. It's worth keeping the old EoL images in the DB, because there will probably be many species that have a PD image from EoL, but where the wiki image is e.g. CC-BY_SA.

If we do manage to write a harvesting script, it would be helpful to browse the original images and compare to the cropped ones, and also assess the general quality.

Yes, the cropping part is quite a challenge, which hit me with extinct creatures (sauropods had very long necks! 😆). I don't think we want to be in the business of manually choosing a crop region for 300K images, so we'll at least want a very good default. And that would require some smart AI tool, as it's a hard problem. I have not researched this, and maybe there is something out there.
How are we doing this with EoL today? Are they offering squared images to begin with?

Looking on OneZoom tree, the current cropping is not always great. E.g. the Clouded Leopard is missing an eye. The Pantana cat is missing its head entirely. So maybe we're just doing center cropping and it does whatever it does?
I don't know what the sources looked like, because they're no longer available (e.g. http://media.eol.org/content/2014/10/20/03/35031_orig.jpg).

Looking on OneZoom tree, the current cropping is not always great. E.g. the Clouded Leopard is missing an eye. The Pantana cat is missing its head entirely. So maybe we're just doing center cropping and it does whatever it does?

Yes, there used to be the ability to specify a crop area by hand, and I did this for ~ 1000 images in which the default crop was bad. The ones you identified are likely to be among the majority of images that I missed.
In the long term, this is definitely an AI job, although e.g. the differences between plants and animals will probably make this pretty hard to generalise.

We simply tried to tackle the odd problem by hand as it occurred, but I haven't been keeping up with this. As well as the two that you pointed out, the lion is pretty poor, and we should probably fix this by hand, since it's such an iconic species.
As you say, it's impossible to do this for 300k images, and it should be possible using AI routines, although I don't know of any. AI routines might help with the rating too. If we do find a workable solution, especially if it is open source, I'm sure that EoL would be interested, and might even provide funding to someone to implement it across their site (I helped write the Wikimedia harvesting code for EoL at one point, purely voluntarily)

If we do find a workable solution, especially if it is open source, I'm sure that EoL would be interested, and might even provide funding to someone to implement it across their site

Yes, although I feel that somewhat goes against the direction of this discussion. With only finite time, if we decide to invest in getting images from wikimedia (with the assumption that they are better), then it may not make sense to also invest in EoL.
In a perfect world, EoL themselves would rebase their image story on wikimedia (or join them in some way), to avoid having to solve the same problems twice.

Yes, sorry, I didn't make that clear. I'm not saying that we should be involved in implementing it for EoL, but if we did find a workable solution for cropping (and rating) wikimedia images, I'm sure the developers at EoL would want to know. What they then did with that would be up to them. It's worth giving them some tips as to what works, so we are acting in a collaborative manner with the major players in this space.

I agree, by the way, that a re-write of the harvester should be focussed on getting images from wikimedia commons rather than EoL.

Got it, thanks for clarifying.

Just to note here that we decided on Slack that cropping images to size 300x300 px would be better than the current default of 150x150px. @jrosindell is also keen to store the original (uncrossed) image if possible. I suppose we could do this and simply not serve that image on the normal OneZoom page (we have a reasonable about of disk space on our server: about 7.6T available!)

I just played around with the newest beta version of Azure Image Analysis service, and it actually did a rather decent job with square cropping. It's not perfect, but it's the best I've found yet. It did well on mammals, and then did poorly on this shark.
If you want me to try it on a specific image, just send me a link!

One nice thing about this Cloud API is that you don't need to upload your pictures, not download the results. Instead:

You just point it straight at a video on the internet
It doesn't actually crop it for you, but just gives you the crop coordinates (you just ask for an aspect ration). You then use whatever tools you want to crop it yourself.

Just a follow-up on image naming conventions:

Download the actual image and save it, e.g. under static/FinalOutputs/img/20/140/140.jpg (though we might need a better scheme to avoid having one folder per species).

The folder within which an image such as 140.jpg lives, is simply based on the last 3 digits of the name. So if we used the QID for the image name e.g. the blue whale, Balaenoptera musculus (Q42196) would saved under static/FinalOutputs/img/20/196/42196.jpg. Since most QIDs are more than 3 digits, it means we don't create one folder per species.
The rationale for the subfolders was to make sure that we didn't have a single folder with 100,000 images in it, which slows down filesystem access. I picked the last 3 digits as these are more likely to be random, and so I hoped that we would have roughly the same number of images in each of the 1000 three-digit subfolders. I think it's working OK so far, so I don't see a compelling reason to change this system.
It's helpful to name the images using an integer from -2,147,483,648 to 2,147,483,647 (4 byte int in MYSQL). There are currently 110 million QIDs, so if we use the QID as the identifier, we can deal with ~20 times more wikidata information before needing to change to using an SQL BIGINT in the database.
Alternatively, we could simply allocate a new (auto-incremented) number for the image name every time we harvested a new image. This would mean we could keep the older images available, rather than overwriting the blue whale image every time it changes on wikidata. I think the ability to tie the image number to the WD item is quite valuable, however.
For manually harvested images, we could conceivably have two images for a single wikidata item (a public domain and a non-public domain image), so perhaps we would want to use the auto-incremented number for those, or e.g. use a negative number for the equivalent PD images (urgh!)

Yes, now I recall that with my early 'extinct species' experiment, I struggled with the fact that wikimedia images don't have IDs per se. They just have their file name (e.g. "Bluewhale877.jpg", which are unique within wikimedia). But those file names don't translate well into our integer source ID column. So I ended up hashing them, which can then run into clashes.
I like the simplicity of using the wikidata ID as the image id, with the obvious quirk that there can be multiple images for one WD ID, and that they can change over time. In my 'extinct species' case, I was actually directly using wikipedia and not wikidata, so it's not clear that I could always associate a WD if. And side note: wikipedia pages also have an ID, completely distinct for the WD id (e.g. see https://en.wikipedia.org/w/index.php?title=Blue_whale&action=info).
And if we end up using generated IDs as well in some scenarios, we'll need to allocate a different 'src' for it (e.g. 20 vs 21), since the field semantics will be different.


HTTP 400 Bad Request when executing a Query

Summary
I get an exception when executing a query.
Version
2.2.0
Description
Stack Trace:

I've also looked at the response body:

Having the same issue when using await() after executing a query. I think that's because it is throwing an exception on a http code error. It would be great if we can return a Failure object in that cases

Hi 👋  That sounds like an interoperability issue with your server. A quick Google search returned this: https://stackoverflow.com/questions/36691554/graphql-post-body-must-provide-query-string.
Maybe add a OkHttpInterceptor to remove charset=utf-8from the Content-Type ?
You should also remove the () from Hello() since there's no argument.
Besides that, I don't see anything out of the ordinary. To debug these kind of interoperability issue, you can try to make the same query from GraphiQL or Playground and look for differences in HTTP headers/body.
HTH

@UltronOne anything else I can help with here? Did you get your query working?

Yes, I think the issue was the "Content-Type" that was set incorrectly.
Thank you for your support.


Different eval batch size get different results?

In my setting, I use zero shot (num-fewshot is 0) and single GPU card
I try different eval batch such as 1, 2, 4, 8, 16. the acc results on lambada are different
Is this a bug?
lm-eval==0.2.0

Hi,
I'm seeing this issue too -
did you find a way to fix this, or is this expected?


[v1.2 testing] false message corrupted blockchain

Started up freshly burned v1.2 SD card w/existing blockchain w/o LCD.  Alt-F2 to get to terminal and the following was shown.  Ctrl-C to command line and tail of bitcoind showed it running OK.
SSH'ed into it and it shows normal screen finishing up bitcoind syncing. Need to look into what conditions it's using to detect the presumed corruption.  The HDD containing the blockchain I new was fine as I run it constantly on my Linux notebook to keep it synced (with same Raspiblitz partition name and dir/file config)

bitcoind debug.log shows the following:

2019-04-28T22:57:10Z HTTP: starting 4 worker threads
2019-04-28T22:57:10Z Cache configuration:
2019-04-28T22:57:10Z * Using 2.0MiB for block index database
2019-04-28T22:57:10Z * Using 8.0MiB for chain state database
2019-04-28T22:57:10Z * Using 90.0MiB for in-memory UTXO set (plus up to 47.7MiB of unused mempool space)
2019-04-28T22:57:10Z init message: Loading block index...
2019-04-28T22:57:10Z Opening LevelDB in /home/bitcoin/.bitcoin/blocks/index
2019-04-28T22:57:11Z Opened LevelDB successfully
2019-04-28T22:57:11Z Using obfuscation key for /home/bitcoin/.bitcoin/blocks/index:<PHONE_NUMBER>000000
2019-04-28T22:57:32Z LoadBlockIndexDB: last block file = 1620
2019-04-28T22:57:32Z LoadBlockIndexDB: last block file info: CBlockFileInfo(blocks=15, size=20853103, heights=573934...573981, time=2019-04-30...2019-04-30)
2019-04-28T22:57:32Z Checking all blk files are present...
2019-04-28T22:57:33Z Opening LevelDB in /home/bitcoin/.bitcoin/chainstate
2019-04-28T22:57:33Z Opened LevelDB successfully
2019-04-28T22:57:33Z Using obfuscation key for /home/bitcoin/.bitcoin/chainstate: 6cd269e505599e1e
2019-04-28T22:57:34Z Loaded best chain: hashBestChain=00000000000000000019767c51510a1f76155603e64aedcc4cca243cc2947bd7 height=573981 date=2019-04-30T21:53:51Z progress=1.000995
2019-04-28T22:57:34Z init message: Rewinding blocks...
2019-04-28T22:57:42Z init message: Verifying blocks...
2019-04-28T22:57:42Z : The block database contains a block which appears to be from the future. This may be due to your computer's date and time being set incorrectly. Only rebuild the block database if you are sure that your computer's date and time are correct.
Please restart with -reindex or -reindex-chainstate to recover.
2019-04-28T22:57:42Z Aborted block database rebuild. Exiting.
2019-04-28T22:57:42Z Shutdown: In progress...
2019-04-28T22:57:42Z scheduler thread interrupt
2019-04-28T22:57:42Z Shutdown: done

further screens:


new def to get lcz_arr, add test.

Slowly making my way through the code adding more tests ...

@theendlessriver13 I have added tests for all sections.
Without including the "main" tests, they cover ~95%. Largest chunk of missing are lines 99-146, and some small bits and pieces here and there, that do not seem crucial.
Feel free to review, but I feel done with this ....

If these are accepted, perhaps they can be pushed to the main branch, and a new package version could be created?

I was thinking to then re-submit to JOSS.
But perhaps it makes sense to wait until the global LCZ map draft is submitted, and the review online? Since the review is public, it is already possible to cite the manuscript, and thus also refer to the global LCZ map in the JOSS paper.

If these are accepted, perhaps they can be pushed to the main branch, and a new package version could be created?

yes, I agree. A release to Pypi would be nice!

I can maybe also rebase this branch and e.g. squash all the clean output to screen a bit ... commits since they are not particularily helpful being split up 😄

Some other things I'd like to improve:

make a separate PR finishing and fixing the type annotations (Any actually does nothing and should be normally avoided except maybe for very mixed up dictionaries)
finish up #42 but splitting out the mypy and typing part and make it separate.
the reformatting changes could be set to be ignored in a git blame, so they don't cover up the important changes.

Thanks for the feedback @theendlessriver13. Would be great if you could fix and clean all of this up a bit. Your suggestions make sense to me ...


States/configurations validation strategy

We could take advantage of running a job via travis to compare the configurations against the states to validate the consitency of the infrastructures. Indeed when checking out the repository, if we execute the command terraform plan for each workspaces, we should have no changes.

Seems to be no more relevant.


Update README testing section

Solidus is now available to the public. Don't need work around for
testing.

Thanks!

Thanks Brian :tada:


"No data has been added to the tables."

What happened? ,-,

Are you using the dev or master branch?
I'm redoing the code on development, and it isn't finished.
If you are using master, you'll need to import the MySQL data.


Added Italian language for network detection

The network connection wasn't detected on Italian builds.

Good find and solution, thanks! Merging.


Upgrade v1/v2v3 project activity CSV exports

What does this PR do and why?
Add redemptions, payouts, additions to balance, and participants to the CSV export modal on v2/v3 project pages. Consolidate into one modal (instead of bringing up a second modal for block number). I'll do v1 projects some time soon.
Screenshots or screen recordings
https://user-images.githubusercontent.com/96905094/205792818-5778646c-4b78-4dee-9f21-8538af77b6a3.mov
Acceptance checklist

[x] I have evaluated the Approval Guidelines for this PR.
[x] I have tested this PR in all supported browsers.
[x] I have tested this PR in dark mode and light mode (if applicable).

@filipvvv sir, thank you for this PR and for taking the initiative here! Will be so great to have richer export tools. Great great work 👏
My only suggestion ATM would be to reduce the size of this file by splitting the code up across multiple files. This will help with maintainability. One approach might be to create components for each button (for example, DownloadPaymentsCsvButton.tsx), and keep the related download utility function (for example downloadPayments(...)) in each component. Alternatively, we could move the download helper functions to their own file.
Let me know what you think or if you have any questions.

@filipvvv sir, thank you for this PR and for taking the initiative here! Will be so great to have richer export tools. Great great work clap
My only suggestion ATM would be to reduce the size of this file by splitting the code up across multiple files. This will help with maintainability. One approach might be to create components for each button (for example, DownloadPaymentsCsvButton.tsx), and keep the related download helper function (for example downloadPayments(...)) in each component. Alternatively, we could move the download helper functions to their own file.
Let me know what you think or if you have any questions.

SGTM! Did this, implemented for v1, and added the USD amounts from #2708 (merged into this PR). Also rebased with main.

Let me know if I should re-do this PR sans the rebase.

Hey @filipvvv I think something has gone a bit skewiff with the rebase - no worries, I will take a look and force-push a clean rebase in a sec!

@filipvvv okay! Think we're good now. I made some super minor changes here, just make the modal markup more consistent with our commonly used patterns in the codebase.
I also merged this PR from Peri prior: https://github.com/jbx-protocol/juice-interface/pull/2708, which included some of the USD subgraph additions.
All in all, I've tested all the downloads and they appear to be working as expected. Lets ship it!!! Thanks again for working on this.


Native notebook interface with percent-encoded scripts

Apologies if this is a dupe: I've searched for "percent" and "jupytext" with no result but it seems strange that this hasn't been raised.
I want to use the new native notebook interface with percent-encoded notebook/scripts, as supported by the legacy interpreter pane.
E.g.
#%%
# cell 1
import sql
#%%
# cell 2
df = sql.read(...)
#%%
...

I would expect the workflow to work roughly like jupyter with the jupytext extension: I'd open a .py file (perhaps with a special "open as notebook" command) and I'd be presented with it rendered and editable as a notebook. Cell outputs would not be saved in this format, but vscode might prepend some metadata to its head if necessary to save kernel params, the fact it's a "notebook", etc.

This is possible today?

That exports from the file itself. You can also export from the interactive window.
It seems it's not available (all the time) on the command palette though. When it is it looks like this:

Very close to being a dupe of #1240. Even if it's different, we don't have plans on doing this in the near future. Thanks for the request though!

Indeed that link is close enough to what I want. Thanks! (And thanks for otherwise thankless triage work :) )


Cancel button of ion-searchbar not working probably? V4

Bug Report
Ionic Info
Ionic:
   ionic (Ionic CLI)          : 4.0.6
   Ionic Framework            : @ionic/angular 4.0.0-beta.2
   @angular-devkit/core       : 0.7.3
   @angular-devkit/schematics : 0.7.3
   @angular/cli               : 6.1.3
   @ionic/ng-toolkit          : 1.0.6
   @ionic/schematics-angular  : 1.0.4

Describe the Bug
When using ion-searchbar and click the cancel button (back arrow) should navigate me to another page. This functionally is working on the mobile browser but on the desktop browser is does not work? (nothing happened when clicking on cancel button)
Steps to reproduce the behaviour:

Click on the search box
Click the cancel button (back arrow)

Related Code
.html
<ion-searchbar showCancelButton=true (ionCancel)="onCancel($event)"></ion-searchbar>
.ts
	onCancel(event) { 		this.router.navigateByUrl('/home'); 	}
Expected Behavior
The cancel button should trigger function which goes back to homepage using Router.

Individuals feel that they can write a route to navigate a new address

+1
on browser, the onCancel event is not triggered when click the cancel button which is an back arrow

I'm having the same issue on 4.0.0-beta.16. onCancel doesn't trigger in the browser or on Android/iOS devices.

Isn't it ionCancel instead of onCancel?

I checked in RC.0 and it's working with your code

@paulstelzer Except that the cancel button is a bit off, will submit a PR in a while. Code should be:
<ion-searchbar showCancelButton (ionCancel)="onCancel($event)"></ion-searchbar>

I wonder why they still use ionCancel instead of cancel.


Issues with pip package (missing attribute detect_language_multi_segment)

Hi, thanks for your great work.
I'd like to report that when I am trying this package, I noticed a weird thing. When I install this package with pip install, the code it installed missed some attributes in WhisperModel, so I couldn't run language_info = model.detect_language_multi_segment(wavpath)  because model has no attribute detect_language_multi_segment, it happened both with version 1.0.0 and the upgraded 1.0.3.
In the github repo I can see that it does have the attribute, but when I entered the package code installed by pip, it does not contain this attribute (and several other attributes are missing too)
Finally I uninstalled the pip installed package, pull the github repo and ran pip install -e ., then this time, it is correctly install and I can use the detect_language_multi_segment attribute.
I am not sure if it was because I was using a pip mirror and that mirror was not updated properly (but the version number is correct, so I think it is strange enough). Maybe the author could check if the pip package is updated with all the attributes? And if anyone run into the same issue, just install the package from this repo, it shoule be able to fix it.

But then I realized after I installed from source, another issue showed up.
when I tried result = model.transcribe(wavpath, word_timestamps=True, batch_size = 16), it told me transcribe has no keyword argument batch_size ! (If I install from pip it works properly.)
It is making me confused.

Its not an issue with the pip package, rather this change is yet to be released as a Pypi package. The best would be to install from source and use it:
pip install git+https://github.com/SYSTRAN/faster-whisper.git

Version 1.1.0 just released to PyPI