Call to StanfordCoreNLP is getting stuck

Hi,
I tried calling StanfordCoreNLP from MacOS, however, it's getting stuck and it's not coming out after starting the server.  Below is the log. Can anyone tell me the issue? Thanks in advance.

nlp = StanfordCoreNLP(r'stanford-corenlp-full-2018-10-05', quiet=False)
[main] INFO CoreNLP - --- StanfordCoreNLPServer#main() called ---
[main] INFO CoreNLP - setting default constituency parser
[main] INFO CoreNLP - warning: cannot find edu/stanford/nlp/models/srparser/englishSR.ser.gz
[main] INFO CoreNLP - using: edu/stanford/nlp/models/lexparser/englishPCFG.ser.gz instead
[main] INFO CoreNLP - to use shift reduce parser download English models jar from:
[main] INFO CoreNLP - http://stanfordnlp.github.io/CoreNLP/download.html
[main] INFO CoreNLP -     Threads: 4
[main] INFO CoreNLP - Starting server...
[main] INFO CoreNLP - StanfordCoreNLPServer listening at /0:0:0:0:0:0:0:0:9000

I've had this issue on and off for the past two years. I've found a clunky workaround. Let's call your script above script_1.  Kill script_1, then elsewhere (in a separate python script -- let's call it script_2 -- or it could just be an interactive python session), run the same code to start the CoreNLP server and let it get stuck. While script_2 remains stuck, script_1 should work fine.
I don't understand this behavior and don't love my workaround, but maybe it will help you.

2020-09-07 11:34:20,888 ： INFO : Server shell PID: 7029
2020-09-07 11:34:21,896 ： INFO : Waiting until the server is available.
2020-09-07 11:34:22,901 ： INFO : Waiting until the server is available.
and waiting...waiting....available, could you help me out of this issue? thanks

202107 and I still get stuck on mac.

2020-09-07 11:34:20,888 ： INFO : Server shell PID: 7029 2020-09-07 11:34:21,896 ： INFO : Waiting until the server is available. 2020-09-07 11:34:22,901 ： INFO : Waiting until the server is available. and waiting...waiting....available, could you help me out of this issue? thanks

Have you solved this? 2022 I'm still stuck on mac


Fail import w/cython, cffi and build on 3.5 HEAD.

Various tracebacks available here depending on each case.
Ok, it's Python 3.5 head, so I should partially blame myself.
And yes I'll try cython master.

Thanks, my guess is it's a Cython issue, but bundled libzmq is a C extension that doesn't involve Cython, so there may need to be changes there.

Hum, indeed, I narrowed it down to :
In [1]: import Cython.Compiler.Scanning
---------------------------------------------------------------------------
ImportError                               Traceback (most recent call last)
<ipython-input-1-8faf04ac6b88> in <module>()
----> 1 import Cython.Compiler.Scanning

ImportError: dynamic module does not define module export function (PyInit_.Scanning)

So it seem to be due to this  that finish to implement pep 489 more info on issue tracker

This is a bug in Python 3.5b1 that will be fixed in 3.5b2. I tested with HEAD, and it works fine. There's nothing for us to do here.


Use byte[] to create DatagramSocketAddress and so reduce overhead

Motivation:
At the moment we use the String representation of the IP to create the DatagramSocketAddress. This is not for free and we should better use the byte[] directly to reduce the overhead of parsing the String (and creating it in the first place)
Modifications:
Directly use byte[] as input for the DatagramSocketAddress
Result:
Less overhead when using Datagrams with native transports

Spotted this while working on https://github.com/netty/netty/pull/9509

@franz1981 you wanted to give it a closer look or you are ok with it ?

@normanmaurer I was now in the middle of taking a look to it ;)


Auxiliary storage is not cleared on reorg

As AuxStore is global, in BABE weight for block that was initially imported, but eventually got pruned, remains in the storage forever.
Arguably minor issue, but still annoying and should probably be fixed.

As I already explained yesterday, AuxStore is not fork aware or anything. It is just a "dumb" store.

Right, and that is the reason why it needs to be cleared up "manually" or it is stuck in storage forever.

Ahh sorry, I was confused by your title.
Then this is a duplicate of: https://github.com/paritytech/substrate/issues/8692


Some documents have been forgotten to translate into Chinese

@saraao commented on Wed Feb 27 2019
文档中Set up your development environment被部分被漏翻译

文档详细信息
⚠ 请勿编辑此部分。 docs.microsoft.com ➟ GitHub 问题链接必须具有此部分。

ID: 65ca3600-cbad-b9eb-3c7e-22b5251226ec
Version Independent ID: 8881b6f3-c64d-f758-15c8-79e10e9764a9
Content: 回归模型教程：准备数据 - Azure Machine Learning service
Content Source: articles/machine-learning/service/tutorial-data-prep.md
Service: machine-learning
GitHub Login: @cforbe
Microsoft Alias: cforbe

@CeciAc commented on Thu Feb 28 2019
你好，@saraao

感谢你的反馈。

我们正在积极查看你的评论，并会很快地再次和你取得联系。

深深的祝福，
Microsoft DOCS International Team

Hi team,
Hi team,
There are no inverted commas needed in order to close the codebox before the line "Set up..." causing this paragraph to be treated as a code-box/non translatable

@CeciAc Hi, this is a duplicate issue of #25979 I will close this and please keep eyes on #25979 instead. Thanks.
We will now proceed to close this thread. If there are further questions regarding this matter, please respond here and @YutongTie-MSFT and we will gladly continue the discussion.


spacing between information.

I have an ultrawide monitor.
See how the information looks on them. I believe you have to limit it to the center of the screen.
Anki 800x600

Monitor Ultrawide

Scheduled this for the next update. Thanks for reporting!


BayesianOptimization: Allow for multiple workers.

Currently, SimpleBayesianOptimizationCore returns the same point for each worker that asks for one. This will have to be changed.
This also includes implementing working timeouts.

This has been superseded by #115 and, similary, can be closed.


Update instructions to match eldritch and remove duplicate config

Updated the instructions to match eldritch main github repo.
Also removed duplicated configuration

Thanks for the easy fix


Add a link to image_optimizer

Would you consider adding a link to image_optimizer in the readme?
Makes it more explicit where additional settings can be found.
Thanks!

Coverage remained the same at 100.0% when pulling eb78af72b621c620c8616dfafb2f6e37833bfe3e on tilsammans:patch-1 into b7f6d4ada33ab1df6049ec7ab89c4c937637f7d4 on jtescher:master.

Thanks!


Inquiry About Slow Performance of BOCPD on Our Dataset

I am currently working on anomaly detection using the BOCPD (Bayesian Online Change Point Detection) method on our dataset, which consists of approximately 7,000 rows and 26 columns. However, I have encountered an issue with the process being extremely slow, and I'm not sure why this is happening.
I would appreciate any insights or suggestions you might have regarding the potential causes of this slowdown and how I might be able to optimize the performance.
Thank you for your assistance.
Best regards,

7,000 rows and 26 columns

Omg @beifangqiuer, BOCPD is really slow compared to other methods since it takes into account the dependency of multivariate time series.
You can try to reduce the number of time series (reduce 26 columns to 3-4 columns), and re-sampling the data (reduce 7000 rows to 700 rows).
I also offer nsigma for anomaly detection, you can also give it a try: https://github.com/phamquiluan/baro/blob/main/baro/anomaly_detection.py#L7


[PD] Take your English test with Duolingo to check your English Level

Coursework content
To be able to join as a Trainee your English level must be B2 or higher - which is a score of at least 100. We will send you the voucher to take the Duolingo English Test.
This email will be sent to the email address you signed up with.
Check your spam folder.
If you cannot find the voucher, post it on the #general Slack channel.
If you do not need to become a Trainee now, work on your English and take the test during Module 3.
Set-up for the test

You can't use Linux for this test. If you have a Linux laptop, either use the library or come to class and borrow a computer for an hour.
The computer must have a working camera and microphone
You must have a valid ID.  List of accepted IDs. If you don't have one, please talk to your cohort founders to arrange a different voucher.
Do not enter the voucher number until you are ready with everything: it is only valid for 20 days. This information is only available after the voucher is entered, and pausing is impossible.
Before doing the real test, do this Practice Test. This helps you to understand the limited time you have to reply to the questions.
You can also watch this video about the test.
You will receive the voucher on your email address

Format of the test:

Quick setup: 5 MINUTES
An introduction that walks you through the test rules and requirements. You must have a valid ID with you. List of accepted IDs

Adaptive test; 45 MINUTES
A series of questions that evaluate your English skills

Writing and speaking sample - 10 MINUTES
Open-ended prompts that are shared with institutions alongside your score

Estimated time in hours
1
What is the purpose of this assignment?
Assess your level of English.
How to submit

Create an account on the Duolingo page
You will receive a voucher on your email address
"Buy" a test using the Coupon Code CYF will give you

Login to your Duolingo account
Use the route "Purchase a test"
Select "1 test" option
Do not pay extra for fast results (CYF won't cover that cost)
Do NOT add your credit card information, use the "Apply Coupon Code" option

Take the test
Add the screenshot of your test outcome to this ticket and then close this ticket.
Add the screenshot to the trainee enrollment

@SueMsOl , you need to clone the backlog to your GitHub repo and then close it. This is the main repository issue which is used as a template.

hi @kfklein15 could you please let me know how  i can clone this backlog to my own github? I have forked repos before but i don't know how to clone this issue to my github

@SueMsOl , it's on our curriculum. Search for it. Or ask your peers. Your community is there to support you better than myself.


Implement support for caddy placeholders in replacement

Thanks for contribution. Can you add some test cases in test/ directory covering both {caddy_replacement} and {1} use cases?

I have no linux machine or emulator to test the run-test script, but I tried to verify the test implementation using windows tools


Remove local conda build files

Conda builds are now being uploaded to rapidsai/rapidsai-nightly conda channels and local build scripts are not needed anymore.

Thanks @ajschmidt8 !

/merge


new package: lux 1.2

Description of package
POSIX Shell script to easily control brightness on backlight-controllers.
Checklist

[x] Latest upstream version.
[x] I agree to maintain this package (required).
[x] I agree to notify KISS if I can no longer maintain this package (required).

done

rm depends 18619ef

The depends file still exists in this PR. :+1:

doh

merge it


LightLLM benchmark

Hi vLLM genius @zhuohan123 @WoosukKwon
I find a new project  https://github.com/ModelTC/lightllm
After reading their blog, the performance advantage on the 7b model is not very obvious, but the gap is larger on the 65b. We will also do some verification and comparison later. The reason for bringing up this issue is to hope that we may see what the LightLLM does well, so that we can refer to and port similar optimizations to vLLM. Cheers.

As mentioned in the blog, one point particularly caught my attention, and I feel that this feature may be compatible with the current design of vLLM.

三进程架构，主要用于异步化处理 tokenize 和 detokenize操作， 可以避免这些耗时的cpu处理阻碍模型推理时gpu的调度执行，降低gpu的使用率，进而降低了整体服务性能。

English version

The three-process architecture is mainly used for asynchronous processing of tokenize and detokenize operations, which can avoid these time-consuming cpu processing from hindering the scheduling execution of gpu during model inference, reduce the utilization rate of gpu, and then reduce the overall service performance.

Also cc @naed90 @wejoncy

After briefly reviewing LightLLM, I found that its kernel is written in OpenAI Triton rather than CUDA. This makes it easier for those who want to participate in optimization in the future to get started, and it also has good performance. For multi GPUs inference, it uses RPyC instead of Ray. Both of vLLM and LightLLM use Tensor Parallelism over multiple GPUs for faster inference. Currently, it's hard to say whether the technology choice can bring such a big performance difference. I think the performance improvement comes more from TokenAttention and Efficient Router, as well as the a-synchronization of tokenize and de tokenize. I've counted the lines of code in LightLLM, and only look at Llama2, there are only over 2000 lines overall when removing Bloom and LLaMA, which is quite unbelievable.

Hi! Thanks for bringing this up. We are excited to see new open-source efforts based on vLLM projects. I'm running reproducing the results from LightLLM right now, but from the first glance:

TokenAttention is the special case of PagedAttention when block size equals to 1, which we have tested before and find it under-utilizes GPU compute compared to larger block size. Unless LightLLM's Triton kernel implementation is surprisingly fast, this should not bring speedup.
The memory saving brought by TokenAttention should also not be significant. In our current benchmarks, the memory waste is already less than 4%. From 4% -> 0% should not bring that much speed gain. In addition, running 7B LLaMA on 80GB A100 should have abundant memory, memory waste should further not be the speed bottleneck.
GPU-based efficient router is a cool design. However, in vLLM, the page table only has ~10k blocks, which is very small compared to the neural network computation and should not be a speed bottleneck as well.
Therefore, we believe the speedup should mainly come from the design of tokenizers and samplers , which is a known speed bottleneck in vLLM.

However, these are all my initial guesses. We will perform a more thorough benchmark and update the results here.

I tried to rerun the LLaMA 7B benchmark on an 80GB A100 on GCP. With the latest vLLM main branch:
(vllm) zhuohan@zhuohan-1:~/vllm/vllm/benchmarks$ python benchmark_serving.py --backend vllm --tokenizer huggyllama/llama-7b --dataset ShareGPT_V3_unfiltered_cleaned_split.json --num-prompts 2000 --request-rate 200 --host <IP_ADDRESS> --port 9009
Namespace(backend='vllm', host='<IP_ADDRESS>', port=9009, dataset='ShareGPT_V3_unfiltered_cleaned_split.json', tokenizer='huggyllama/llama-7b', best_of=1, use_beam_search=False, num_prompts=2000, request_rate=200.0, seed=0, trust_remote_code=False)
INFO 08-03 21:09:35 tokenizer.py:29] For some LLaMA-based models, initializing the fast tokenizer may take a long time. To eliminate the initialization time, consider using 'hf-internal-testing/llama-tokenizer' instead of the original tokenizer.
Total time: 433.25 s
Throughput: 4.62 requests/s
Average latency: 200.60 s
Average latency per token: 0.69 s
Average latency per output token: 4.12 s

When commenting out all tokenization and using batched argmax sampling (branch):
(vllm) zhuohan@zhuohan-1:~/vllm/vllm/benchmarks$ python benchmark_serving.py --backend vllm --tokenizer huggyllama/llama-7b --dataset ShareGPT_V3_unfiltered_cleaned_split.json --num-prompts 2000 --request-rate 200 --host <IP_ADDRESS> --port 9009
Namespace(backend='vllm', host='<IP_ADDRESS>', port=9009, dataset='ShareGPT_V3_unfiltered_cleaned_split.json', tokenizer='huggyllama/llama-7b', best_of=1, use_beam_search=False, num_prompts=2000, request_rate=200.0, seed=0, trust_remote_code=False)
INFO 08-04 00:29:29 tokenizer.py:29] For some LLaMA-based models, initializing the fast tokenizer may take a long time. To eliminate the initialization time, consider using 'hf-internal-testing/llama-tokenizer' instead of the original tokenizer.
Total time: 245.59 s
Throughput: 8.14 requests/s
Average latency: 113.03 s
Average latency per token: 0.39 s
Average latency per output token: 2.33 s

The improvement in throughput (1.76x) is very close to the improvement reported in LightLLM (1.92x).
Will update the results after reproducing LightLLM's results.

Hi @zhuohan123
Thanks for your detailed reply. As mentioned above, the advantage of 7b throughout is not obvious. Perhaps, in addition to reproducing the 7b results, we may also investigate the 65b results, where the throughput difference becomes even larger when the model size increases. Thanks.

I found that a lot of coroutines are used in lightllm router, maybe these also bring some throughput improvements？

I tried to rerun the LLaMA 7B benchmark on an 80GB A100 on GCP. With the latest vLLM main branch:
(vllm) zhuohan@zhuohan-1:~/vllm/vllm/benchmarks$ python benchmark_serving.py --backend vllm --tokenizer huggyllama/llama-7b --dataset ShareGPT_V3_unfiltered_cleaned_split.json --num-prompts 2000 --request-rate 200 --host <IP_ADDRESS> --port 9009
Namespace(backend='vllm', host='<IP_ADDRESS>', port=9009, dataset='ShareGPT_V3_unfiltered_cleaned_split.json', tokenizer='huggyllama/llama-7b', best_of=1, use_beam_search=False, num_prompts=2000, request_rate=200.0, seed=0, trust_remote_code=False)
INFO 08-03 21:09:35 tokenizer.py:29] For some LLaMA-based models, initializing the fast tokenizer may take a long time. To eliminate the initialization time, consider using 'hf-internal-testing/llama-tokenizer' instead of the original tokenizer.
Total time: 433.25 s
Throughput: 4.62 requests/s
Average latency: 200.60 s
Average latency per token: 0.69 s
Average latency per output token: 4.12 s

When commenting out all tokenization and using batched argmax sampling (branch):
(vllm) zhuohan@zhuohan-1:~/vllm/vllm/benchmarks$ python benchmark_serving.py --backend vllm --tokenizer huggyllama/llama-7b --dataset ShareGPT_V3_unfiltered_cleaned_split.json --num-prompts 2000 --request-rate 200 --host <IP_ADDRESS> --port 9009
Namespace(backend='vllm', host='<IP_ADDRESS>', port=9009, dataset='ShareGPT_V3_unfiltered_cleaned_split.json', tokenizer='huggyllama/llama-7b', best_of=1, use_beam_search=False, num_prompts=2000, request_rate=200.0, seed=0, trust_remote_code=False)
INFO 08-04 00:29:29 tokenizer.py:29] For some LLaMA-based models, initializing the fast tokenizer may take a long time. To eliminate the initialization time, consider using 'hf-internal-testing/llama-tokenizer' instead of the original tokenizer.
Total time: 245.59 s
Throughput: 8.14 requests/s
Average latency: 113.03 s
Average latency per token: 0.39 s
Average latency per output token: 2.33 s

The improvement in throughput (1.76x) is very close to the improvement reported in LightLLM (1.92x).
Will update the results after reproducing LightLLM's results.

@zhuohan123 can you update the link to the branch where only  batched argmax sampling is used , since its not working anymore, thanks in advance.

.

This optimization has been integrated to the latest main branch of vLLM. Please try it out!


Add --source and --library arguments for jextract

Without the --source argument, the plugin generates .class files instead of .java files. The .java files can be easily imported from user code.
Without the --library argument, jextract does not load the implementation of the header file. Adding a library parameter configurable so users can point to their .so files.

Hi and thank you for your PR! I am fine with adding support for the --library parameter. However I am pretty sure that --source is obsolete and that generation of class files has even been removed from the tool.

generation of class files has even been removed from the tool.
Huh, I didn't know about this. I passed in jextract from openjdk21 in the executable when I tested, and the generated-sources contained .class files. Was it removed in JDK22?

I could make the --source an optional parameter instead of an option added by default?

generation of class files has even been removed from the tool.

Huh, I didn't know about this. I passed in jextract from openjdk21 in the executable when I tested, and the generated-sources contained .class files. Was it removed in JDK22?
I could make the --source an optional parameter instead of an option added by default?

This is my config in the pom:
<plugin>
    <groupId>io.github.coffeelibs</groupId>
    <artifactId>jextract-maven-plugin</artifactId>
    <version>0.4.0</version>
    <configuration>
       <executable>/home/name/dev/pers/jextract21/bin/jextract</executable>
       <headerSearchPaths>/usr/include/</headerSearchPaths>
    </configuration>
    <executions>
       <execution>
          <id>triple</id>
          <goals>
             <goal>sources</goal>
          </goals>
          <configuration>
             <headerFile>src/main/resources/test.h</headerFile>
             <targetPackage>org.my.package</targetPackage>
             <includeFunctions>
                <includeFunction>triple</includeFunction>
             </includeFunctions>
          </configuration>
       </execution>
    </executions>
</plugin>

Was it removed in JDK22?

Exactly, see https://github.com/coffeelibs/jextract-maven-plugin/releases/0.4.0


Migration to .NET Standard 1.4

Hello,
I've been using your control for some months now and I just wanted to give a small contribution by migrating your project to .NET Standard 1.4 (.NET Standard 2.0 only works in UWP projects if you target the release 16299).

How di you make it work with 1.4 if Xamarin.Forms is compatible only with 2.0?

Xamarin(.Forms) is compatible with all versions of .NET Standard: https://docs.microsoft.com/en-us/dotnet/standard/net-standard.
.NET Standard 2.0 is now supported with Xamarin.Forms 2.4

Xamarin.Forms is not on that list. I tried before and it didn't work. in UWP it only works with 16299 release and still doesn't works or i don't know how to make it work. It says my OS is running previous version.

Of course Xamarin.Forms is not on that list as it's an additional layer added on top of Xamarin.iOS, Xamarin.MacOS, Xamarin.Android and UWP. Once again, if you target .NET Standard 1.4, your plugin will work will all UWP SDK. Have a look at the plugins of James Montemagno, all of them target .NET Standard.
Example: https://github.com/jamesmontemagno/GeolocatorPlugin/blob/master/src/Geolocator.Plugin.Abstractions/Geolocator.Plugin.Abstractions.csproj
If you have a closer look at the pull request, you will see that the target version of the UWP Demo project is still set to 15063 and the min version to 10240. It compiles and works. Just download the code or clone the fork of your project from my repository: https://github.com/arnaudmaichac/CarouselView/tree/NetStandard
By targeting .NET Standard 2.0, you will have to set the target and min version of your UWP project to 16299.

I tried before and it didnt work. Will give it another shot.

Happy to see you were able to target .NET Standard 1.4 in the version 5.0 👍

Yes, i did. Also i found out that the same Net.Standard binary works on PCL, so the plugin is backward compatible.


Provide a tutorial for writing NXdata

Do we want to provide a tutorial for manually writing NXdata, or do we aim at providing helper functions for all possibles NXdata use cases ?
See #1603

+1

Simple save_image as NXdata and save_curve as NXdata (accepting single items or lists)
We would provide the necessary asserts (same length for curves, correct number of names, ...)


automatic shade levels for small-valued data

Reported by ansley b manke on 5 Jul 2017 18:15 UTC
Reported by Hella Reide, https://www.pmel.noaa.gov/maillists/tmap/ferret_users/fu_2017/msg00468.html
This data which has small absolute values does not compute correct color levels for a SHADE command. - the uppermost value doesn't get a color. In addition the symbols which capture the levels settings are useless for the small-valued data,
yes? use color_lev_bug.nc
yes? stat co_emac

             CO EMAC
             LONGITUDE: 180E(-180) to 180E
             LATITUDE: 40S to 90N
             Z:  N/A
             T:  N/A
             E:  N/A
             F:  N/A
             DATA SET: ./bug.nc

 Total # of data points: 468 (36*13*1*1*1*1)
 # flagged as bad  data: 249
 Minimum value: 4.420167757E-08
 Maximum value: 0.00000018643
 Mean    value: 0.000000076222 (unweighted average)
 Standard deviation: 1.56683949E-08

yes? shade co_emac
yes? sh sym lev*
LEV_MIN = "0"
LEV_MAX = "0"
LEV_NUM = "29"
LEV_DEL = "0"

but scale the data, and the problem goes away.
yes? shade co_emac*1.e9
yes? sh sym lev*
LEV_MIN = "40"
LEV_MAX = "190"
LEV_NUM = "30"
LEV_DEL = "5"

Migrated-From: http://dunkel.pmel.noaa.gov/trac/ferret/ticket/2550

Modified by ansley.b.manke on 5 Jul 2017 18:18 UTC

Comment by ansley.b.manke on 6 Jul 2017 16:47 UTC
This is fixed in set_levels_shade_fill.F, to work in more precision when needed.  The top level was not included because of roundoff error. Fixes to setting the symbols LEV_MIN, LEV_MAX etc in setlab_syms.F and a small adjustment in key.F so the colorbar labels have enough digits.
New benchmark script err71_colorlevs.jnl

Attachment from ansley.b.manke on 5 Jul 2017 18:17 UTC
the data file used by the script
REPLACE THIS TEXT WITH UPLOADED FILE ./attachments/TRAC_2550_GIT_1822/color_lev_bug.nc

Attachment from ansley.b.manke on 5 Jul 2017 18:17 UTC
the resulting image
REPLACE THIS TEXT WITH UPLOADED FILE ./attachments/TRAC_2550_GIT_1822/color_lev_bug.png


When assigning a task to someone else why is it visible to the logged in  user in todos

Issue Description
[Provide a brief description of the issue here.]
Expected Behavior
Should be assinged to the respective user
Current Behavior
When assigning a task to someone else why is it visible to the logged in  user in todos
Screenshots
[If applicable, add screenshots or images that help illustrate the issue. You can use the following Markdown syntax to embed images:]
Environment

Operating System: [e.g., Windows, macOS, Linux]
Browser (if applicable): [e.g., Chrome, Firefox, Safari]
Version of Software/Project: [e.g., v1.0.0]

Additional Information
[Include any additional context, logs, or details that might be helpful in addressing the issue.]
Checklist

[ ] I have read and followed the project's code of conduct.
[ ] I have searched for similar issues before creating this one.
[ ] I have provided all the necessary information to understand and reproduce the issue.
[ ] I am willing to contribute to the resolution of this issue.

Thank you for contributing to our project! We appreciate your help in improving it.
📚 See contributing instructions.

please describe it properly.

These are todos of Goals App

[ ] Are we getting all todos from API and I don't think POST API is working properly? Please mention the reason before jumping to any solution.
[ ] When I am typing anything in goals form, it is kinda  disable, please fix this
[ ] The pickup date isn't visible even after choosing that.
[ ] Goals icon is not visible
[ ] Please fix the bug on choosing that member from drop-down, it should be scrolled down automatically


Use the verify flag on every network request

and allow it to be controlled from a local config file.
This is useful when testing against a dev server running on localhost.

Could you also update the doc strings on lines 406-415 and 1365-1374 to:
{
	"prod": {
		"url": "https://validation-v1.brainsimulation.eu",
		"client_id": "3ae21f28-0302-4d28-8581-15853ad6107d",
		"verify_ssl": true
	},
	"dev_test": {
		"url": "https://validation-dev.brainsimulation.eu",
		"client_id": "90c719e0-29ce-43a2-9c53-15cb314c2d0b",
		"verify_ssl": false
	}
}


Properly dispose subscriptions in example

Coverage remained the same at 93.187% when pulling c672fa5a588c4d56a098aee26384006d5a63105b on fix-example-bug into 8b8ae28474a91fd6fdfb837cb2366d669de35217 on master.


Mashup Container Profile not run

Good morning.
I can't get "Mashup Container Profile" to work since I updated the Gateway.

I'm encountering the same error.
It appears to be failing at this step:
= Table.AddColumn(#"Expanded Custom", "Custom", each Table.FromRecords( Json.Document(Text.Combine(List.Skip(Lines.FromBinary([Content]),7)))))
I'm attaching the MashupContainerProfiles.log file that is the source for this particular query.  Could this be due to a recent update of the log file format?
MashupContainerProfiles.log

Exactly, the MashupContainerProfiles.log on the latest update is not longer a valid JSON file (after line 6) and I cannot simply read it with Json.Document.
I'm waiting for a confirmation from the Gateway team if this change is permanent to fix the template

Fixed this issue today, by adapting the PowerQuery to the new file format.

@RuiRomano Looks like its again happening with mashup container profile after Nov23 gateway upgrade.


smpl mesh mismatch garments

I'm running the demo as readme. The output garment meshes look nice, but why does the smpl mesh mismatch with them?

Hi, we do not implement the try-on between dynamic garment mesh and human SMPL.


Fix wrong user returned in API (#15139)

The API call: GET /repos/{owner}/{repo}/pulls/{index}/reviews/{id}/comments
returns always the reviewer, but should return the poster.
Co-authored-by: 6543<EMAIL_ADDRESS>Co-authored-by: zeripath<EMAIL_ADDRESS>

@6543 I think we should re-work the fix, see https://github.com/go-gitea/gitea/pull/15139#issuecomment-806507139


Version 2.1.13 isn't published to npm

The version was bumped to 2.1.13 6 days ago, but it wasn't released to npm.
https://github.com/karma-runner/karma/issues/2603 would get fixed by this version bump.

My bad, apologies for the inconvenience.

It's published now*


[usbdev] vcs simulation error

Description
I was running dvsim (with vcs) on usbdev (following the instruction on doc: $ $REPO_TOP/util/dvsim/dvsim.py $REPO_TOP/hw/ip/usbdev/dv/usbdev_sim_cfg.hjson -i usbdev_smoke
) ($REPO_TOP is assigned to the project path) and receiving the error:
## Failure Buckets

* `Job killed most likely because its dependent job failed.` has 50 failures:
    * Test usbdev_smoke has 50 failures.
        * 0.usbdev_smoke.113191544020138269311601978749896137825200446949674567954761446161057716144844\
         Log /home/rg/edaplay/opentitan/scratch/HEAD/usbdev-sim-vcs/0.usbdev_smoke/latest/run.log

        * 1.usbdev_smoke.57796881990879131150646658121476870022023561893310958635400675336129742354532\
         Log /home/rg/edaplay/opentitan/scratch/HEAD/usbdev-sim-vcs/1.usbdev_smoke/latest/run.log

        * ... and 48 more failures.
* `Error-[NYI] Not Yet Implemented` has 1 failures:
    * Test default has 1 failures.
        * default\
          Line 1529, in log /home/rg/edaplay/opentitan/scratch/HEAD/usbdev-sim-vcs/default/build.log

                Error-[NYI] Not Yet Implemented
                ../src/lowrisc_dv_usbdev_env_0.1/seq_lib/usbdev_spray_packets_vseq.sv, 269
                  Feature is not yet supported: Hierarchical reference to a structure array
                  member connected to task ref-port is not supported
                  Source info: usbdev_env_pkg::\usbdev_base_vseq::check_rxfifo_packet (this,

I have no idea why did this happen since i was running the aes and i2c simulation fine.
Additionally I found that in an previous revision https://reports.opentitan.org/hw/ip/usbdev/dv/2024.04.03_04.01.25/report.html similar error "Error-[NYI] Not Yet Implemented`" was found.

The error here is at build time. I've just run that exact command and it works (as you'd hope). Is the problem a difference in VCS version? I am using version 2023.03.

Thanks for the advice, it is indeed an issue in VCS verison!!
I'm using VCS 2020, and looks like "VCS 2020 has limitations in handling hierarchical references to structure array members connected to task reference ports." as the error message suggests.
Passing a dynamic array to the exp_byte_data argument of check_rxfifo_packet works for my case.


If it can't connect to a service, the entire bridge stops working.

Describe the bug
There are connection issues with the matrix.org server which prevents the bridge from connecting, however, our bridge includes more than 2 protocols.
To Reproduce
Steps to reproduce the behavior:
· Attempt to start Matterbridge with an invalid or unreachable service.
Expected behavior
Matterbridge should ignore the faulty service and continue the normal functionality, and attempt to reconnect to the faulty one after a while.
Screenshots/debug logs
[2019-11-14T17:33:09Z]  INFO matrix:       matrix.mymatrix: joining #(redacted):matrix.org (ID: #(redacted):matrix.orgmatrix.mymatrix)
[2019-11-14T17:33:20Z] FATAL main:         Starting gateway failed: Bridge matrix.mymatrix failed to join channel: (redacted) msg=Failed to POST
JSON to /_matrix/client/r0/join/#(redacted):matrix.org:
503 Service Unavailable

No server is available to handle this request.

 code=503 wrapped=

Environment (please complete the following information):

OS: Ubuntu 18.04 LTS
Matterbridge version: version: 1.16.1 bad1990

There is a setting for it.
See https://github.com/42wim/matterbridge/wiki/Settings#ignorefailureonstart


[TASK] standardize the use of Assember across RAVEN

Issue Description
Currently, we have two different ways to add and retrieve Assembler Object. We should standardize the method that we use Assembler.
Is your feature request related to a problem? Please describe.
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]
Describe the solution you'd like
A clear and concise description of what you want to happen.
Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.

For Change Control Board: Issue Review
This review should occur before any development is performed as a response to this issue.

[x] 1. Is it tagged with a type: defect or task?
[x] 2. Is it tagged with a priority: critical, normal or minor?
[x] 3. If it will impact requirements or requirements tests, is it tagged with requirements?
[x] 4. If it is a defect, can it cause wrong results for users? If so an email needs to be sent to the users.
[x] 5. Is a rationale provided? (Such as explaining why the improvement is needed or why current code is wrong.)

For Change Control Board: Issue Closure
This review should occur when the issue is imminently going to be closed.

[ ] 1. If the issue is a defect, is the defect fixed?
[ ] 2. If the issue is a defect, is the defect tested for in the regression test system?  (If not explain why not.)
[ ] 3. If the issue can impact users, has an email to the users group been written (the email should specify if the defect impacts stable or master)?
[ ] 4. If the issue is a defect, does it impact the latest release branch? If yes, is there any issue tagged with release (create if needed)?
[ ] 5. If the issue is being closed without a pull request, has an explanation of why it is being closed been provided?

An additional consideration:
Currently there are two required arguments to retrieve an assembled object: the "tag" (TargetEvaluation or Output for example) and the "name" (given by the user in the user manual).
It's not clear that the second argument should be required, if it does have a purpose. It might be worth making the object name optional, and return a list of matching entries if there are more than one.


#2797, #2794 and fix MEF failures

#2797 First time connection displayed in red

IsConnected changes after interlocked, need to cache original state.

#2794 Add GPU report to the session info
Revert MEF export as property since exporting as property does not work, MEF imports fail.

Actually I don't what happens with multiple and MO search. I guess We'd have to return a collection


Font of Editor

I want the font of the editor to be italic, but there is no such option in User Settings. Hope this option could be added in the next version.

Dup of https://github.com/Microsoft/vscode/issues/24830


Saving edited note title and description should be allowed

Right now saving title and description is tightly coupled to saving content. They should be separated, since they are stored separately it should be easy to save title only, description only or both without overwriting content.

Solved in #46


External CSS reference is making site slow to load

Description
There is a reference to an external stylesheet on typekit.net that is extremely slow to load, eventually timing out:
https://github.com/PublicMapping/districtbuilder/blob/6b14c3d7b7626f0a12a248ed286814240ac05a31/public/index.html#L6
This is slowing down page loads for DistrictBuilder by a large amount.

This seems to have been a temporary issue?


is self contained installation possible?

Hi,
I am using this package in a docker environment with a multistage build, i.e. I am building all python dependancies to a virtual environment in a build stage and copying it to the final production image.
I was hoping pymongoarrow would be self contained, i.e. it would not require any additional apt-get installs in the production image.
However, when attempting to use pymongoarrow in the production image I am getting:
/opt/venv/lib/python3.9/site-packages/pymongoarrow/__init__.py:34: UserWarning: Could not find compiled pymongoarrow.lib extension, please install from source or report the following traceback on the issue tracker:
Traceback (most recent call last):
  File "/opt/venv/lib/python3.9/site-packages/pymongoarrow/__init__.py", line 32, in <module>
    from pymongoarrow.lib import libbson_version
ImportError: libbson-1.0.so.0: cannot open shared object file: No such file or directory

  warnings.warn(
Traceback (most recent call last):
  File "/usr/lib/python3.9/runpy.py", line 197, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "/usr/lib/python3.9/runpy.py", line 87, in _run_code
    exec(code, run_globals)

(...)

    from pymongoarrow.api import Schema
  File "/opt/venv/lib/python3.9/site-packages/pymongoarrow/api.py", line 26, in <module>
    from pymongoarrow.context import PyMongoArrowContext
  File "/opt/venv/lib/python3.9/site-packages/pymongoarrow/context.py", line 16, in <module>
    from pymongoarrow.lib import (
ImportError: libbson-1.0.so.0: cannot open shared object file: No such file or directory

here are the contents of pymongoarrow site-package
$ ls -l /opt/venv/lib/python3.9/site-packages/pymongoarrow/
total 68624
-rw-r--r-- 1 user user     1606 Nov 23 17:16 __init__.py
drwxr-xr-x 2 user user      267 Nov 23 17:16 __pycache__
-rw-r--r-- 1 user user    13902 Nov 23 17:16 api.py
-rw-r--r-- 1 user user     3456 Nov 23 17:16 context.py
-rw-r--r-- 1 user user     1553 Nov 23 17:16 errors.py
-rwxr-xr-x 1 user user  2400424 Nov 23 17:16 lib.cpython-39-aarch64-linux-gnu.so
-rw-r--r-- 1 user user    13466 Nov 23 17:16 lib.pyx
-rw-r--r-- 1 user user     1232 Nov 23 17:16 libarrow.pxd
-rwxr-xr-x 1 user user 56618568 Nov 23 17:16 libarrow.so.900
-rwxr-xr-x 1 user user  2251680 Nov 23 17:16 libarrow_python.so.900
-rw-r--r-- 1 user user     3960 Nov 23 17:16 libbson.pxd
-rwxr-xr-x 1 user user  8915624 Nov 23 17:16 libparquet.so.900
-rw-r--r-- 1 user user     1484 Nov 23 17:16 monkey.py
-rw-r--r-- 1 user user      945 Nov 23 17:16 result.py
-rw-r--r-- 1 user user     2397 Nov 23 17:16 schema.py
-rw-r--r-- 1 user user     4465 Nov 23 17:16 types.py
-rw-r--r-- 1 user user      637 Nov 23 17:16 version.py

I need to install the libbson library explicitly with
sudo apt-get update && sudo apt-get install libbson-1.0-0

then everything is working as expected.
Is this a bug or a feature?
Best,
Wiktor

Hi @noname77, our built wheels include libbson, and our conda-forge recipe depends on the libbson conda package, but if you're building from source, then yes, you will need to either install libbson from your package manager, or use our build-libbson.sh script to build from GitHub source.

Thank you,
is there a plan to build and publish wheels for aarch64 architecture?

I created https://jira.mongodb.org/browse/ARROW-131


finalization issue

For this ENS auction (krishnan.ens):
https://etherscan.io/enslookup?q=0x34d07f64507d3220a7a755f469c9ca6270f57491fb5a8b61085467d94cb53078
There were 3 bids, with mine being the highest. On the registrar DAPP page, it gets the refund amount upon finalisation correct, but it says that no other bids exceeded the minimum bid amount.
"This name was registered at 2017-05-21. Owner offered to pay up to 0.1 ether. No other bid was above the minimum of 0.01 ether.
Owned by: this account belongs to you
Needs to be renewed by: 2019-05-21
Before any changes can be done to the name, the owner of this name needs to be finalized which can send them a refund 0.04700000000000001 ether to them."
And possibly related, if you look at the finalisation transaction, you will see that the refund of the amount over the second highest bid doesn't make it through to the address that won the auction.  The ownership of the domain did seem to work properly.
Chromium + MetaMask, Ubuntu 16.04 LTS
While you're looking at this, the wording "which can send them a refund 0.04700000000000001 ether to them." isn't very good.  Should just be "which can send them a refund of 0.04700000000000001 ether"

Thinking more about it, I have been having some struggles with my router lately.  At the time of finalisation I had some connectivity obviously since the finalisation appears on the blockchain, but maybe intermittent connectivity messed it up somehow?  Is there some checking on the state of connectivity?  Maybe more of a MetaMask issue if it reports old info instead of some sort of connection error.


Commitment to maintenance?

I submitted a PR to nvim-treesitter to make this the default grammar for Meson, but they're concerned about the long term stability of the project. Do you plan to maintain it or is it a one shot thing?

Not the stability of this project, but its maintenance downstream.

(Listen to this person. Sorry, I really should have prepared better.)


Out of pokeball

Expected Behavior
farm pokeshop
Actual Behavior
[#] Walking from (40.773632899999996, -73.97418739999999) to (40.77404382503233, -73.97322318103993) for approx. 38.0 seconds
[#] Finished walking to (40.77404382503233, -73.97322318103993)
[x] Walked to Pokemon
[#] A Wild Pidgey appeared! [CP75]
[x] Out of pokeballs...
[x] Farming pokeballs...
[x] Found pokemon at distance<PHONE_NUMBER>26m
[#] Walking from (40.77404382503233, -73.97322318103993) to (40.774392713676995, -73.97404965831205) for approx. 32.0 seconds
[#] Finished walking to (40.774392713676995, -73.97404965831205)
[x] Walked to Pokemon
[x] Found pokemon at distance<PHONE_NUMBER>72m
[#] Walking from (40.774392713676995, -73.97404965831205) to (40.77404382503233, -73.97322318103993) for approx. 32.0 seconds
[#] Finished walking to (40.77404382503233, -73.97322318103993)
[x] Walked to Pokemon
[#] A Wild Pidgey appeared! [CP75]
[x] Out of pokeballs...
[x] Farming pokeballs...
certain [x] Found pokemon at distance<PHONE_NUMBER>26m
[#] Walking from (40.77404382503233, -73.97322318103993) to (40.774392713676995, -73.97404965831205) for approx. 32.0 seconds
Steps to Reproduce
Other Information
OS: Debian 8
Git Commit: (run 'git log -n 1 --pretty=format:"%H"' and paste it here)

please provide the git commit format

Run git pull so you have the latest version. Then in config.json edit line 8 to say "mod": "farm",.

Git Commit: ab604452c2a0a72e13fa6d940fa55902d3b01466
Im using the latest version :(

@hklcf this was committed 8 hours ago

@petercunha where can i find the config.json?
I just see config.json.example in the folder.

rename .example to config.json

@surfaace ah...
when i run git pull it return up-to-date

what branch? git branch

oh sorry!
im using master branch :-1:


Update README.md and governance docs to improve clomonitor score

adds direct links to slack repos
adds MAINTAINERS.md and GOVERNANCE.md files that reference the real files
add link to license scanner output
adds clomonitor badge

Kind
/kind cleanup
Release Note
NONE

Adds MAINTAINERS.md and GOVERNANCE.md files that reference the real files

Why would we add these? Istio and Kubernetes don't have "sym link" to their governance and maitainers files.

Add CLOMonitor

Why do we need this?

I'm trying to improve the score that is shown on the CNCF website:

Adding the MAINTAINERS.md and GOVERNANCE.md files will make this check succeed:

(https://clomonitor.io/projects/cncf/cert-manager#cert-manager_documentation)

waiting for this update: https://github.com/cncf/clomonitor/pull/1270
/hold

@maelvls blocked by https://github.com/cert-manager/community/pull/10

/lgtm
/approve

/unhold

/hold

@maelvls I updated the PR, so we replace the files that we moved to the community repo with links to their new location. These files were created in the community repo in https://github.com/cert-manager/community/pull/10.


bash completion

would be nice to have autocompletion on the commandline.

Agreed! I'm not sure where this will fit in the list of priorities, but this would definitely be nice to have. 👍

Will endeavour to include this in first release of Buckaroo Redux. Likely we can install using the .deb file.
Basically this file (https://github.com/LoopPerfect/buckaroo/blob/buckaroo-redux/buckaroo_bash_completion.bash) needs to be copied into /etc/bash_completion.d/.


Add Ratings component

For a scoring component, please refer to: https://vuetifyjs.com/zh-Hans/components/ratings

This appears to be a duplicate of #219

#219


Error Occurs When Negative Parameter is Passed to epoch_to_timestamp Function.

When passing a negative value to the epoch_to_timestamp function, the following error occurs:
called `Result::unwrap()` on an `Err` value: TryFromIntError(())
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace

Values before January 1, 1970, are negative. This means that any timestamp representing a date prior to the Unix epoch (1970-01-01) will be a negative number. The function should ideally handle these cases without resulting in an error.
For example, test with the following code:
_ = epoch_to_timestamp::<1_000_000>(-1);

Thank you.

I assume you have happend to discover that behavior then trying to read data with timestamps older than 1970-01-01? What is the ask here? I think yielding a proper error instead of a panic is doable, yet supporting such timestamps in arrow is a different beast.
Do you want to get an error instead of the panic? Or is it something else you are after?

I wrote a test program and obtained the following results.
use arrow::{
    array::{
        RecordBatch, TimestampMicrosecondArray, TimestampMillisecondArray,
        TimestampNanosecondArray, TimestampSecondArray,
    },
    datatypes::{DataType, Field, Schema, TimeUnit},
};

fn main() {
    let sec_array = TimestampSecondArray::from(vec![-1]);
    let mili_array = TimestampMillisecondArray::from(vec![-1]);
    let micro_array = TimestampMicrosecondArray::from(vec![-1]);
    let nano_array = TimestampNanosecondArray::from(vec![-1]);
    let schema = Schema::new(vec![
        Field::new("sec", DataType::Timestamp(TimeUnit::Second, None), false),
        Field::new(
            "mili",
            DataType::Timestamp(TimeUnit::Millisecond, None),
            false,
        ),
        Field::new(
            "micro",
            DataType::Timestamp(TimeUnit::Microsecond, None),
            false,
        ),
        Field::new(
            "nano",
            DataType::Timestamp(TimeUnit::Nanosecond, None),
            false,
        ),
    ]);

    let batch = RecordBatch::try_new(
        Arc::new(schema),
        vec![
            Arc::new(sec_array),
            Arc::new(mili_array),
            Arc::new(micro_array),
            Arc::new(nano_array),
        ],
    )
    .unwrap();

    println!("{:?}", batch);
}

Output:
RecordBatch { schema: Schema { fields: [Field { name: "sec", data_type: Timestamp(Second, None), nullable: false, dict_id: 0, dict_is_ordered: false, metadata: {} }, Field { name: "mili", data_type: Timestamp(Millisecond, None), nullable: false, dict_id: 0, dict_is_ordered: false, metadata: {} }, Field { name: "micro", data_type: Timestamp(Microsecond, None), nullable: false, dict_id: 0, dict_is_ordered: false, metadata: {} }, Field { name: "nano", data_type: Timestamp(Nanosecond, None), nullable: false, dict_id: 0, dict_is_ordered: false, metadata: {} }], metadata: {} }, columns: [PrimitiveArray<Timestamp(Second, None)>
[
  1969-12-31T23:59:59,
], PrimitiveArray<Timestamp(Millisecond, None)>
[
  1969-12-31T23:59:59.999,
], PrimitiveArray<Timestamp(Microsecond, None)>
[
  1969-12-31T23:59:59.999999,
], PrimitiveArray<Timestamp(Nanosecond, None)>
[
  1969-12-31T23:59:59.999999999,
]], row_count: 1 }

I don't think that Arrow doesn't support negative timestamp values.
Chrono's DateTime has a from_timestamp_nanos function that can obtain values from nanoseconds. How about modifying epoch_to_timestamp as follows?
pub fn epoch_to_timestamp<const UNIT_FACTOR: i64>(from: i64) -> Timestamp {
    let timestamp = from * (1_000_000_000 / UNIT_FACTOR);
    let ndt = chrono::DateTime::from_timestamp_nanos(timestamp);
    let date = ndt.date_naive();
    let time = ndt.time();
    Timestamp {
        year: date.year().try_into().unwrap(),
        month: date.month().try_into().unwrap(),
        day: date.day().try_into().unwrap(),
        hour: time.hour().try_into().unwrap(),
        minute: time.minute().try_into().unwrap(),
        second: time.second().try_into().unwrap(),
        fraction: time.nanosecond(),
    }
 }

fixed in arrow-odbc 13.0.1


Interest in removing jquery dependency?

This is something that I'm considering tackling but was curious how others felt about eliminating jquery/zepto dependency?

I think I've seen talk about this around here (or perhaps on HN).
Unless there are some strong arguments for using jQuery in this context, I think we should help paint the picture that you might not always need jQuery and ditch it entirely.

I juggled this on and off, and then dumped my thoughts here. Let's continue the discussion there.
I'd be interested in seeing how compact a 100% equivalent vanilla alternative would look, and how it compares to the < 10KB that Zepto + shoelace.js requires.
Another point I made was that using Zepto as a base (and jQuery as an alternative) provides a foundation for building elegant third-party components. But like I said, let's discuss it in #21.


Test Tools deprecated and not working

It is a minor thing, but the provided Test Tools were deprecated by Unity and don't work in the newer Versions of Unity. I think Testing is now built directly into Unity.

Updated to work with 2019.1. Grab it here: https://github.com/FluidPlay/syrinj


Publish a new version

We want to try and make use of Bytes::to_mut in some parts of Servo. I don't know if the other changes that landed since 0.5.0 are breaking or not, but you yourself probably know whether they are already. :)

0.5 isn't ready yet, but if to_mut is a non-breaking change, it could be backported to the 0.4.x branch.

Yeah, it would need to be back ported.

@nox would you be able to backport? Otherwise, I probably won't get to it before next week.

I'm going to close this as there has been no response.


Define custom Helm repositories in the Helm chart

This simplifies using custom Helm repositories and generates a
repositories.yaml for the Helm operator.
Relates to #1862
Signed-off-by: Simon Rüegg<EMAIL_ADDRESS>

@stefanprodan The BGB (Big Green Button) is yours


Mistake in readme

There is a little mistake in readme guide. In the description of the configuration file there is 'pg' key for the postgres connection and etc. This error follows:
root@9529452bd859:/home/go/pg2ch# go run main.go --config config.yaml
could not load config: publication name is not specified
exit status 1
If you look in the source file (pkg\config\config.go) there is different key 'postgres'
And if replace 'pg' with 'postgres', it works correctly.

fixed.
thank you!


External cluster for postsubmit

Follow up to #338

Jenkins job manager/presubmit passed

Jenkins job manager/presubmit passed

Jenkins job manager/presubmit passed


Add Custom header parsing to Docker Provider

This PR provide a basis for updating the Kubernetes provider.
Fixes #2028

This PR will resolve https://github.com/containous/traefik/issues/2028 and will provide a basis for updating the kubernetes provider

Still working on this.

Ok. Submitting this for review.
This PR allows the custom request and response headers to be set via docker labels. The labels get parsed, and invoke the headers middleware.

Ping @containous/traefik

If review is passed, will squash and rebase.

@timoreimann Squashed, Rebased, Helper-ified, and Documented :)

ping @containous/traefik

@ldez corrections implemented!


BinExport2Sql9 from IDAPython

Is it possible to call function BinExport2Sql9 from IDAPython? Or is this function available only from IDC?

Oh, the problem solved itself: idc.Eval('BinExport2Sql9()'). Is there other ways to call this function from IDAPython?

Slightly more complicated:
import idaapi
idc_lang = idaapi.find_extlang_by_name("idc")
idaapi.run_statements("BinExport2Sql9(\"host\", 5342, \"database\", \"public\", \"user\", \"pass\")",
                      idc_lang)

Alternatively, you could use idc.RunPlugin() to invoke the Plugin directly. In that case you need to set the plugin options manually before.


Random Error

Uncaught Error: C:/Users/Ben/justauserbot/mysql/client.lua:98: attempt to index local 'task' (a nil value) stack traceback:         C:/Users/Ben/justauserbot/mysql/client.lua:98: in function 'f'         C:/Users/Ben/justauserbot/mysql/client.lua:124: in function 'handler'         [string "bundle:deps/core.lua"]:248: in function 'emit'         [string "bundle:deps/stream/stream_readable.lua"]:992: in function <[str ing "bundle:deps/stream/stream_readable.lua"]:985>         [string "bundle:deps/timer.lua"]:123: in function <[string "bundle:deps/ timer.lua"]:119>         [C]: in function 'run'         [string "bundle:init.lua"]:52: in function <[string "bundle:init.lua"]:4 7>         [C]: in function 'xpcall'         [string "bundle:init.lua"]:47: in function 'fn'         [string "bundle:deps/require.lua"]:310: in function <[string "bundle:dep s/require.lua"]:266>
I appear to be getting this error randomly without even querying anything, have you seen something simular before?

its because mysql server close connection ECONNRESET after a timeout (show variables like 'wait_timeout';)
to solve this, you need to keep the connection alive:

send an empty request using client:ping() every 60 seconds
reconnect to database in ECONNRESET hander & socket:on("close


Treatment of T-Names in Scotland

Margaret Singleton said:
"sometimes the wife did use her maiden name and like everything else in FreeCEN it was entered “as is”. Sometimes both her married name and maiden name were entered e.g. “Smith or Jones” and this would be entered as Smith / Jones.  If you are saying we omit the backslash now and just put a space will both names be indexed?  Will old records with the backslash still be recognised?"
This means that our blocking the use of / in the Surname field will need to be amended to allow the entry.
It also means that we need to include a method o searching either side of the / in FC2 searching.
The fact that not allowing / did not raise a query from Kirk when we wrote the rules suggests that this ability my have been lost between FC1 and FC2. This will need to be checked by a programmer.
So there are 2 issues here - using a / in Scotland Surnames and searching.
Geoff

Handbook needs updating when Scotland can move forward


Modernize carbon flux

Modernizing an example checklist
Preliminary checks

[x] Look for open PRs and issues that reference the project you are updating. It is possible previous unmerged work in PR could be re-used to modernize the project. Comment on these PRs and issues when appropriate, hopefully we should be able to close some of them after your modernizing work.

Change ‘anaconda-project.yml’ to use the latest workable version of packages

[x] Pin python=3.11
[x] Remove the upper pin (e.g. hvplot<0.9 to hvplot, panel>=0.12,<1.0 to panel>=0.12) of all other dependencies. Removing the upper pins of dependencies could necessitate code revisions in the notebooks to address any errors encountered in the updated environment. Should complexities or extensive time requirements arise, document issues for team discussion on whether to re-pin specific packages or explore other solutions.
[x] Add/update the lower pin of all other dependencies (e.g. hvplot to hvplot>=0.9.2, hvplot>=0.8 to hvplot>=0.9.2). Usually, the new/updated lower pin of a dependency will be the version resolved after anaconda prepare has been run. Execute !conda list in a notebook, or anaconda run conda list in the terminal, to display the version of each dependency installed in the environment. Adjusting the lower pin helps ensure that the locks produced for each platform (linux-64, win-64, osx-64, osx-arm64) rely on the tested dependencies and not on some older versions.
[x] If one of the channels include conda-forge or pyviz, ask Maxime if it can be removed

Plot API updates (discussed on a per-example basis)

[x] Generally, try to replace HoloViews usage with hvPlot. At a certain point of complexity, such as with the use of ‘.select’, it might be better to stick with HoloViews. Additional examples of ‘complexity boundaries’ should be documented in this document.
[x] Almost always, try to replace the use of datashade with rasterize (read this page). Essentially, rasterize allows Bokeh to handle the colormapping instead of Datashader.

Interactivity API updates (discussed on a per-example basis)

[x] Remove all pn.interact usage
[x] Avoid .param.watch() usage. This is pretty low-level and verbose approach and should not be used in Examples unless required, or an Example is specifically trying to demo its usage in an advanced workflow.
[x] Prefer using pn.bind(). Read this page for explanation.
[x] For apps built using a class approach, when they create a view() method and call it directly, update the class by inheriting from pn.viewable.Viewer and replace view() by __panel__(). Here is an example.

Panel App updates (discussed on a per-example basis)

[x] If the project doesn’t at any point create a Panel app at all, consider creating one. It can be as simple as wrapping a plot in pn.Column, or more complicated to incorporate widgets, etc. Make the final app  .servable().
[x] If the project creates an app in a notebook but doesn’t deploy it (i.e. there is no command: dashboard declaration in the anaconda-project.yml file), try adding it.
[x] If the project already deploys an app but doesn’t wrap it in a nice template, consider wrapping it in a template.
[x] If the project deploys an app wrapped in a template, customize the template a little so all the apps don’t look similar (e.g. change the header background color). This doesn’t need to be discussed.
[x] Comment start If you are building the application in a single cell, you can construct a template explicitly, like template = pn.template.BootstrampTemplate, but if building up an app across multiple cells, it is probably cleaner to declare the template at the top with pn.extension(template='bootstrap'). See how to guide on setting a template.

General code quality updates

[x] If the notebook disables warnings (e.g. with warnings.simplefilter(‘ignore’) somewhere at the start of the notebook, remove this line. Try to update the code to remove the warnings, if any. If updating the code to remove the warnings is taking significant amount of time and effort, bring it up for discussion and we may decide to disable warnings again.

Text content

[x] Edit the text content anywhere and everywhere that it can be improved for clarity.
[x] Check the links are valid, and update old links (e.g. http -> https, xyz.pyviz.org -> xyz.holoviz.org)
[x] Remove instructions to install packages inside an example

Visual appearance - Example

[x] Check that the titles/headings make sense and are succinct.
[x] Check that the text content blocks are easily readable; revise into additional paragraphs if needed.
[x] Check that the code blocks are easily readable; revise as needed. (e.g. add spaces after commas in a list if there are none, wrap long lines, etc.)
[x] Check image and plot sizes. If possible, making them responsive is highly recommended.
[x] Check the appearance on a smartphone (check Google to see how to adapt the appearance of your browser to display pages as if they were seen from a smartphone, this is usually done via the web developer tools). This is not a top priority for all examples, but if there are a few easy and straightforward changes to make that can improve the experience, let’s do it.
[x] Check the updated notebook with the original notebook

Visual appearance - Gallery

[x] Check the thumbnail is visually appealing
[x] Check the project title is well formatted (e.g. Ml Annotators to ML Annotators), if not, add/update the examples_config.title field in anaconda-project.yml
[x] Check the project description is appropriate, if not, update the description field in anaconda-project.yml

Workflow (after you have made the changes above)

[x] Run successfully doit validate:<projectname>
[x] Run successfully doit test:<projectname>
[x] Run successfully doit doc_one –name <projectname>. It’s better if the project notebook(s) is saved with its outputs (but be sure to clear outputs before committing to the examples repo!) when building the docs. Then open this file in your browser ./builtdocs/index.html and check how the site looks.
[x] If you’re happy with all the above, open a PR. Reminder, clear notebook outputs before pushing to the PR.

This is still a WIP. Not ready for review yet.

Bug Report on this example notebook: Inconsistency with the usage of intake
These are the current issues preventing the complete modernization of this notebook:

Version Compatibility:
Although it is recommended to pin intake to <2, only version 0.6.2 runs without errors. For example, executing metadata = cat.fluxnet_metadata().read() results in the following traceback error with other versions:

Traceback
ValueError                                Traceback (most recent call last)
Cell In[4], line 1
----> 1 metadata = cat.fluxnet_metadata().read()
      2 metadata.sample(5)

File ~/Documents/development/holoviz-topics-examples/carbon_flux/envs/default/lib/python3.11/site-packages/intake/source/csv.py:190, in CSVSource.read(self)
    186     return self._dask_df.compute()
    188 import pandas as pd
--> 190 self._get_schema()
    191 return pd.concat([self._get_partition(i) for i in range(len(self.files()))])

File ~/Documents/development/holoviz-topics-examples/carbon_flux/envs/default/lib/python3.11/site-packages/intake/source/csv.py:142, in CSVSource._get_schema(self)
    140 nrows = self._csv_kwargs.get("nrows")
    141 self._csv_kwargs["nrows"] = 10
--> 142 df = self._get_partition(0)
    143 if nrows is None:
    144     del self._csv_kwargs["nrows"]

File ~/Documents/development/holoviz-topics-examples/carbon_flux/envs/default/lib/python3.11/site-packages/intake/source/csv.py:160, in CSVSource._get_partition(self, i)
    157     return self._dask_df.get_partition(i).compute()
    159 url_part = self.files()[i]
--> 160 return self._read_pandas(url_part, i)

File ~/Documents/development/holoviz-topics-examples/carbon_flux/envs/default/lib/python3.11/site-packages/intake/source/csv.py:166, in CSVSource._read_pandas(self, url_part, i)
    163 import pandas as pd
    165 if self.pattern is None:
--> 166     return pd.read_csv(url_part, storage_options=self._storage_options, **self._csv_kwargs)
    168 drop_path_column = "include_path_column" not in self._csv_kwargs
    169 path_column = self._path_column()

File ~/Documents/development/holoviz-topics-examples/carbon_flux/envs/default/lib/python3.11/site-packages/pandas/io/parsers/readers.py:1026, in read_csv(filepath_or_buffer, sep, delimiter, header, names, index_col, usecols, dtype, engine, converters, true_values, false_values, skipinitialspace, skiprows, skipfooter, nrows, na_values, keep_default_na, na_filter, verbose, skip_blank_lines, parse_dates, infer_datetime_format, keep_date_col, date_parser, date_format, dayfirst, cache_dates, iterator, chunksize, compression, thousands, decimal, lineterminator, quotechar, quoting, doublequote, escapechar, comment, encoding, encoding_errors, dialect, on_bad_lines, delim_whitespace, low_memory, memory_map, float_precision, storage_options, dtype_backend)
   1013 kwds_defaults = _refine_defaults_read(
   1014     dialect,
   1015     delimiter,
   (...)
   1022     dtype_backend=dtype_backend,
   1023 )
   1024 kwds.update(kwds_defaults)
-> 1026 return _read(filepath_or_buffer, kwds)

File ~/Documents/development/holoviz-topics-examples/carbon_flux/envs/default/lib/python3.11/site-packages/pandas/io/parsers/readers.py:620, in _read(filepath_or_buffer, kwds)
    617 _validate_names(kwds.get("names", None))
    619 # Create the parser.
--> 620 parser = TextFileReader(filepath_or_buffer, **kwds)
    622 if chunksize or iterator:
    623     return parser

File ~/Documents/development/holoviz-topics-examples/carbon_flux/envs/default/lib/python3.11/site-packages/pandas/io/parsers/readers.py:1620, in TextFileReader.__init__(self, f, engine, **kwds)
   1617     self.options["has_index_names"] = kwds["has_index_names"]
   1619 self.handles: IOHandles | None = None
-> 1620 self._engine = self._make_engine(f, self.engine)

File ~/Documents/development/holoviz-topics-examples/carbon_flux/envs/default/lib/python3.11/site-packages/pandas/io/parsers/readers.py:1880, in TextFileReader._make_engine(self, f, engine)
   1878     if "b" not in mode:
   1879         mode += "b"
-> 1880 self.handles = get_handle(
   1881     f,
   1882     mode,
   1883     encoding=self.options.get("encoding", None),
   1884     compression=self.options.get("compression", None),
   1885     memory_map=self.options.get("memory_map", False),
   1886     is_text=is_text,
   1887     errors=self.options.get("encoding_errors", "strict"),
   1888     storage_options=self.options.get("storage_options", None),
   1889 )
   1890 assert self.handles is not None
   1891 f = self.handles.handle

File ~/Documents/development/holoviz-topics-examples/carbon_flux/envs/default/lib/python3.11/site-packages/pandas/io/common.py:728, in get_handle(path_or_buf, mode, encoding, compression, memory_map, is_text, errors, storage_options)
    725     codecs.lookup_error(errors)
    727 # open URLs
--> 728 ioargs = _get_filepath_or_buffer(
    729     path_or_buf,
    730     encoding=encoding,
    731     compression=compression,
    732     mode=mode,
    733     storage_options=storage_options,
    734 )
    736 handle = ioargs.filepath_or_buffer
    737 handles: list[BaseBuffer]

File ~/Documents/development/holoviz-topics-examples/carbon_flux/envs/default/lib/python3.11/site-packages/pandas/io/common.py:453, in _get_filepath_or_buffer(filepath_or_buffer, encoding, compression, mode, storage_options)
    445     return IOArgs(
    446         filepath_or_buffer=file_obj,
    447         encoding=encoding,
   (...)
    450         mode=fsspec_mode,
    451     )
    452 elif storage_options:
--> 453     raise ValueError(
    454         "storage_options passed with file object or non-fsspec file path"
    455     )
    457 if isinstance(filepath_or_buffer, (str, bytes, mmap.mmap)):
    458     return IOArgs(
    459         filepath_or_buffer=_expand_user(filepath_or_buffer),
    460         encoding=encoding,
   (...)
    463         mode=mode,
    464     )

ValueError: storage_options passed with file object or non-fsspec file path

Pinning intake=0.6.2 resolves this issue without any traceback errors.

Inconsistency in File Downloads:
The cell responsible for downloading the full fluxnet files shows inconsistent behavior:

s3 = S3FileSystem(anon=True)
s3_paths = s3.glob('earth-data/carbon_flux/nee_data_fusion/FLX*')

datasets = []
skipped = []
used = []

for i, s3_path in enumerate(s3_paths):
    sys.stdout.write(f'\r{i+1}/{len(s3_paths)}')

    try:
        dd = cat.fluxnet_daily(s3_path=s3_path).to_dask()
    except FileNotFoundError:
        try:
            dd = cat.fluxnet_daily(s3_path=s3_path.split('/')[-1]).to_dask()
        except FileNotFoundError:
            continue
    site = dd['site'].cat.categories.item()

    if not set(dd.columns) >= set(data_columns):
        skipped.append(site)
        continue

    datasets.append(clean_data(dd))
    used.append(site)

print()
print(f'Found {len(used)} fluxnet sites with enough data to use - skipped {len(skipped)}')

This cell sometimes generates the following traceback:

Traceback
1/209
/Users/mac/Documents/development/examples/carbon_flux/envs/default/lib/python3.11/site-packages/dask_expr/_collection.py:4160: UserWarning:
You did not provide metadata, so Dask is running your function on a small dataset to guess output types. It is possible that Dask will guess incorrectly.
To provide an explicit output types or to silence this message, please provide the `meta=` keyword, as described in the map or apply function that you are using.
  Before: .apply(func)
  After:  .apply(func, meta=(None, 'object'))

  warnings.warn(meta_warning(meta))
/Users/mac/Documents/development/examples/carbon_flux/envs/default/lib/python3.11/site-packages/dask_expr/_collection.py:4160: UserWarning:
You did not provide metadata, so Dask is running your function on a small dataset to guess output types. It is possible that Dask will guess incorrectly.
To provide an explicit output types or to silence this message, please provide the `meta=` keyword, as described in the map or apply function that you are using.
  Before: .apply(func)
  After:  .apply(func, meta=('TIMESTAMP', 'object'))

  warnings.warn(meta_warning(meta))

This warning is repeated for all the cells up to 209/209.
The circumstances under which this error occurs are unclear. A temporary solution, discovered with the help of @hoxbro, involves removing the local version of intake and re-downloading it using anaconda-project run. This typically resolves the issue. However, restarting the kernel and running the notebook from the top down might bring back the Traceback error.

Cell [20] Error:
The following code in Cell [20] generates a traceback error when the full data is not downloaded properly (as in problem 2):

partial_soil_data = df[df[soil_data_columns].notnull().any(1)]
partial_soil_data_sites = metadata[metadata.site.isin(partial_soil_data.site.unique())]

Traceback:
TypeError                                 Traceback (most recent call last)
Cell In[20], line 1
----> 1 partial_soil_data = df[df[soil_data_columns].notnull().any(1)]
      2 partial_soil_data_sites = metadata[metadata.site.isin(partial_soil_data.site.unique())]

TypeError: DataFrame.any() takes 1 positional argument but 2 were given

Using any(axis=1) resolves this error. However, if problem 2 does not occur, this cell runs without the TypeError.
@maximlt
@droumis

I have completely re-wrote the notebook to remove all usage of intake.

The .csv files are downloaded locally via awscli by running anaconda-project run download_fluxnet_daily. This takes about a minute to download all the files and saves in the same folder as the .txt file.

Some of the cells are failing the test now and I don't know why. I will investigate that later.

Otherwise, I think this is ready for review now.
@hoxbro

I have pushed for a fix that will make the test pass. I'm unsure why it doesn't work when you scatter with the index.
The doc build is failing; @Azaya89, can you try and see if you can fix this?

Arf @Azaya89 I see we're still having some issues. The error we encounter looks very similar to the one reported here https://github.com/aws/aws-cli/issues/8988. Digging more into this direction should hopefully give us a solution. This for instance looks promising https://github.com/aws/aws-cli/issues/5623#issuecomment-801240811, this too https://stackoverflow.com/questions/64992288/s3-sync-issue-running-in-azure-devops-pipeline-on-linux.

Arf @Azaya89 I see we're still having some issues. The error we encounter looks very similar to the one reported here aws/aws-cli#8988. Digging more into this direction should hopefully give us a solution. This for instance looks promising aws/aws-cli#5623 (comment), this too https://stackoverflow.com/questions/64992288/s3-sync-issue-running-in-azure-devops-pipeline-on-linux.

Thank you. Let me try this out...

The doc build is failing; @Azaya89, can you try and see if you can fix this?

Fixed. I think it is ready for final review now @hoxbro

dev site

LGTM!


Remove the word Blacklist from the API Manager UIs

Remove racially charged word 'Blacklist' from the product UIs. The admin portal contains Blacklist policies. Alternate words should be used as appropriate.

Fixed with https://github.com/wso2/carbon-apimgt/pull/8678


Interlock stops processing further events on swarm container error

When running a interlock + nginx plugin against a swarm cluster, I am running into what looks like a race condition where interlock tries to query for a container that doesn't exist and swarm throws an error stating that the said container doesn't exist.  It seems that interlock stops processing further events.  Here is a gif of the error in action.  Interlock is on top, swarm on the bottom:

I am running swarm from master on all of my swarm nodes as well as master and interlock:latest (0.2.6)

In testing, I found that if I switched my swarm-agent-master back to using swarm:0.3.0-rc2, I get the container errors but interlock continues to process events.

This should be fixed in the new ng branch.  Please re-open if you continue to notice issues.  Thanks!


VS Code extension instructions

Hi
I'm confused about how to get the VS Code extension working. I've copied the syntax/vscode folder into my VS Code extensions folder, but nothing seems to happen. Is there an install step I need to run?
Alternatively would it be possible to get the extension on the VS Code marketplace, or distribute it a .vsix file?

@peterreeves I'm sorry for the inconvenience caused by missing documentation, but since I am a heavy Vim user, I don't know much about VS Code.
In my case, Copying the contents of syntax/vscode directory into ~/.vscode/extensions/kogia-sima.vscode-sailfish-0.1.0 directory has worked properly.
I didn't know about .vsix` file. Thanks for the tips! And I'll update the document soon.

The extension is now available at Marketplace.

Thanks for putting it on the marketplace, it works perfectly!


Combobox filter function bug

In this filter function:
  const filter = async (value: string) => {
    // current active item
    const current = state.active === -1
      ? state.selected
      : state.items[state.active].value

I'm running into a bug where state.active is undefined. (Refer to the first value in the console log screenshot.)

I can reproduce this reliably. It happens on a fresh page refresh when I start entering an input in a combobox for the first time. The second time (after exiting and refocusing the combobox), it works correctly.
I believe it can be fixed with this change:
    const current = state.active === -1
      ? state.selected
      : state.items[state.active || 0].value

It will default to the first item if state.active is undefined.

Apparently, it was caused by something I did on my end. Turns out, if you set $combobox.selected = null, you also need to set $combobox.active = 0. Otherwise, that error happens.


With cnpm installed vue-cli being given, I use the company's other computer is being given, the error is as follows

[40/43]<EMAIL_ADDRESS>installed at node_modules\_request@2.81.0@request Install fail! Error: ENOENT: no such file or directory, chmod 'C:\Users\HP\AppData\Roaming\npm\node_modules\vue-cli\node_modules\_js-beautify<EMAIL_ADDRESS>Error: ENOENT: no such file or directory, chmod 'C:\Users\HP\AppData\Roaming\npm\node_modules\vue-cli\node_modules\_js-beautify<EMAIL_ADDRESS>   at Error (native)

dup of #591


DNS error after I change internet connection from Wifi to LAN or vice versa (host Windows 10 - Ubuntu 22.04)

Windows Version
Microsoft Windows [Version 10.0.19045.2728]
WSL Version
<IP_ADDRESS>
Are you using WSL 1 or WSL 2?

[X] WSL 2
[ ] WSL 1

Kernel Version
<IP_ADDRESS>
Distro Version
Ubuntu 22.04.2 LTS
Other Software
No response
Repro Steps
My Steps are here :

set computer connection to Wifi
install wsl from cmd/power shell using wsl --install -d ubuntu
after finish, run wsl2 (wsl_update_x64.msi)
login to ubuntu, ping google.com are fine and internet connection is good
while still on ubuntu, change computer connection to LAN
ping google give error "ping: google.com: Temporary failure in name resolution"
I tried every possible way (via googling) but cannot fix the problem
a. terminate and starting ubuntu
b. change /etc/resolv.conf and /etc/wsl.conf
c. flush dns in windows
d. restart windows
e. sudo ln -s ../run/resolvconf/resolv.conf resolv.conf
f. add IP gateway to eth0 using sudo ip addr add
When I changed computer connection to Wifi, command "ping google.com" still error

Expected Behavior
When change connection from wifi to LAN or otherwise, the WSL should maintain DNS automaticly
Actual Behavior
Ping or sudo apt or pip command did not work
Diagnostic Logs
No response

@taweijm before you switch connections, from an elevated powershell session run get-hnsendpoint to show the IPAdrdress assigned to the WSL instance. After switching from Wi-Fi to LAN run the command again. The enpoint info shouldn't change if using the default virtual switch setup by WSL installation. Also, run hnsdiag.exe list all to see if anything changes. Again, the enpoint info shouldn't change.  Did not repro on Windows 11, however you filed the bug for Windows 10.

Before switch connnection and after switch connection, the end point still
the same :
VirtualNetworkName : WSL
IPAddress          : <IP_ADDRESS>
GatewayAddress     : <IP_ADDRESS>
DNSServerList      : <IP_ADDRESS>
after running hnsdiag.exe list all, I get this
////////////////////////NETWORKS///////////////////////
Network : B95D0C5E-57D4-412B-B571-18A81A16E005
Name             : WSL
Type             : ICS
Subnet Address   : <IP_ADDRESS>/20
Gateway          : <IP_ADDRESS>
///////////////////////ENDPOINTS///////////////////////
Endpoint         : d5430601-9fec-4675-8417-73411e720449
Name             : Ethernet
IP Address       : <IP_ADDRESS>
After switching to LAN, the problem exist
--- google.com ping statistics ---
12 packets transmitted, 0 received, 100% packet loss, time 11462ms

/dupe #8365


size mismatch when loading a saved checkpoint model

I recently find the proposed PMP-Net is an interesting and pioneering work to perform progressive point cloud generation for the cloud completion task. I'd like to conduct the comparison on another dataset, so I've rewritten the dataset, I don't think the code will change much.
However, I encounter a problem when I want to load a saved checkpoint model to perform inference. My training script is based on PMP-Net/core/train_pcn.py and the inference script is based on PMP-Net/core/inference_pcn.py.
To reproduce the error, I tried to save the model immediately before starting the training for loop. Then I ran the script with python main_pcn.py --inference, it could load the checkpoint file but was not able to load the state_dict to the model. The error messages are as follows.
RuntimeError: Error(s) in loading state_dict for DataParallel:
        size mismatch for module.step_1.sa_module_1.mlp_conv.0.conv.weight: copying a param with shape torch.Size([64, 6, 1, 1]) from checkpoint, the shape in current model is torch.Size([64, 9, 1, 1]).
        size mismatch for module.step_1.fp_module_1.mlp_conv.0.conv.weight: copying a param with shape torch.Size([128, 134, 1]) from checkpoint, the shape in current model is torch.Size([128, 137, 1]).

Any suggestions for this? Many thanks in advance!

I found in the PMP-Net/core/train_pcn.py, it loaded from models.model import Model as the model, but in PMP-Net/core/inference_pcn.py it loaded from models.model import ModelNoise as Model as the model. Why do training and testing load different models? Shouldn't they be the same model?

After I change the imported model to from models.model import Model, it works fine.

After I change the imported model to from models.model import Model, it works fine.

Thanks for your generous help for sharing with me the resolution which fixes the problem confusing me for a long time.


Is the project still being maintained?

As stated in the readme, everything is highly experimental in this repository, it's more a proof of concept. It's actually a prototype for a bigger (paid) project I plan to start in the next few months.
One of the major hurdles right now is that I want to integrate it with bevy, but since I could only do this in my spare time, bevy was too much of a moving target to be worth the time doing attempts. Nevertheless, in case you haven't seen, the bevy branch is much more recent (even though it doesn't actually contain bevy at this moment).
If you have any specific problems or requests, feel free to create issues for them!

Thank you for your reply. I am quite interested in this project, but I am not familiar with it at the moment. I will need to study this project thoroughly before I start working on it😂.

Just wanted to state I came across this as I had major disappointment in the flutter perf on linux, and only on linux which seems to be an issue with the embedder since the elinux project didn't seem to share the same issues. I realize being a replacement for that is likely out of scope, but I am quite interested in experimenting with it in the if your next project will also be something open source!


Split LeftMenuBar component out of Main component

Split LeftMenuBar component out of Main component

I don't know who to start

PR ready for review https://github.com/golang-cms/cms-admin/pull/4


Problem with data.py

Trying to run the code in data.py from my OS terminal I get this error message:
File "data.py", line 80
print "Vocabulary size: %d" % len(vocabulary)
^
SyntaxError: invalid syntax
Can you explain to me how to overcome this?

What is the version of your python?

You need to use the Python version 2.7 for this particular script.

You could use the pre-installed python2 to python3 converter within python3.

yes you can use <2to3 data.py>


locals.parser.tests: fixes the unit tests

Trivial fix to make the unit tests run here.

I removed those because I thought they "shouldn't be necessary". And tests pass if you run them yourself but as part of load-all test-all it fails.  I suppose it's bad form to leave a broken build but was hoping to identify what caused the failure.
Maybe we merge this and then investigate separately?

Oh, sorry I totally misunderstood you then. But you're right it is a little strange that those weird << and >> are needed there.

Seems like manifest is being set to f or unset somehow.
This reproduces the test failures:
f manifest [ "locals" test ] with-variable

Closing for now I forgot about this and applied the fix but didn't give you credit, whoops.


Audit logging for RBAC policy changes

Acceptance criteria
Every create, update, or delete change an RBAC administrator makes on policies and roles should be logged with information like.

Event name as identified in the system
Description of the event
Timestamp
Actor or plugin that created, edited, or deleted
Information that identifies the running backstage instance (IP Address, hostname etc.)
Information on where the source of the change originated (country, hostname, IP address, device ID, etc.)

We may also implement audit logging for Scaffolder and Orchestrator. We can combine the efforts to store/forward and view these logs.
Who will have access:
Put an x in the boxes that apply

[X] Authenticated user
[ ] Unauthenticated user/Guest
[X] System Admin only

UI/UX
Figma links if needed
Api documentation/information
OpenAPI link if needed

Feature was implemeted.


Grid component

Do we need Grid component
https://www.lightningdesignsystem.com/utilities/grid/#site-main-content
or its better to use with divs and classNames

I'm open to adding it if you want to make a props proposal and then work on it once approved. The reason it's not in here, is that I am biased toward working on the let's say "more complicated" components like form elements such as input or ones that have ARIA specs such as Tree and TreeGrid in order to make sure we get those right instead of making layout components that designers can "red-line" and ask their product engineers to fix if wrong. That's my take on it.
A little background
A grid component exists at https://github.com/salesforce/design-system-react/blob/master/components/grid/index.jsx that has not been updated from 2016, but I don't even know what it gives us. It's purposely not on the documentation site. I'm open to deprecating the current component and starting from scratch if you'd like to proceed.


NNUE (ƎUИИ Efficiently Updatable Neural Network) for Go

NNUE (ƎUИИ Efficiently Updatable Neural Network) is a sparse shallow neural network architecture that can be calculated incrementally. This has proven incredibly successful in Chess and Shoigi. Historically algorithms that works in Chess does not necessarily translate to Go (e.g. AlphaBeta pruning), but more modern neural network architectures has generalized well (e.g. MuZero).
This issue is to formally document the thoughts I've had on the possibility of designing a NNUE architecture for Go that performs competitively when compared to larger neural networks.

The chess architecture is based on a denormalization of the features based on the kings position (our_king_square, piece_square, piece_type, piece_color), and shogi uses a similar representation. The first challenge is to find a feature representation for Go that fulfills the criterias:

Is hyper sparse, at most 2% non-zeros.
Allows efficient incremental updates, at most O(1) amortized updates.

(our_piece1, our_piece2, piece_color)
This is the "direct" translation of the chess (KP) representation for Go, which asks for storing all piece pairs. The problem is that this representation is neither sparse nor does it allow for fast incremental updates. Adding a piece to the board would require us to update O(n) cells as this affects every other piece on the board.
I am also skeptical about this representation as it is probably not expressive enough for a shallow network to evaluate determine long-range dependencies such as
MuZero Embedding representation
The NNUE architecture reassembles the MuZero architecture with a few additional constraints. Given this we could train the representation instead of trying to figure it out ourselves:

The dynamics network is very shallow.
The prediction network is very shallow.

More...
...

All search algorithms needs to weight the benefits or quality vs quantity of nodes explored. NNUE is a step towards quantity, where as all recent Go algorithms trend towards quality.
The reason for this divide can be observed in the number of candidate moves per game state, chess has about 35 whereas Go has about 150. This means the cost of a misstep during search is a lot higher in Go than in Chess, which might be the explanation as for why quality is more important in Go than in Chess.
This would suggest that NNUE might not work as well in Go as it does for Chess.

All current NNUE architectures are pure value networks which outputs 0 or 1 depending on the current state in a losing state or not. This is not necessarily a problem, generalizing NNUE to output both a policy and value should not be impossible.

Continuing on the topic of the MuZero Embedding representation.  It occurred to us that you can view the dynamics function as an RNN (or as it's more successful implementations GRU or LSTM). The advantage of this would be that RNN's are very well researched, and in general use only feedforward layers, which are fast. So gives us the following procedure:

Use the representation function to squash the input features to an embedding vector.
Evaluate and predict the next move from the embedding vector.
Set the embedding vector as the initial hidden state of the RNN.
Set the input features for the next few moves as the inputs of the RNN.
Use the outputs from the RNN for each timestep to evaluate and predict the next move.

The idea would be to have a potentially large initial representation function to compute the initial hidden state, and then allow the RNN to operate on the much smaller embedding (which would allow is to be very fast). A few open questions in regard to the modelling:

Both GRU and LSTM makes excessive use of sigmoid instead of relu, do we need to change the final activation of the representation function to match this?
What size should the embedding be?
Does it make sense to feed the embedding vector to both the prediction function and as the initial hidden state of the RNN?

Should we feed start the RNN from the initial step, instead of skipping it?
Should we feed it an empty input features instead?

Experimental results
WIP

Experimental results
Experimental results of using a large representation network with a small dynamics network so far show negative results, the model is bottlenecked by the dynamics network and it's accuracy scale with the minimum of the dynamics / representation size. So there is no point in having two networks of different size.
If a dynamics network that is feed the exact game state cannot scale, then I do not think there is any reason to expect a dynamics network that is feed only the motion features would keep up so this is probably a dead end in terms of research.
See https://github.com/Chicoryn/dream-go/pull/58#issuecomment-1040451748 for the full data from the experiment.


Allow multiple bridges to the same IP:Port endpoint

We stupidly identify bridges by their IP/Port combination at the other broker. This means that you have to open an extra listener on the remote broker when you want to set up multiple bridges to the same remote broker. (let's say for concurrency reason).
For instance, you can't configure 2 outgoing bridges like this:
vmq_bridge.ssl.sbr0 = <IP_ADDRESS>:1889
vmq_bridge.ssl.sbr1 = <IP_ADDRESS>:1889

OTOH, the extra listener could be used for adapted TCP buffer configuration.

What is the idea here? The identifier to be sbr0, sbr0 and allow them to use the same ip:port?

Yes, the bridge name is probably the best identifier. I was just wondering why this shouldn't be possible, and I think it should be. (Mosquitto allows configs like this without problem). I don't see this as urgent though, just wanted to document it.


docs: Missing a single quote

name: :memo: Documentation Fix
about: Fixing a problem in an existing docs page
Checklist

[x] Is there an existing issue for this PR?

No

[x] Have the files been linted and formatted?

Yeah

What docs page needs to be fixed?

Section: Redux Fundamentals, Part 3: State, Actions, and Reducers
Page: Designing Actions

What is the problem?
Miss a single quote in the code.
What changes does this PR make to fix the problem?
Add a single quote.

Thanks!


[9.x] Add missing /DateInterval typehint to expireAfter

Saw this warning, but expireAfter calls secondsUntil which takes - @param  \DateTimeInterface|\DateInterval|int  $delay which allows it work from the Interval. So a simple update to docblock.

@iBotPeaches Note that Laravel does not support named params/have a BC promise on them.

@iBotPeaches Note that Laravel does not support named params/have a BC promise on them.

Okay. This was about a wrong docblock though. So don't understand the ping.