Can't get it to work!

Hello,
I've been trying to get PiVPN installed over the last forever and I've come to the conclusion that I have no idea what I'm doing.
I've followed the instructions and forwarded the appropriate port - 1194 on UDP; however, when I try to run it, I simply get timeouts.
I'd love to get this up and running and I've also got pi-hole installed.
Here is my debug:
`:::					:::
::		PiVPN Debug		 ::
:::					:::
::	Latest Commit			 ::
:::					:::
commit 6b406ffb27fad7edaae4fee3e6ccafa523c1ed9f
Author: Kaladin Light<EMAIL_ADDRESS>Date:   Sun Dec 11 10:04:33 2016 -0500
Fix type for moving client script

:::					:::
::	Recursive list of files in	 ::
::	/etc/openvpn/easy-rsa/pki	 ::
:::					:::
/etc/openvpn/easy-rsa/pki/:
ca.crt
Default.txt
dh2048.pem
index.txt
index.txt.attr
index.txt.attr.old
index.txt.old
issued
ovpncertificatehere.ovpn
private
serial
serial.old
ta.key
/etc/openvpn/easy-rsa/pki/issued:
mycerthere.crt
server.crt
/etc/openvpn/easy-rsa/pki/private:
ca.key
mykeynamehere.key
server.key
:::					:::
::	Output of /etc/pivpn/*		 ::
:::					:::
:: START /etc/pivpn/DET_PLATFORM ::
Raspbian
:: END /etc/pivpn/DET_PLATFORM ::
:: START /etc/pivpn/INSTALL_PORT ::
1194
:: END /etc/pivpn/INSTALL_PORT ::
:: START /etc/pivpn/INSTALL_PROTO ::
udp
:: END /etc/pivpn/INSTALL_PROTO ::
:: START /etc/pivpn/INSTALL_USER ::
pi
:: END /etc/pivpn/INSTALL_USER ::
:: START /etc/pivpn/NO_UFW ::
1
:: END /etc/pivpn/NO_UFW ::
:: START /etc/pivpn/REVOKE_STATUS ::
0
:: END /etc/pivpn/REVOKE_STATUS ::
:::					:::
:: /etc/openvpn/easy-rsa/pki/Default.txt ::
:::					:::
client
dev tun
proto udp
remote appropriatednsaddresshere 1194
resolv-retry infinite
nobind
persist-key
persist-tun
key-direction 1
remote-cert-tls server
tls-version-min 1.2
verify-x509-name server name
cipher AES-256-CBC
auth SHA256
comp-lzo
verb 1
:::					:::
::	Output of iptables		 ::
:::					:::
Chain PREROUTING (policy ACCEPT 4364 packets, 345K bytes)
pkts bytes target     prot opt in     out     source               destination
Chain INPUT (policy ACCEPT 4364 packets, 345K bytes)
pkts bytes target     prot opt in     out     source               destination
Chain OUTPUT (policy ACCEPT 31165 packets, 2300K bytes)
pkts bytes target     prot opt in     out     source               destination
Chain POSTROUTING (policy ACCEPT 31165 packets, 2300K bytes)
pkts bytes target     prot opt in     out     source               destination
0     0 MASQUERADE  all  --  *      eth0    <IP_ADDRESS>/24          <IP_ADDRESS>/0
0     0 MASQUERADE  all  --  *      eth0    <IP_ADDRESS>/24          <IP_ADDRESS>/0
:::					:::
::	Debug Output Complete		 ::
:::					:::
`
Now, the only other thing that I can think of is that I'm on a Bell network. Does anyone know if they are blocking that port or have a suggestion?

go outside your network (where your client would be) and run netcat to test if your port is open correctly.  On mac:
nc -uz yourhost 1194
on linux 'netcat' is the command in many cases.

Connected to my mobile hotspot and entered the above mentioned - nc -uz.... and I received a success.... what else can I test?

what does the client log say exactly?

Can you give me direction on where I should be looking at?

I don't know what your client is.  you said when you try to run it you get timeouts.  run what? on what device?  what client is running and does it output more than just 'timeout'.

Yeah, duh! I'm running it on openVPN for iOS and I've also run it on TunnelBrick:
2016-12-16 20:02:48 EVENT: RESOLVE
2016-12-16 20:02:48 Contacting IPinQuestion:1194 via UDP
2016-12-16 20:02:48 EVENT: WAIT
2016-12-16 20:02:48 SetTunnelSocket returned 1
2016-12-16 20:02:48 Connecting to [My.duckdns.org]:1194 (IPinQuestion) via UDPv4
2016-12-16 20:02:49 NET WiFi:ReachableViaWiFi/-R t-----d
2016-12-16 20:02:49 NET Internet:ReachableViaWiFi/-R t------
2016-12-16 20:02:56 NET WiFi:NotReachable/-R tc-----
2016-12-16 20:02:56 NET Internet:NotReachable/-R tc-----
2016-12-16 20:02:56 UDP send error: send: Can't assign requested address
2016-12-16 20:02:56 Transport Error: EADDRNOTAVAIL: Can't assign requested address
2016-12-16 20:02:56 EVENT: TRANSPORT_ERROR EADDRNOTAVAIL: Can't assign requested address [ERR]
2016-12-16 20:02:56 Client terminated, restarting in 5...
2016-12-16 20:02:57 NET WiFi:NotReachable/WR t------
2016-12-16 20:02:57 NET Internet:ReachableViaWWAN/WR t------
2016-12-16 20:02:59 RECONNECT TEST: Internet:ReachableViaWWAN/WR t------ WiFi:NotReachable/WR t------
2016-12-16 20:03:01 EVENT: DISCONNECTED
2016-12-16 20:03:01 Raw stats on disconnect:
BYTES_OUT : 216
PACKETS_OUT : 4
NETWORK_SEND_ERROR : 1
TRANSPORT_ERROR : 1
2016-12-16 20:03:01 Performance stats on disconnect:
CPU usage (microseconds): 16998
Network bytes per CPU second: 12707
Tunnel bytes per CPU second: 0
2016-12-16 20:03:01 ----- OpenVPN Stop -----
2016-12-16 20:03:10 ----- OpenVPN Start -----
OpenVPN core 3.0.11 ios arm64 64-bit built on Apr 15 2016 14:13:50
2016-12-16 20:03:10 Frame=512/2048/512 mssfix-ctrl=1250
2016-12-16 20:03:10 UNUSED OPTIONS
4 [resolv-retry] [infinite]
5 [nobind]
6 [persist-key]
7 [persist-tun]
11 [verify-x509-name] [server] [name]
15 [verb] [1]
2016-12-16 20:03:10 EVENT: RESOLVE
2016-12-16 20:03:11 Contacting IPinQuestion:1194 via UDP
2016-12-16 20:03:11 EVENT: WAIT
2016-12-16 20:03:11 SetTunnelSocket returned 1
2016-12-16 20:03:11 Connecting to [My.duckdns.org]:1194 (IPinQuestion) via UDPv4
2016-12-16 20:03:11 NET Internet:ReachableViaWWAN/WR t------
2016-12-16 20:03:11 NET WiFi:NotReachable/WR t------
2016-12-16 20:03:20 Server poll timeout, trying next remote entry...
2016-12-16 20:03:20 EVENT: RECONNECTING
2016-12-16 20:03:20 EVENT: RESOLVE
2016-12-16 20:03:20 Contacting IPinQuestion:1194 via UDP
2016-12-16 20:03:20 EVENT: WAIT
2016-12-16 20:03:20 SetTunnelSocket returned 1
2016-12-16 20:03:20 Connecting to [My.duckdns.org]:1194 (IPinQuestion) via UDPv4
2016-12-16 20:03:30 Server poll timeout, trying next remote entry...
2016-12-16 20:03:30 EVENT: RECONNECTING
2016-12-16 20:03:30 EVENT: RESOLVE
2016-12-16 20:03:31 Contacting IPinQuestion:1194 via UDP
2016-12-16 20:03:31 EVENT: WAIT
2016-12-16 20:03:31 SetTunnelSocket returned 1
2016-12-16 20:03:31 Connecting to [My.duckdns.org]:1194 (IPinQuestion) via UDPv4
2016-12-16 20:03:40 Server poll timeout, trying next remote entry...
2016-12-16 20:03:40 EVENT: RECONNECTING
2016-12-16 20:03:40 EVENT: RESOLVE
2016-12-16 20:03:40 Contacting IPinQuestion:1194 via UDP
2016-12-16 20:03:40 EVENT: WAIT
2016-12-16 20:03:40 SetTunnelSocket returned 1
2016-12-16 20:03:40 Connecting to [My.duckdns.org]:1194 (IPinQuestion) via UDPv4
2016-12-16 20:03:50 Server poll timeout, trying next remote entry...
2016-12-16 20:03:50 EVENT: RECONNECTING
2016-12-16 20:03:50 EVENT: RESOLVE
2016-12-16 20:03:50 Contacting IPinQuestion:1194 via UDP
2016-12-16 20:03:50 EVENT: WAIT
2016-12-16 20:03:50 SetTunnelSocket returned 1
2016-12-16 20:03:50 Connecting to [My.duckdns.org]:1194 (IPinQuestion) via UDPv4
2016-12-16 20:04:00 Server poll timeout, trying next remote entry...
2016-12-16 20:04:00 EVENT: RECONNECTING
2016-12-16 20:04:00 EVENT: RESOLVE
2016-12-16 20:04:00 Contacting IPinQuestion:1194 via UDP
2016-12-16 20:04:00 EVENT: WAIT
2016-12-16 20:04:00 SetTunnelSocket returned 1
2016-12-16 20:04:00 Connecting to [My.duckdns.org]:1194 (IPinQuestion;) via UDPv4
2016-12-16 20:04:10 EVENT: CONNECTION_TIMEOUT [ERR]
2016-12-16 20:04:10 EVENT: DISCONNECTED
2016-12-16 20:04:10 Raw stats on disconnect:
BYTES_OUT : 1620
PACKETS_OUT : 30
CONNECTION_TIMEOUT : 1
N_RECONNECT : 5
2016-12-16 20:04:10 Performance stats on disconnect:
CPU usage (microseconds): 32951
Network bytes per CPU second: 49163
Tunnel bytes per CPU second: 0
2016-12-16 20:04:10 EVENT: DISCONNECT_PENDING
2016-12-16 20:04:10 ----- OpenVPN Stop -----
2016-12-16 21:49:12 ----- OpenVPN Start -----
OpenVPN core 3.0.11 ios arm64 64-bit built on Apr 15 2016 14:13:50
2016-12-16 21:49:12 Frame=512/2048/512 mssfix-ctrl=1250
2016-12-16 21:49:12 UNUSED OPTIONS
4 [resolv-retry] [infinite]
5 [nobind]
6 [persist-key]
7 [persist-tun]
11 [verify-x509-name] [server] [name]
15 [verb] [1]
2016-12-16 21:49:12 EVENT: RESOLVE
2016-12-16 21:49:12 Contacting IPinQuestion:1194 via UDP
2016-12-16 21:49:12 EVENT: WAIT
2016-12-16 21:49:12 SetTunnelSocket returned 1
2016-12-16 21:49:12 Connecting to [My.duckdns.org]:1194 (IPinQuestion) via UDPv4
2016-12-16 21:49:13 NET Internet:ReachableViaWWAN/WR t------
2016-12-16 21:49:13 NET WiFi:NotReachable/WR t------
2016-12-16 21:49:22 Server poll timeout, trying next remote entry...
2016-12-16 21:49:22 EVENT: RECONNECTING
2016-12-16 21:49:22 EVENT: RESOLVE
2016-12-16 21:49:22 Contacting IPinQuestion:1194 via UDP
2016-12-16 21:49:22 EVENT: WAIT
2016-12-16 21:49:22 SetTunnelSocket returned 1
2016-12-16 21:49:22 Connecting to [My.duckdns.org]:1194 (IPinQuestion) via UDPv4
2016-12-16 21:49:32 Server poll timeout, trying next remote entry...
2016-12-16 21:49:32 EVENT: RECONNECTING
2016-12-16 21:49:32 EVENT: RESOLVE
2016-12-16 21:49:32 Contacting IPinQuestion:1194 via UDP
2016-12-16 21:49:32 EVENT: WAIT
2016-12-16 21:49:32 SetTunnelSocket returned 1
2016-12-16 21:49:32 Connecting to [My.duckdns.org]:1194 (IPinQuestion) via UDPv4
I'm hoping that this gives you something...

Weird.  reboot your iphone, turn off wifi and try connecting just over your cellular.

Got the same results. Sadly...
On Fri, Dec 16, 2016 at 11:27 PM 0-kaladin<EMAIL_ADDRESS>wrote:

Weird. reboot your iphone, turn off wifi and try connecting just over your
cellular.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/pivpn/pivpn/issues/170#issuecomment-267739989, or mute
the thread
https://github.com/notifications/unsubscribe-auth/ARZrZPLlBB3vbhAb0cjv51tx0iLnqcdsks5rI1aNgaJpZM4LPgfo
.

On macOs, nc has the following comment:

 UDP port scans will always succeed (i.e. report the port as open), ren-
 dering the -uz combination of flags relatively useless.

So it may not be the case that UDP port 1194 is being correctly forwarded.
What sort of router do you have.

Interesting!
I have an actiontech router from Bell. As for the UDP, yes, I'm 100% sure
that I have it forwarded.
On Sat, Dec 17, 2016 at 3:24 AM fyellin<EMAIL_ADDRESS>wrote:

On macOs, nc has the following comment:
UDP port scans will always succeed (i.e. report the port as open), ren-
dering the -uz combination of flags relatively useless.
So it may not be the case that UDP port 1194 is being correctly forwarded.
What sort of router do you have.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/pivpn/pivpn/issues/170#issuecomment-267748227, or mute
the thread
https://github.com/notifications/unsubscribe-auth/ARZrZEc-kKNLIMLskTap4MEoUx5p9ttbks5rI44XgaJpZM4LPgfo
.

I just uninstalled it and reinstalled it and I'm still getting the same thing. Can't connect from my phone to my network.
What else can I dig through to help me figure this out and make this work?

I'm not sure it's connecting through your router. So I don't think reinstalling pivpn would help. Have to find a way to ensure it is forwarded correctly.

Ok, thanks!
So, how do I go about testing that? I've tried the usual "can you see me" websites and half of my ports are showing open and half are showing closed. According to Bell, those sites are completely unreliable and I should rely on what's they give me.
I don't know enough code to be able to test it any other way, but I'd love to get this to work.

Maybe a long shot, but you could try to make the VPN connection 'inside' you LAN. This will prove whether or not your PIVPN and VNP Client is in an operational configuration with each other and by that gain confidence that your problem is 100% routing related...!?

Thanks for posting, because it reminded me that I had left this open! I have it working just fine! it was a corruption on the install on my SD Card. I wiped it and started from scratch without any issues!


[Bug]: Port from APPSMITH_MONGODB_URI is incorrectly parsed

Is there an existing issue for this?

[X] I have searched the existing issues

Description
When I start Appsmith with a Amazon DocumentDB cluster uri like so
APPSMITH_MOGODB_URI=mongodb://<username>:<password>@databaseb269d8bb-xxxxxxxxx.cluster-xxxxxxx.eu-west-1.docdb.amazonaws.com:27017?tls=true&tlsCAFile=/usr/local/share/ca-certificates/rds-combined-ca-bundle.pem&replicaSet=rs0&readPreference=primary&retryWrites=false

Parsing the URI fails to extract the port. From the Input and the error message below I suspect that the URI is split at the first "/" instead of correctly parsing the whole URI (using the Java URL class) and then extracting the port using getPort().

backend stdout | [2023-05-16 10:52:53,302]  - Exception encountered during context initialization - cancelling refresh attempt: org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'customThemeRepositoryCEImpl' defined in URL [jar:file:/opt/appsmith/backend/server.jar!/BOOT-INF/classes!/com/appsmith/server/repositories/ce/CustomThemeRepositoryCEImpl.class]: Unsatisfied dependency expressed through constructor parameter 0: Error creating bean with name 'reactiveMongoTemplate' defined in class path resource [com/appsmith/server/configurations/MongoConfig.class]: Unsatisfied dependency expressed through method 'reactiveMongoTemplate' parameter 0: Error creating bean with name 'reactiveMongoDatabaseFactory' defined in class path resource [org/springframework/boot/autoconfigure/data/mongo/MongoReactiveDataAutoConfiguration.class]: Unsatisfied dependency expressed through method 'reactiveMongoDatabaseFactory' parameter 1: Error creating bean with name 'reactiveStreamsMongoClient' defined in class path resource [org/springframework/boot/autoconfigure/mongo/MongoReactiveAutoConfiguration.class]: Failed to instantiate [com.mongodb.reactivestreams.client.MongoClient]: Factory method 'reactiveStreamsMongoClient' threw exception with message: The connection string contains an invalid host 'databaseb269d8bb-0qq4zfnvoyrt.cluster-ckukpnzuka1f.eu-west-1.docdb.amazonaws.com:27017?tls=true&tlsCAFile='. The port '27017?tls=true&tlsCAFile=' is not a valid, it must be an integer between 0 and 65535

Steps To Reproduce
Start an Appsmith instance with an external mongodb instance without a trailing slash
Public Sample App
No response
Environment
Production
Issue video log
No response
Version
Self Hosted - 1.9.19

Hey @matthias-pichler-warrify , thank you for reporting this. While I agree with you in principle, the reason / is assumed to be present in the URI, is that the MongoDB URI needs to have a database name, which shows up as a /dbname just after the port number. Not including this /, but adding query params with a ? is actually an error. Refer the URI format at https://www.mongodb.com/docs/manual/reference/connection-string/#standard-connection-string-format, see that / needs to be included, if you want query params, even if you don't have a DB name.


[WIP] Project code style

Pull Request
What does this PR do?
Fixes #216
Revert to .NET Standard 2.0
Set C# language to 7.3
Remove StyleCop

Moving using outside namespace :
FROM:
https://github.com/meilisearch/meilisearch-dotnet/blob/5b758584b6ef62b15c06817670dadf340c0a7f34/src/Meilisearch/Stats.cs#L1-L26
TO:
https://github.com/meilisearch/meilisearch-dotnet/blob/45d90d50d517b79f71b5ee68769cceeede6e2292/src/Meilisearch/Stats.cs#L1-L26
Let me know if you are ok with this style and I will update all the files.

You can have a look at MeilisearchClient.cs
The using are at the top and ordered with System first
And we have var all the way
Let me know what you think for this two styles before I continue with other options.

Ok, well actually it will probably easier if you look at the project with all changes.
It will take too much time to discuss every rules.
This is more or less how an OSS project looks like nowadays. Let me know if you have any questions.

@juchom sorry, I clicked on the ready for review button, sorry about this!

@juchom do you want to change something else?

You can merge it. The main idea is to have a code that looks like what we can find.
If you miss something or want to change something we can change it later, it won't be that big.

bors merge


can't find the "deploy.py" in lmdeploy/serve/turbomind/

Checklist

[ ] 1. I have searched related issues but cannot get the expected help.
[ ] 2. The bug has not been fixed in the latest version.

Describe the bug
I can't find the "deploy.py" in lmdeploy/serve/turbomind/ after I build Lmdeploy from source.
Reproduction
GPU Memory Test
The first step of  Testing method.
Environment
sys.platform: linux
Python: 3.9.18 (main, Sep 11 2023, 13:41:44) [GCC 11.2.0]
CUDA available: True
numpy_random_seed:<PHONE_NUMBER>
GPU 0,1,2,3,4,5,6,7: NVIDIA A100-SXM4-40GB
CUDA_HOME: /tools/cluster-software/cuda-cudnn/cuda-11.7.1-8.5.0
NVCC: Cuda compilation tools, release 11.7, V11.7.99
GCC: gcc (GCC) 11.4.0
PyTorch: 1.13.0+cu117
PyTorch compiling details: PyTorch built with:
  - GCC 9.3
  - C++ Version: 201402
  - Intel(R) Math Kernel Library Version 2020.0.0 Product Build 20191122 for Intel(R) 64 architecture applications
  - Intel(R) MKL-DNN v2.6.0 (Git Hash 52b5f107dd9cf10910aaa19cb47f3abf9b349815)
  - OpenMP 201511 (a.k.a. OpenMP 4.5)
  - LAPACK is enabled (usually provided by MKL)
  - NNPACK is enabled
  - CPU capability usage: AVX2
  - CUDA Runtime 11.7
  - NVCC architecture flags: -gencode;arch=compute_37,code=sm_37;-gencode;arch=compute_50,code=sm_50;-gencode;arch=compute_60,code=sm_60;-gencode;arch=compute_70,code=sm_70;-gencode;arch=compute_75,code=sm_75;-gencode;arch=compute_80,code=sm_80;-gencode;arch=compute_86,code=sm_86
  - CuDNN 8.5
  - Magma 2.6.1
  - Build settings: BLAS_INFO=mkl, BUILD_TYPE=Release, CUDA_VERSION=11.7, CUDNN_VERSION=8.5.0, CXX_COMPILER=/opt/rh/devtoolset-9/root/usr/bin/c++, CXX_FLAGS= -fabi-version=11 -Wno-deprecated -fvisibility-inlines-hidden -DUSE_PTHREADPOOL -fopenmp -DNDEBUG -DUSE_KINETO -DUSE_FBGEMM -DUSE_QNNPACK -DUSE_PYTORCH_QNNPACK -DUSE_XNNPACK -DSYMBOLICATE_MOBILE_DEBUG_HANDLE -DEDGE_PROFILER_USE_KINETO -O2 -fPIC -Wno-narrowing -Wall -Wextra -Werror=return-type -Werror=non-virtual-dtor -Wno-missing-field-initializers -Wno-type-limits -Wno-array-bounds -Wno-unknown-pragmas -Wunused-local-typedefs -Wno-unused-parameter -Wno-unused-function -Wno-unused-result -Wno-strict-overflow -Wno-strict-aliasing -Wno-error=deprecated-declarations -Wno-stringop-overflow -Wno-psabi -Wno-error=pedantic -Wno-error=redundant-decls -Wno-error=old-style-cast -fdiagnostics-color=always -faligned-new -Wno-unused-but-set-variable -Wno-maybe-uninitialized -fno-math-errno -fno-trapping-math -Werror=format -Werror=cast-function-type -Wno-stringop-overflow, LAPACK_INFO=mkl, PERF_WITH_AVX=1, PERF_WITH_AVX2=1, PERF_WITH_AVX512=1, TORCH_VERSION=1.13.0, USE_CUDA=ON, USE_CUDNN=ON, USE_EXCEPTION_PTR=1, USE_GFLAGS=OFF, USE_GLOG=OFF, USE_MKL=ON, USE_MKLDNN=ON, USE_MPI=OFF, USE_NCCL=ON, USE_NNPACK=ON, USE_OPENMP=ON, USE_ROCM=OFF,

TorchVision: 0.14.0+cu117
LMDeploy: 0.0.14+b7c88ca
transformers: 4.35.0
gradio: 3.50.2
fastapi: 0.104.1
pydantic: 2.4.2

Error traceback
No response

Converting models command has been changed since lmdeploy 0.0.13
Please try lmdeploy convert to convert a model

Converting models command has been changed since lmdeploy 0.0.13 Please try lmdeploy convert to convert a model

Thanks, I'll try it.

Converting models command has been changed since lmdeploy 0.0.13 Please try lmdeploy convert to convert a model
How can I "modify the maximum concurrency in the workspace configuration"? By setting the group_size with "lmdeploy convert"?

You can refer to the guide: https://github.com/InternLM/lmdeploy/blob/main/docs/en/turbomind_config.md
Pay attention to chapter "TurboMind 1.0 config"

You can refer to the guide: https://github.com/InternLM/lmdeploy/blob/main/docs/en/turbomind_config.md Pay attention to chapter "TurboMind 1.0 config"

Okay, let me take a look.

You can refer to the guide: https://github.com/InternLM/lmdeploy/blob/main/docs/en/turbomind_config.md Pay attention to chapter "TurboMind 1.0 config"

When I run bin/llama_triton_example, it shows that "[WARNING] Cannot open the file '../examples/cpp/llama/start_ids.csv'." In fact, there is no such file.

Try python3 examples/cpp/llama/tokenizer.py <the/path/of/tokenizer/model> <the/path/of/a/plain/text/file>. You'll get start_ids.csv
F.Y.I, bin/llama_triton_example is just for internal usage.

Try python3 examples/cpp/llama/tokenizer.py <the/path/of/tokenizer/model> <the/path/of/a/plain/text/file>. You'll get start_ids.csv F.Y.I, bin/llama_triton_example is just for internal usage.
The output of running bin/llama_triton_example is below:

node_id=0 node_num=1
[TM][WARNING] [LlamaTritonModel] `cache_block_seq_len` is not set, default to 128.
[TM][INFO] Barrier(1)
world_size=1 tensor_para_size=1 pipeline_para_size=1
Model:
head_num: 32
kv_head_num: 32
size_per_head: 128
inter_size: 11008
num_layer: 32
vocab_size: 103168
attn_bias: 1
max_batch_size: 32
max_context_token_num: 8224
session_len: 2056
step_length: 1
cache_max_entry_count: 48
cache_block_seq_len: 128
cache_chunk_size: 1
use_context_fmha: 1
start_id: 1
tensor_para_size: 1
pipeline_para_size: 1
enable_custom_all_reduce: 0
model_name: internlm-chat-7b
model_dir: ./workspace/triton_models/weights
quant_policy: 0
group_size: 8
[TM][INFO] Barrier(1)
[INFO] rank = 0
[WARNING] gemm_config.in is not found; using default GEMM algo
[TM][INFO] NCCL group_id = 0
[TM][INFO] [BlockManager] block_size = 64 MB
[TM][INFO] [BlockManager] max_block_count = 48
[TM][INFO] [BlockManager] chunk_size = 1
[TM][ERROR] LlamaBatch<T>::Start()
model instance 0 is created
[TM][INFO] [InternalThreadEntry] 0
after allocation    : free: 24.62 GB, total: 39.45 GB, used: 14.83 GB
request_batch_size=8
[WARNING] Cannot open the file '../examples/cpp/llama/start_ids.csv'.
max_input_len=1
[r8a100-b02:986417] *** Process received signal ***
[r8a100-b02:986417] Signal: Floating point exception (8)
[r8a100-b02:986417] Signal code: Integer divide-by-zero (1)
[r8a100-b02:986417] Failing at address: 0x41dd44
[r8a100-b02:986417] [ 0] /lib64/libpthread.so.0(+0x12cf0)[0x7f61fad10cf0]
[r8a100-b02:986417] [ 1] ./bin/llama_triton_example[0x41dd44]
[r8a100-b02:986417] [ 2] ./bin/llama_triton_example[0x421a7d]
[r8a100-b02:986417] [ 3] ./bin/llama_triton_example[0x4124dd]
[r8a100-b02:986417] [ 4] /lib64/libc.so.6(__libc_start_main+0xe5)[0x7f61e8055d85]
[r8a100-b02:986417] [ 5] ./bin/llama_triton_example[0x41a15e]
[r8a100-b02:986417] *** End of error message ***
Floating point exception (core dumped)

Where is the GPU memory? Does it have to be set to start_ids.csv before it can be obtained？

Afterwards, I generated start_ids.csv using a blank txt file，and then start_ids.csv  is "1". Then I get the new output of running . bin/llama_triton_example:
WARNING: There was an error initializing an OpenFabrics device.

  Local host:   -----------
  Local device: ---------
--------------------------------------------------------------------------
node_id=0 node_num=1
[TM][WARNING] [LlamaTritonModel] `cache_block_seq_len` is not set, default to 128.
[TM][INFO] Barrier(1)
world_size=1 tensor_para_size=1 pipeline_para_size=1
Model:
head_num: 32
kv_head_num: 32
size_per_head: 128
inter_size: 11008
num_layer: 32
vocab_size: 103168
attn_bias: 1
max_batch_size: 16
max_context_token_num: 8224
session_len: 2056
step_length: 1
cache_max_entry_count: 48
cache_block_seq_len: 128
cache_chunk_size: 1
use_context_fmha: 1
start_id: 1
tensor_para_size: 1
pipeline_para_size: 1
enable_custom_all_reduce: 0
model_name: internlm-chat-7b
model_dir: ./workspace/triton_models/weights
quant_policy: 0
group_size: 0
[TM][INFO] Barrier(1)
[INFO] rank = 0
[WARNING] gemm_config.in is not found; using default GEMM algo
[TM][INFO] NCCL group_id = 0
[TM][INFO] [BlockManager] block_size = 64 MB
[TM][INFO] [BlockManager] max_block_count = 48
[TM][INFO] [BlockManager] chunk_size = 1
[TM][ERROR] LlamaBatch<T>::Start()
model instance 0 is created
[TM][INFO] [InternalThreadEntry] 0
after allocation    : free: 24.62 GB, total: 39.45 GB, used: 14.83 GB
request_batch_size=8
max_input_len=1
request_batch_size=8 max_input_len=1
[INFO] request is created
[TM][INFO] [forward] Enqueue requests
[TM][INFO] [forward] Wait for requests to complete ...
[TM][WARNING] [ProcessInferRequests] Request for 0 received.
[TM][WARNING] [ProcessInferRequests] Request for 1 received.
[TM][WARNING] [ProcessInferRequests] Request for 2 received.
[TM][WARNING] [ProcessInferRequests] Request for 3 received.
[TM][WARNING] [ProcessInferRequests] Request for 4 received.
[TM][WARNING] [ProcessInferRequests] Request for 5 received.
[TM][WARNING] [ProcessInferRequests] Request for 6 received.
[TM][WARNING] [ProcessInferRequests] Request for 7 received.
[TM][INFO] [initGen] batch_size = 8
[TM][INFO] [initGen] max_context_len = 1
[TM][INFO] [initGen] slot  sequence_id  context_len  seq_limit_len  finished
[TM][INFO] [initGen]    0            0            1           2049         0
[TM][INFO] [initGen]    1            1            1           2049         0
[TM][INFO] [initGen]    2            2            1           2049         0
[TM][INFO] [initGen]    3            3            1           2049         0
[TM][INFO] [initGen]    4            4            1           2049         0
[TM][INFO] [initGen]    5            5            1           2049         0
[TM][INFO] [initGen]    6            6            1           2049         0
[TM][INFO] [initGen]    7            7            1           2049         0
[TM][INFO] ------------------------- step = 0 -------------------------
[TM][INFO] [CompleteRequest] slot = 0, id = 0
[TM][INFO] [CompleteRequest] slot = 1, id = 1
[TM][INFO] [CompleteRequest] slot = 2, id = 2
[TM][INFO] [CompleteRequest] slot = 3, id = 3
[TM][INFO] [CompleteRequest] slot = 4, id = 4
[TM][INFO] [CompleteRequest] slot = 5, id = 5
[TM][INFO] [CompleteRequest] slot = 6, id = 6
[TM][INFO] [CompleteRequest] slot = 7, id = 7
[TM][INFO] [forward] Request complete for 0, ec = 0
[TM][INFO] [forward] Request complete for 1, ec = 0
[TM][INFO] [forward] Request complete for 2, ec = 0
[TM][INFO] [forward] Request complete for 3, ec = 0
[TM][INFO] [forward] Request complete for 4, ec = 0
[TM][INFO] [forward] Request complete for 5, ec = 0
[TM][INFO] [forward] Request complete for 6, ec = 0
[TM][INFO] [forward] Request complete for 7, ec = 0
[INFO] forward is completed.
sequence length: 6, 6, 6, 6, 6, 6, 6, 6
[TM][ERROR] ~LlamaBatch()
[TM][INFO] [InternalThreadEntry] stop requested.
[TM][INFO] [OutputThreadEntry] stop requested.

So how can I solve the error of WARNING: There was an error initializing an OpenFabrics device, [TM][ERROR] LlamaBatch<T>::Start() and [TM][ERROR] ~LlamaBatch()? And where is the GPU memory?
Wish for you reply.

[TM][ERROR] LlamaBatch<T>::Start() is not an error. It is just a log with high log level to show the function is called. In the latest main, we degraded it to INFO

I have no idea about "OpenFabrics device", @lzhangzz any clue?

I have no idea about "OpenFabrics device", @lzhangzz any clue?
WARNING: There was an error initializing an OpenFabrics device is solved after export OMPI_MCA_btl=^openib. The remaining questions are in another issue .

I have no idea about "OpenFabrics device", @lzhangzz any clue?
WARNING: There was an error initializing an OpenFabrics device is solved after export OMPI_MCA_btl=^openib. The remaining questions are in another issue .

https://github.com/InternLM/lmdeploy/issues/731


Typo in change log for v0.4.0

In entry for the -o and -O command line options released in v0.4.0, CHANGELOG.md has some spurious asterisks that need to be removed.

Fixed in develop branch at commit 0a86622


[UT] Remove isVeloxBackendLoaded usage from file metadata UT

What changes were proposed in this pull request?
As we claim the isxxBackendLoaded usage should be better avoid, and will be remove when time ripe.
I didn't notice that when adding this part ut before.
(Fixes: #ISSUE-ID)
How was this patch tested?
(Please explain how this patch was tested. E.g. unit tests, integration tests, manual tests)
(If this patch involves UI changes, please attach a screenshot; otherwise, remove this)

@PHILO-HE / @rui-mo  help review

@PHILO-HE  the CH fail could you help re-trigger only CH run ?

@PHILO-HE the CH fail could you help re-trigger only CH run ?

@gaoyangxiaozhu, just triggered. We can leave a comment "Run Gluten Clickhouse CI" to trigger CH CI.

@PHILO-HE could you help merge ?


python softwares do not run on my windows 10 laptop

Issue Report Checklist

[* ] Searched the issues page for similar reports
[* ] Read the relevant sections of the Spyder Troubleshooting Guide and followed its advice
[ *] Reproduced the issue after updating with conda update spyder (or pip, if not using Anaconda)
[* ] Could not reproduce inside jupyter qtconsole (if console-related)
[* ] Tried basic troubleshooting (if a bug/error)

[* ] Restarted Spyder
[* ] Reset preferences with spyder --reset
[ *] Reinstalled the latest version of Anaconda
[* ] Tried the other applicable steps from the Troubleshooting Guide

[x] Completed the Problem Description, Steps to Reproduce and Version sections below

Problem Description
I installed python idle on my laptop and the IDLE does start but does not respond and shows the error message "IDLE's sub process did not make a connection. Either IDLE cant start a sub process or personal firewall software is blocking the connection." The command prompt version of python IDLE s working fine. I also install the anaconda package but the whole package does not work. The Spyder IDLE simply does not respond and shows the message "Spyder has encountered an internal problem." The jupyter notebook also does not work. The cmd window just flashes for around 3-4 seconds and then disappears. The Anaconda Navgator also does not work.
I also tried to install the Winpython package but the same problems persists as the Anaconda package.
I also install the pycharm software. But it also does not respond.  It also shows errors.
I tried to reinstall all the above mentioned softwares several times but the same problems continue to persists.
Please someone help me to figure out the problems due to which  I am facing the errors.
Thank You.....
What steps reproduce the problem?

Tried to renistall the softwares but the problems persists.
Tried several troubleshooting problems but the problems still persists

What is the expected output? What do you see instead?

Opening of the Spyder environment
Opening of the python IDLE environment
Opening of pycharm environment

Paste Traceback/Error Below (if applicable)

PASTE TRACEBACK HERE

Versions

Spyder version: 3.7
Python version: 3.7
Qt version:
PyQt version:
Operating System name/version: Windows 10

Dependencies

PASTE DEPENDENCIES HERE

My system information
OS - Windows 10 64 bit
Intel i3 2nd gen.
4 gb RAM
Nvidia geforce with CUDA

Please fill out ths form by writing the information we ask you to fill (the form is almost self-explanatory) and send it to us by providing your Github credentials. That form contains much more detailed information that will help us to understand your problem.
I'm closing this issue for now because without that information we can't help you, sorry.

Can u please help me. Which form do I need to fill?

The one in the screenshot above.

I mean, the one it says
Spyder has encountered an internal problem.
Please read what it says with care and you'll understand what I'm talking about.

I wanted to fill the form. But the whole page does not respond. I can't type nor can I click anywhere. The whole page just hangs until I have to close it. Please help me.

Well, your screenshot shows some strange symbols back in the IPython console. That could mean that you installed Anaconda in a path with special characters (like ñ or á), which could be causing your problem, so should try to rename that directory or create a new Windows user without special characters and install Anaconda there.
You also seem to have a different Python installation other than Anaconda, so you should try to uninstall it.
But all these are just pure speculations based on the extremely little info you provided. However, other than this advice, I'm afraid there's nothing else we can do for you, sorry.

this part in your screenshot is very strange:

you may start "WinPython Command Prompt.exe"
type CHCP
and post the screen shot

maybe will it give more clue

Sir as instructed by you, I have typed the command  chcp in the "WinPython Command Prompt.exe" and got  the result "Active Code Pages= 437".

Sir, can u please with the above

hum, code page 437 means original US DOS codepage. Did you tweak the langage of your Windows PC ?  Uttar Pradesh, India  ?

@stonebig sir , what does tweak mean????
I don't know how to tweak the language.

ok.

@ccordoba12 sir can you please help me with my problem?

@stonebig can you please guide me further

We really don't understand your problem. My last advice is for you to reinstall Windows because there's something seriously wrong with your current installation.
Sorry, but I don't see any other solution.

well, as a stupid try, as I'm clueless, I would suggest you experiment IDLE on a Python-2.7 32bit, just to see if you arrive to make IDLE work at last. for example https://sourceforge.net/projects/winpython/files/WinPython_2.7/<IP_ADDRESS>/


WelcomeView: Could not resolve "svelte/internal"

Hi,
go generate ./app .

fails with error:
Error: wx: failed to compile DOM WelcomeView: Could not resolve "svelte/internal"
Usage:
  wx build [flags]

Flags:
  -d, --dir string   app directory (default ".")
  -h, --help         help for build

wx: failed to compile DOM WelcomeView: Could not resolve "svelte/internal"
app/gen.go:3: running "wx": exit status 1

found problem, npm i is requied


Get user detail endpoint to use username as slug in addition to primary key (/api/users/<userID> OR /api/users/<username>)

Goal: In this issue, we want to allow users to access the Detail view of a User object using the user's username as a slug instead of always having to use the user's id. This way, it is easier for someone to use the API to get details of a specific user, as one does not need to know it's primary key in the model.
We will support: /api/users/<user_id> AND /api/users/<username> to GET/PATCH/DELETE the Detail view of the User with the given id or username

Note: Also enforce that the username is non-numeric in the database. This way, we know when the slug is a user_id or a username (e.g. a username cannot be "1234")


Add option to create new issue from /issues page

Closes #20510.
When filtering one project, a button will be visible to create an issue for this.

Should I do this for pull requests too?

Should I do this for pull requests too?

Fine by me.

I would propose a New Issue button with a dropdown to select the repository to add the new issue to.

Seems like the issue is talking about a single New Issue button on the /issues page with a dropdown, but that is just unnecessary complexity IMO.

I don't know what's the purpose of a dropdown menu if you have the menu on the left. But I can also add it if you want

I don't know what's the purpose of a dropdown menu if you have the menu on the left.

Yup exactly my thought.

But I can also add it if you want

Please not, the current behavior in this PR is better.

IMO, it desires a margin between the sort and new issue

I'm working on it :)


Transparent .webm video does not play on chromium and opera

Expected Behavior
Expected video to play when loaded.
Current Behavior
Transparent .webm video does not play in pixi when using chromium and opera.
Firefox works fine.
Video starts playing in chromium and opera if you manually type video.texture.baseTexture.source.play() into the console.
Video plays fine in opera and chromium when viewed directly.
This error comes up in the console: Uncaught (in promise) DOMException on this line in code: https://github.com/pixijs/pixi.js/blob/24459ad0166e712347a29ba67785277749ef66bf/packages/core/src/textures/resources/VideoResource.js#L260
Maybe pixi thinks the video has loaded before it actually has loaded?
The .webm video is encoded with vp9 codec using ffmpeg.
Environment

pixi.js version: v 5.0.2

Browser & Version:
Chromium: Version 74.0.3729.157
Opera: Version:60.0.3255.83

OS & Version:  Arch linux: 5.1.2-arch1-1-ARCH

Running Example:
https://thor-merlin.no/media/pixi-bug.html
https://thor-merlin.no/media/video.webm

I'm wondering if what you're seeing is the video not autoplaying due to not having had a user interaction. Videos work the same way as sound now :/
An example of starting with an interaction: https://pixijs.io/examples/#/sprite/video.js

Hm... I don't get what it could be.
When I edit the pixijs example with the live-editor to this:
var app = new PIXI.Application();
document.body.appendChild(app.view);

var videoSprite = PIXI.Sprite.from('examples/assets/video.mp4');

videoSprite.width = app.screen.width;
videoSprite.height = app.screen.height;

app.stage.addChild(videoSprite);

Then it works in chromium without any user interaction.
But I tried doing the equivalent on my own page, and it doesn't work. Not even with the same video from the example:
https://thor-merlin.no/media/pixi-bug-2.html

I tried opening that page in firefox now and got the warning Autoplay is only allowed when approved by the user, the site is activated by the user, or media is muted. so it is probably correct that it needs some kind of interaction. I'll try adding an interaction button as the example you sent and see if that works.

Yep, that works!
It is kind of annoying that we need interaction in order to autoplay video, but I can also see why browsers would implement it like this to protect the users.
The pixi example edit I did probably only worked because pixi interpreted the reload button as an interaction to play the video.


 I don't think I hit the text limit of telegram yet.
Could be connection issue between telegram and openai, or my server couldn't handle the load? Any idea?

Great work by the way, so far the most complete integration I can find!

Looks like the problem is solved by increased my server ram from 512 MB to 1 GB. Yay!

That's weird if the server's RAM makes the bot send an incomplete answer :thinking:
Were you using the recently added progressive completion ?

That's weird if the server's RAM makes the bot send an incomplete answer 🤔
Were you using the recently added progressive completion ?

Not sure what is progressive completion, but I'm using the latest release - Real-time Message Streaming.

I meant real-time message streaming yeah. I'll look into what might have caused this issue, and a possible fix.


feat(omnibor): First pass at InputManifest

This commit is a first-pass implementation of InputManifests, without
any logic for actually constructing them. My intent is that they'll be
made by a builder type, and be immutable once constructed. To that end,
all fields are private and gettable only by accessors (which should
generally be inlined to callers to avoid a perf hit).
This commit also implements Display to get the OmniBOR-spec-compliant
printed version of a manifest. This included some light
Clippy-wrangling to ensure we only do \n newlines.
The next step will probably be to implement the builders.
Signed-off-by: Andrew Lilley Brinker<EMAIL_ADDRESS>

Further thinking: the individual rows shouldn’t expose a Display impl, because it’s only useful in the context of a manifest.

I’m thinking builders should basically have an ambient storage they’re backed by, pluggably persisted in the file system or a database. When constructing a manifest for a new artifact, it can check the storage for any manifests for referred artifacts, adding in that manifest’s ID if found.
The simplest form of building would basically be to take already-constructed ID’s, rather than things that can be ID’ed. Probably start there and then add the ability for the builder to handle ID’ing things itself.
Probably want that storage API contract expressed as a trait, implemented by some common (and feature-controlled) options. Unlike other traits in this crate and in the GitOID crate, this one won’t be sealed.
We could even go the way of providing storage impls in separate crates to make them more clearly opt-in and avoid “first-class” vs. “second-class” options, though that raises questions around FFI usage from other languages.

Added initial parsing for manifests on disk. Note that this still preserves the idea that manifests are immutable once loaded in memory.
Still a draft, the new parser code isn't great and also needs to be tested. It's a very rough first pass so I could think through what's needed for parsing.

This PR is ready for final review! It features:

InputManifest struct
InputManifestBuilder struct
Storage trait

InMemoryStorage struct
FileSystemStorage struct

It can handle construction and querying of manifest data for non-embedding mode, but doesn't implementing embedding mode yet.


Update yarn.lock deps, remove extraneous deps, remove redundant .igno…

Could you check if I did yarn.lock correctly? I just ran yarn upgrade and yarn removed a few packages.

I like your style! 😂


Add self updater

https://github.com/jaemk/self_update
OPT-IN for container

self_update not feature rich enough.


Pyarrow -> pandas -> pyarrow null column Question

I am reading parquet files using pyarrow where one of String type column has all null values when I convert it into pandas and back to pyarrow table column type changed to an integer. I read output using Spark. I also supplied schema when converting pandas to table.
Question: How to write a column with type string and all null values? I want to keep datatype as a string and null values.
Thank you !!

Hi Wes, Thank you. Sorry for late reply. while creating a reproducible example, I realized that I am using
write_to_dataset and that method divide that table into subtable and writes it. when I passed schema there, its working fine. API documentation doesn't have this method. I will close this issue now. Thanks again for help.

I opened https://issues.apache.org/jira/browse/ARROW-3629 about adding this to the API listing

Thank you.

This issue can still occur with subtables. If one subtable gets converted to "null", and another table of the same column gets a valid type, then appending to the same parquet file with ParquetWriter will throw:
"ValueError: Table schema does not match schema used to create file: " , with file/table mismatch with one showing null, the other showing a valid column type


Question Images

Some questions need to be able to show images.

Questions that require images are now able to show images.


Panel title bar overflows when there is still space

pls see the screenshot below

@egamma I can not reproduce this. Do you always see this? How do you get into this state?
fyi @sandy081

@isidorn I can always see this when the window is smallish

@isidorn more info:

it happens when the width of the window is 1026 pixels
to repro: Remote Containers> Try a Sample > Node

let me know if you still cannot reproduce this.

@egamma I have tried multiple times to reproduce it but could not. If you are able to repro it consistently, is there something I am missing in the steps here?

@egamma Can you please try again and see if you can repro it?

closing in favor of https://github.com/microsoft/vscode/issues/116424

@egamma Can you please try reproducing this again (tomorrow's insiders) - are you seeing overflow action even if there is enough space ?


Method calls inside expressions: {{ a.b().c }}

Now that parentheses are required explicitly, {{ a.b.c }} no longer works when b is a method. For example:
class Boss:
    decision = 'accept'

b = Boss()

class Player:
    def get_boss(self): return b

res = Template('{{ player.get_boss().decision }}').render(player=Player(), strict_mode=True)

Raises:
ibis.errors.UndefinedVariable: Cannot resolve the variable 'player.get_boss()' in template 'UNIDENTIFIED', line 1.

This is actually working as intended - function calls have only ever been supported at the end of the variable chain.
It isn't possible to support chained function calls given the current architecture but you can use a with block to achieve the same end:
{% with boss = player.get_boss() %}
    {{ bos.decision }}
{% endwith %}


Stock value non-zero for deleted stock

Please verify that this bug has NOT been raised before.

[X] I checked and didn't find a similar issue

Describe the bug*
In the stock list, stock which is depleted still shows a stock value.
It seems, however, that the value is not added to the total line of the table (correctly).
The purchase price shows the correct value, but the purchase price is not multiplied by the correct value (0), but by 1.
See example:

Steps to Reproduce

Mark stock to not be depleted on delete.
Deplete stock
Check table

Expected behaviour
When nothing is in stock, the value should be zero.
Deployment Method

[X] Docker
[ ] Bare metal

Version Information
Version Information:
InvenTree-Version: 0.11.0
Django Version: 3.2.18
Commit Hash: 593a716
Commit Date: 2023-04-18
Database: postgresql
Debug-Mode: False
Deployed using Docker: True
Active plugins: [{'name': 'InvenTreeBarcode', 'slug': 'inventreebarcode', 'version': '2.0.0'}, {'name': 'InvenTreeCoreNotificationsPlugin', 'slug': 'inventreecorenotificationsplugin', 'version': '1.0.0'}, {'name': 'AutoPrintLabelPlugin', 'slug': 'autoprint', 'version': '0.0.1'}, {'name': 'CustomPagerPlugin', 'slug': 'cpager', 'version': '0.1.2'}, {'name': 'Print Labels to file', 'slug': 'printlabeltofile', 'version': '0.0.1'}, {'name': 'Brother Labels', 'slug': 'brother', 'version': '0.6.0'}]
Relevant log output
No response

@miggland thanks for reporting :)


Consider TestServer.Create overload that accepts IConfiguration

needed to override env

Can now be done via TestServerBuilder.Configuration


addTrack support?

@ahmetozalp yes, support addTrack

not working i try.

@ahmetozalp Why can’t it work? Adding a track does not mean adding a transceiver. There is this difference

My English is not very good, am I not set up or not working? I am in the features I want

Can't this package solve my problem?
simple-peer use.
  sender = this._pc.addTrack(track, stream)


Add defaults during concat 508

[x] Closes #508
[x] Tests added
[x] Passes black . && mypy . && flake8
[x] Fully documented, including whats-new.rst for all changes and api.rst for new API

Contined on issue #508 by removing exception when concat two datasets with disjoint variables and instead add the missing variable with np.nan.

Thanks for working on this important issue!
There are a lot of edge cases that can come up in concat, so I think it would be very helpful to try to enumerate a broader set of unit tests for thoroughly testing this. For example:

Pre-existing vs non-pre-existing dimension
Pre-existing dimensions of different sizes
Missing data variables vs coordinates vs indexed coordinates

Ok, I'll work on extending the updates with the feedback and additional tests.  Thanks!

Hi, I've provided a new update to this PR (sorry it took me awhile both to get more familiar with the code and find the time to update the PR).  I improved the logic to be a bit more performant and handle more edge cases as well as updated the test suite.  I have a few questions:

The tests I wrote are a bit more verbose than the tests previously.  I can tighten them down but I found it was easier for me to read the logic in this form.  Please let me know what you prefer.
I'm still not quite sure I've captured all the scenarios as I'm a pretty basic xarray user so please let me know if there is still something I'm missing.

I'll take a look at this more carefully soon. But I do think it is a hard
requirement that concat runs in linear time (with respect to the total
number of variables across all datasets).
On Mon, Dec 30, 2019 at 5:18 PM Scott Chamberlin<EMAIL_ADDRESS>wrote:

Hi, I've provided a new update to this PR (sorry it took me awhile both to
get more familiar with the code and find the time to update the PR). I
improved the logic to be a bit more performant and handle more edge cases
as well as updated the test suite. I have a few questions:

The tests I wrote are a bit more verbose than the tests previously.
I can tighten them down but I found it was easier for me to read the logic
in this form. Please let me know what you prefer.
I'm still not quite sure I've captured all the scenarios as I'm a
pretty basic xarray user so please let me know if there is still something
I'm missing.

—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/pydata/xarray/pull/3545?email_source=notifications&email_token=AAJJFVVSKN5ZWD4FQHPIJG3Q3KMWXA5CNFSM4JOLVICKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEH3RY5Q#issuecomment-569842806,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AAJJFVUPKZ7Q3UFVSH7D2STQ3KMWXANCNFSM4JOLVICA
.

I am now wondering if we can use align to do the filling for us.
Example: goal is concat along 'x' with result dataset having x=[1,2,3,4]

Loop through datasets and assign coordinate values as appropriate.
Break datasets up into mappings collected = {"variable": [var1_at_x=1, var2_at_x=2, var4_at_x=4]} -> there's some stuff in merge.py that could be reused for this
concatenate these lists to get a new mapping concatenated = {"variable": [var_at_x=[1,2,4]]}
apply reindexed = {concatenated[var].reindex(x=[1,2,3,4], fill_value=...) for var in concatenated}
create dataset Dataset(reindexed)

Step 1 would be where we deal with all the edge cases mentioned in @shoyer's comment viz

For example:
Pre-existing vs non-pre-existing dimension
Pre-existing dimensions of different sizes
Missing data variables vs coordinates vs indexed coordinates

I just pushed an incomplete set of changes as @kmuehlbauer tests have demonstrated there was some incomplete cases the PR still isn't handling.
Here is a summary:

I've simplified the logic based on @dcherian comments but in order to keep the result deterministic needed to use list logic instead of set logic.  I also kept the OrderedDict instead of going with the default dict as the built in ordering methods as of py 3.6 were still insufficient for keeping the ordering consistent (I needed to pop FIFO) which doesn't seem possible until py 3.8.
I did add a failing test to capture the cases @kmuehlbauer  pointed out.

I'm not sure I have my head wrapped around xarray enough to address @dcherian's latest comments though which is why i'm sharing the code at this point.  All tests are passing except the new cases which were pointed out.
I'll try to continue to get time to update this but wanted to at least provide this status update at this point as its been awhile.

Has this been implemented? Or is it still failing the tests?

Cool PR - looks like it's stale? Maybe someone should copy the work to a new one? Have been coming across this issue a lot in my work recently.

@scottcha Are you still around and interested to bring this along? If not I could try to dive again into this.

I'm still along and yes I do still need this functionality (I still sync back to this PR when I have data missing vars).  The issue was that the technical requirements got beyond what I was able to account for with the time I had available.  If you or someone else was interested in picking it up I'd be happy to evaluate against my use cases.

I can try to rebase the PR onto latest main

I did try that a few months ago, but a lot has changed since the PR was opened so it might actually be easier to reimplement the PR?

Thanks @keewis for the heads up. I'll have a look and if things get too complicated a reimplementation might be our best option.

@scottcha @keewis I've tried hard, but finally decided to start from scratch, see #7400.


Swift Example

Would be great to get a Swift version of this.

@talkaboutdesign I'll be porting to Swift in next few days.

https://github.com/firebase/mlkit-material-ios/commit/074c687c3a44a4fb845d0604d93456b6a21f1a8f


Improve data set citation

These changes improve the HTML for the "Cite data set" tab a bit.
The citations are now more compliant with guidelines for citing data elsewhere. Different components of the citation have been factored out into reusable templates. The title is output as an HTML  element. An example citation for an individual file in the collection is also now provided. Example output:
Augurzky P. (2019 - 2021): squid. Data set in Tübingen Archive of Language Resources.

Persistent identifier: https://hdl.handle.net/11022/0000-0007-EC46-1

Augurzky P. (2019 - 2021): squid1/squid03.cnt. In: squid. Data set in Tübingen Archive of Language Resources.

Persistent identifier: <a href="https://hdl.handle.net/11022/0000-0007-EC46-1<EMAIL_ADDRESS>

Any objections if I merge this?


Notion Image do not load

Description

Image do not load up and throw {"message":"Something went wrong."} error.
Notion Test Page ID
bd999537dba44d68be67cbcf11ee6199

Did you add allowed image domains in next site config?
You can refer - https://stackoverflow.com/questions/66533981/next-image-configuration-in-next-js-config-file

@heypratik It was working without this image domain, is there any upgrade or dependency introduced which caused this issue?

Same thing happens.

The image urls api gives are invalid.
ex)
https://www.notion.so/image/https%3A%2F%2Ffile.notion.so%2Ff%2Fs%2F2f3dca95-eec5-4117-b336-6a748a5ddddd%2FUntitled.png%3Ftable%3Dblock%26id%3D24640f83-bca7-46e9-b096-388e696fa8c2%26expirationTimestamp%3D1679017640323%26signature%3DhTyG5u5jozwOeA33Rd3qxpyU1FoZw81tqC_Lh84zLBU?table=block&id=24640f83-bca7-46e9-b096-388e696fa8c2&cache=v2

I found the reason.
See https://github.com/NotionX/react-notion-x/issues/441

It fixed for me when I added file.notion.so in next.config.js in the domains array inside images.

It fixed for me when I added file.notion.so in next.config.js in the domains array inside images.

still not work for me.

@heypratik It was working without this image domain, is there any upgrade or dependency introduced which caused this issue?

the code hadn't changed much, I think notion changed their rules cause this problem.
https://www.notion.so/image/https%3A%2F%2Ffile.notion.so%2Ff%2Fs%2Fe7476dd2-7f21-45ec-9a65-a97775efc4f5%2FUntitled.png%3Ftable%3Dblock%26id%3D5785bd67-0de9-4041-b382-e5159d0437ae%26expirationTimestamp%3D1679793369481%26signature%3DGkY7tXJsX9jlHu8x4ugX-YfPtyxnrZV4QW2lkTF7oTQ?table=block&id=5785bd67-0de9-4041-b382-e5159d0437ae&cache=v2
I looked my page url, it said blocked.

I am facing the same problem. Images on my blog do not show and when I try to access the src from browser it raise {"message":"Something went wrong."}.
One example page is https://www.richardsong.space/l2-risk where images in original notion page do not show.

I have the same problem, the domain of the image is "file.notion.so" and when I access that image URL, it always returns {"message":"Something went wrong."}
I try to "file.notion.so" domain to next.config.js but it doesn't work

I have the same problem, the domain of the image is "file.notion.so" and when I access that image URL, it always returns {"message":"Something went wrong."}
I try to "file.notion.so" domain to next.config.js but it doesn't work

same issue here. any update here? this is a pretty big issue IMO.

@0xFloyd I didn't change anything and now its working as usual.

It works for now

I am facing the same problem. Images on my blog do not show and when I try to access the src from browser it raise {"message":"Something went wrong."}. One example page is https://www.richardsong.space/l2-risk where images in original notion page do not show. I have tried method mentioned by @adayush, it cannot work for me😥

notion using Amazon’s cdn，its‘ period time is about one day（24hours），the static resources like src in html only Effective within 24 hours

I am facing the same problem. Images on my blog do not show and when I try to access the src from browser it raise {"message":"Something went wrong."}. One example page is https://www.richardsong.space/l2-risk where images in original notion page do not show. I have tried method mentioned by @adayush, it cannot work for me😥

notion using Amazon’s cdn，its‘ period time is about one day（24hours），the static resources like src in html only Effective within 24 hours

I am facing the same problem. Images on my blog do not show and when I try to access the src from browser it raise {"message":"Something went wrong."}. One example page is https://www.richardsong.space/l2-risk where images in original notion page do not show. I have tried method mentioned by @adayush, it cannot work for me😥

I wanted to set static resources cnd cache lessthan 24hours,so that images' url can be valid,but I failed;Then,you can set a schedule task(less than 24 hours) to redeloy your project ,so that can refresh static resources

How did you guys solve it? I'm facing the same thing it only works when I refresh the page or switching the light mode, but it never works the first time you visited it, such a bad user experience : (

Getting something similar in my deployment recently. I wonder if Notion changed some header in their image responses?


RefreshAsync: Schedule config refresh at the end of cache expiration window

In the scenario that the RefreshAsync is called in a function that is triggered by Event Grid events sent by AppConfig, the configuration refresh could be missed (ignored) if the event arrives at the time the current cache expiration window is not yet reached. The proposal is to schedule a configuration refresh at the end of the cache expiration window in this case. Only one real configuration refresh should happen even if multiple are scheduled.
cc: @jimmyca15 @drago-draganov

This is resolved by the introduction of the new API below in IConfigurationRefresher, which can be called when an event is received from Event Grid.
void SetDirty(TimeSpan? maxDelay = null)


【Android】why does bundleReleaseJsAndAssets task not run

for pic
left:run assembleDevRelease task by cmd
right:run app by app
on the 'left',it run bundleReleaseJsAndAssets task and output the bundle file,but 'right' can't.
why?it's similar to run the task

Because assembleDevRelease builds without debug mode. The other is in some sort of debug build which skips building the bundle. The bundle built during the gradle build is only used to ship it with the APK. If you doing a debug build it assumes you will have the React Native packager running which the app will use to pull the bundle.

@rmevans9 Not,the two build type all is release,they difference just one run by cmd,the other run by IDE,the task all is assembleDevRelease

Try to uncheck Configure on demand.

Hi there! This issue is being closed because it has been inactive for a while.
But don't worry, it will live on with Canny! Check out its new home: https://react-native.canny.io/feature-requests/p/androidwhy-does-bundlereleasejsandassets-task-not-run


Update README.md

[ ] Redmine Issue: https://redmine.pfsense.org/issues/NNNN
[ ] Ready for review

Changes and Edit


Only generate needed chunks

Limit chunk generation to chunks actually needed. i.e. use ray tracing to find out which chucks are visible or are going to become visible soon.
This would drastically reduce the lag caused by people rapidly exploring the world. Would also reduce save filesize.
Problems:

Chuck population may be problematic
Spectators would not be able to see much when diving through underground.

This is not viable to do server side.
As it is it would actually increase server lag. Raytracing is very expensive operation. That's why Minecraft never uses it. Clientside it uses a simplified visibility graph algorithm. But even that would not scale well to tens or hundreds of players, even when they are in very small area.
It would also lead to something very counterintuitive: Plant and animals not in view may not update. Players definitely wouldn't like it.
Another option would be to let clients request chunks to be loaded. This could work but it would be a very significant change that would break even more mods.
Many mods rely on all the chunks near a player being loaded to work correctly. Even the openblocks elevator mod - it requires both elevator endpoints to be loaded clientside.
And all of the above ignores the fact that it's just not something I want to do in this mod. There has to be a limit to what this mod does. The idea is to keep things similar to vanilla. I made a big exception for CustomCubic world type, which will be a mod on it's own, to avoid adding unnecessary things to the base cubic chunks mod.


developer journey proposal

listed recommendations of key modules and functions that should be part of edge cloud API family

Hi Kev, I see that you have approved the change but it still dont get an option to merge the change.
What would be the next step?

also, i did make a small update and commit it to same branch.

HI @gunjald please can you review?


[Snyk] Security upgrade python from 3.10.1-alpine to 3.11.0a7-alpine

This PR was automatically created by Snyk using the credentials of a real user.Keeping your Docker base image up-to-date means you’ll benefit from security fixes in the latest version of your chosen image.
Changes included in this PR

Dockerfile

We recommend upgrading to python:3.11.0a7-alpine, as this image has only 0 known vulnerabilities. To do this, merge this pull request, then verify your application still works as expected.
Some of the most important vulnerabilities in your base image include:

Severity
Priority Score / 1000
Issue
Exploit Maturity

500
Integer Overflow or Wraparound SNYK-ALPINE315-EXPAT-2393733
No Known Exploit

500
Integer Overflow or Wraparound SNYK-ALPINE315-EXPAT-2393735
No Known Exploit

500
Integer Overflow or Wraparound SNYK-ALPINE315-EXPAT-2407738
No Known Exploit

500
Improper Encoding or Escaping of Output SNYK-ALPINE315-EXPAT-2407749
No Known Exploit

500
Exposure of Resource to Wrong Sphere SNYK-ALPINE315-EXPAT-2407753
No Known Exploit

Note: You are seeing this because you or someone else with access to this repository has authorized Snyk to open fix PRs.
For more information:
🧐 View latest project report
🛠 Adjust project settings

Learn how to fix vulnerabilities with free interactive lessons:
🦉 Learn about vulnerability in an interactive lesson of Snyk Learn.

We do not use alpha Python releases for our relatively stable Docker images.


feat(protocol): Internal review

These are some simplifications/optimization/small fixes/questions I have after doing a first pass review of the code, though certainly still parts that require more looking into. Nothing super important though here.
It's certainly not my goal to get all these small modifications in the current code base, but maybe some of them could and some of them could be done in a later version if deemed not important enough to still change the code at this point. I do also think that unnecessary changes should be avoided at this point.
I will also add comments to the different parts in this PR with some more context where needed.
Overall impression: it's hard to review because of the complexity of the different systems. There's a lot of code and the different optimizations that work on top of each other that just make things difficult to verify. The amount of different tricks you need to keep in your head just for all the gas optimizations to store the list of blocks and transitions is already big, and if you add the contestation part on top of it, it makes it hard. While the rollup basically just stores a list of blocks and a mapping of transitions, the current implementation makes this a challenge to easily understand. There's also a lot of features that result in a lot of conditional branches which does not make things easier.
There seems to be quite some tests missing I feel. Which I can understand very well because the amount of features and if/else cases that need to be tested is big. Take for example just the AssignmentHook mechanism and the amount of different things that would need to be tested to truly test all the features: payment with ETH, payment with ERC20 token, limited by time/block id/parent hash/meta hash, paying an ETH tip to coinbase, multiple hooks which also impact some of there features in non-trivial ways,... And this is only for the successful paths, you would still have to test for all the error paths as well. It's a lot of work.
I know a lot of my "keep things simple" comments have been ignored before, so I don't have any illusions or really goals to change things at this point. But I don't come with only complaints today because I actually have a simplified Taiko implementation that I started working on for the booster rollups: https://github.com/Brechtpd/taiko-mono/pull/1. It also contains a new design for how to do multi-provers and making sure buggy provers are automatically disabled. The mechanism used there would already greatly decrease the complexity compared to the current contestation system (and fixes issues I have raised in the past with that).

I got this warning so I have to spend some time to learn the transient storage.
Warning (2394): Transient storage as defined by EIP-1153 can break the composability of smart contracts: Since transient storage is cleared only at the end of the transaction and not at the end of the outermost call frame to the contract within a transaction, your contract may unintentionally misbehave when invoked multiple times in a complex transaction. To avoid this, be sure to clear all transient storage at the end of any call to your contract. The use of transient storage for reentrancy guards that are cleared at the end of the call is safe.

I think a valuable feedback is about msg.sender in 1) mesage ownership, and 2) block.coinbase, and 3) transition.prover. We probably need to work on these improvements.

I got this warning so I have to spend some time to learn the transient storage.

Great article here;
Quote:
"An expected canonical use case for transient storage is cheaper reentrancy locks, which can be readily implemented with the opcodes as showcased below. However, given the caveats mentioned in the specification of EIP-1153, utmost care has to be taken for more advanced use cases of transient storage to preserve the composability of your smart contract. To raise awareness of this issue, for the time being, the compiler will emit a warning on use of tstore in assembly."

Just as a benchmark, gas tested and improvements for propose/prove/verify:

(non-tiered - tiered tests)
Propose: 9 - 10%
Prove: 1.8 - 3.5 %
Verify: 5 - 8%

Just as a benchmark, gas tested and improvements for propose/prove/verify:
 (non-tiered - tiered tests) Propose: 9 - 10% Prove: 1.8 - 3.5 % Verify: 5 - 8%

not sure I understand these numbers...

Just as a benchmark, gas tested and improvements for propose/prove/verify:
>  (non-tiered - tiered tests) Propose: 9 - 10% Prove: 1.8 - 3.5 % Verify: 5 - 8%

not sure I understand these numbers...

Old code gas report:

Brecht's code gas report:


FBP-136. Added explicit namespaces

Fixes #136

Codecov Report

Merging #154 into master will increase coverage by 0.01%.
The diff coverage is 84.21%.

@@             Coverage Diff              @@
##             master     #154      +/-   ##
============================================
+ Coverage     62.78%   62.79%   +0.01%
  Complexity      830      830
============================================
  Files            85       85
  Lines          3646     3647       +1
  Branches        671      671
============================================
+ Hits           2289     2290       +1
  Misses         1117     1117
  Partials        240      240

Flag
Coverage Δ
Complexity Δ

#unittests
62.79% <84.21%> (+0.01%)
830.00 <9.00> (ø)

Impacted Files
Coverage Δ
Complexity Δ

.../intellij/plugin/flowable/parser/FlowableParser.kt
90.93% <84.21%> (+0.02%)
124.00 <9.00> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 08ff96a...9d0866c. Read the comment docs.


Upgrade Containerd in main from 1.7.13 to 1.7.14

Subject says it all.

The tang/tpm CI failures of arm64 are not relevant.
See the open PR to fix that.


[BugFix] Fix datacache deadline overflow

Fixes #27147
What type of PR is this:

[x] BugFix
[ ] Feature
[ ] Enhancement
[ ] Refactor
[ ] UT
[ ] Doc
[ ] Tool

Checklist:

[ ] I have added test cases for my bug fix or my new feature
[ ] This pr will affect users' behaviors
[ ] This pr needs user documentation (for new or modified features or behaviors)

[ ] I have added documentation for my new feature or new function

Bugfix cherry-pick branch check:

[x] I have checked the version labels which the pr will be auto-backported to the target branch

[x] 3.1
[ ] 3.0
[ ] 2.5
[ ] 2.4

@Mergifyio rebase

[FE PR Coverage Check]
:heart_eyes: pass : 1 / 1 (100.00%)
file detail

path
covered_line
new_line
coverage
not_covered_line_detail

:large_blue_circle:
com/starrocks/lake/DataCacheInfo.java
1
1
100.00%
[]

@Mergifyio backport branch-3.1


Proposing hot reload for development env

(This is a "nice to have", just proposing at this time)
I have been thinking that putting the example in this repository and using something like nodemon would greatly improve my efficiency.
Here are my steps currently:
On swiftui-react-native:
yarn run clean-build

On swiftui-react-native-example

Quit metro (if running)
Restart metro with:

rm -rf node_modules && yarn install && yarn start --reset-cache

Wait for metro to load up, then hit Rto reload simulator(s).

This would be cool to see. Feel free to take a crack at it!

Did you try anything like this yet within the example proj? I think this is exactly what you want. https://medium.com/dailyjs/how-to-use-npm-link-7375b6219557

I have not, will try this first before having to add any devDependecies.

If I get something working, I think it'd be productive to work off the same example app. Maybe expand to allow us to try things outside of a List Section?
I've been on my own branch saving zero of my exploratory testing and I'm full of guilt about it hahaha

Did you try anything like this yet within the example proj? I think this is exactly what you want. https://medium.com/dailyjs/how-to-use-npm-link-7375b6219557

https://stackoverflow.com/a/47403470/6074395 darn

ah damn. if those alternative suggested don't work, another alternative could be this:

add a new script in the package.json "build-example"
it would call the clean-build script and then move the output dist folder into your example app project.

npm run clean-build && copfiles dist ../swiftui-react-native-example
or something like that (no clue if that is correct but the idea should work). That way all you would have to do is make a change, then run this script.

Pending your review to my pull on the example repo, I think this can be closed. (No action needed on this repo to resolve issue).


Release releasetool 0.7.0

This pull request was generated using releasetool.

Release is at https://github.com/GoogleCloudPlatform/releasetool/releases/tag/releasetool-0.7.0


move templates out of stubs directories, and generate clean manifests

Thanks, @Amit-PivotalLabs! Looks good to me; I'll have the team pull it in ASAP.
Best,
Eric


feat: using a much more compact timeline layout

Fixes #306

I like it. As discussed out of band, it's much denser information wise, but slightly less sexy, but I think overall it's probably a better tradeoff.


Add extraVolumeMounts to fluentd statefulset spec

Is your feature request related to a problem? Please describe.
Cannot access S3 variant due to missing SSL certificate in fluentd. The fluentd configuration when creating a Flow does not have an option to include extraVolumeMounts.
Describe the solution you'd like
Add extraVolumeMounts as a configurable option to the fluentd statefulset spec.
Describe alternatives you've considered
As an alternative I added a volume mount as kubernetes patch to the existing statefulset, this however is a hotfix instead of an alternative solution.
Additional context

Can you please elaborate on what kind of SSL certificate you want to install and where? There is a mount option for Secret kind parameters in several plugins.

We have Rados on top of Ceph as a self hosted S3 variant. To connect, Fluentd needs a certificate which we provide via a volume mount. I did not see any option in https://banzaicloud.com/docs/one-eye/logging-operator/crds/ to mount this volume for the Fluentd statefulset.

These kind of integration supported via the plugin output configuration as a secret: https://banzaicloud.com/docs/one-eye/logging-operator/plugins/outputs/secret/. Which output do you use to connect to Rados?


you should add the snippets feature

something like github gist would be awesome feature

+1

+1

To keep things in order, please follow on https://github.com/gogits/gogs/issues/936 .
Thanks again!


Redactions created on one page is showing up on next page in the 'Redline pdf'

Describe the bug in current situation
when a user created redactions on one page, but on the 'redline package' it shows up on the next page
Link bug to the User Story
Impact of this bug
Describe the impact, i.e. what the impact is, and number of users impacted.
Every users
Chance of Occurring (high/medium/low/very low)
Pre Conditions: which Env, any pre-requesites or assumptions to execute steps?
Request EDU-2023-09561024 on test-marshal
Steps to Reproduce
Steps to reproduce the behavior:

Go to records tab and upload an excel file as a ministry user
Login as IAO user and go to redaction app for the request
Set 'duplicate ' flag on first page
Create 'with held in full' flag on the next page
Then generate 'Redline pdf' for the request
See full page redaction is showing up on the 3rd page instead of 2nd

Actual/ observed behaviour/ results
Expected behaviour
A clear and concise description of what you expected to happen. Use the gherking language.
Screenshots/ Visual Reference/ Source
If applicable, add screenshots to help explain your problem. You an use screengrab.

@richard-aot I noticed that this issue happens if a page is set for a Duplicate/Not responsive flag, then following page's redaction is moving to next page and so on

Thanks, @nimya-aot. I can reproduce this issue on test-marshal. Will do some investigation.

working as expected, so closing it


revert the behavior that Lookup handler adds TLF to favorite

Tested locally in my zsh with syntax-highlighting enabled. Resolves https://github.com/keybase/client/issues/3503

I think this will bring back the problems with rmdir on OS X again.  Because the folderBranchOps object for the removed object is still in the list of folders, the subsequent ls that rmdir does will succeed and get plumbed through the folderBranchOps object to do a Stat, which will cause it to get re-added to favorites.  I think we might need to keep the recentlyRemoved stuff around.  Unless there's something I'm missing?

@strib I thought recentlyRemoved existed because we did "add TLF to favorites in Lookup" and that OS X always does a lookup at the end of rmdir. If we don't add TLF to favorites anymore, it should be fine right?

folderBranchOps itself adds it to favorites if it gets a Stat call, which it would if the TLF is still around.


[Storage][DataMovement] Tests with expected failure cannot run in playback

Certain tests that expect a failure to occur during a transfer are difficult to run in Playback mode as there could be differences in how far the transfer made it before the transfer was cancelled due to failure. This can cause the test to fail for missing recordings when running in playback if the playback test tries to run further than the test did when it was recorded.
We either need to find a way have the recoding file contain all necessary requests so it doesn't matter how far the playback test runs, find a way to ignore the recording failures (if this is okay to do in these tests), or find a way to fail at a known spot, likely through mocking.

Time box this. Move tests to mocking.


Bug: Safari Flex Layout

Safari version that I am using (v13.1) causes flex items to over shrink making them stack over each other.
Additional details / screenshot

Turns out the  h-px or any height property > h-6  causes the flex items to over shrink. Currently looking for a way to get around this to stop items from over shrinking.


Crash in playertracker when name does not resolve to steam id

When the name of a player does not resolve to a steamid a crash occurs

should be fixed in v<IP_ADDRESS>


Wondermach patch 1

Changed from http to https

Merged in https://github.com/TowoLabs/ftso-signal-providers/commit/a2024ebd31ac4b207867fadf81bc03a8f2562e30


Code to perform QA task

Does anybody have an inference code or notebook to run VALOR for QA task? any notebooks at least for information retrieval

A simple Inference code is added


Add oneway to moreFields for path like highways

During our Mapping event for bike infrastructure we ran into the issue that on a hw=path (eg. with bicycle=yes|designate+foot=designated) the oneway field is missing.
This PR add the field as "moreFields" option to path like highways which did not have it, yet.
This way the value becomes visible if set, but is not requested by default (because usually it is not needed).

merged as 3e5e99ff881d88f4e8761e64356c830875bc8437 (moreFields are usually sorted alphabetically)


Support for MySQL blob fields (Read Only)

Support for MySQL blob fields (Read Only)

yeah sorry

Already solved

Thank you!


Testcafe: iOS simulators are not working

Current behavior
Using SauceCTL + Testcafe + iOS sims fails, it starts a safari browser on OSX, see this execution
Desired behavior
Testcafe should run on iOS sims
Config to reproduce
apiVersion: v1alpha
kind: testcafe

# Sauce Labs specific information
sauce:
  region: eu-central-1 # or us-west-1
  concurrency: 10 # Controls how many suites are executed at the same time.
  metadata:
    name: TestCafe on iOS Simulators with SauceCTL
    tags:
      - testcafe
      - ios simulators
    build: "TestCafe: iOS Simulator test set - $DATE"

# Testcafe specific info
testcafe:
  version: 1.14.2
# Controls what files are available in the context of a test run (unless explicitly excluded by .sauceignore).
rootDir: ./

# Tests
suites:
  - name: "Testcafe - iOS Tests - Safari"
    browserName: "safari"
    src:
      # test files glob
      - "**/login.*"
    simulators:
      - name: iPhone 12 Simulator
        platformName: iOS
        platformVersions:
          - "14.3"
      - name: iPad mini (5th generation) Simulator
        platformName: iOS
        platformVersions:
          - "14.3"

# Controls what artifacts to fetch when the suite on Sauce Cloud has finished.
artifacts:
  download:
    directory: ./artifacts
    match:
      - '*'
    when: always

Versions
 0.52.2

Internal Jira ticket: https://saucedev.atlassian.net/browse/DEVX-1080

This has now been resolved :) Thanks for raising it.


[New UI] Exception thrown when click on the Generate button

Describe your environment

GPU: mps
VRAM: 16GB M1 Pro
CPU arch: arm
OS: macOS
Python: miniconda
Branch: development
Commit: Merge: 4247e75 61b19d4 Merge branch 'development' into patch-1

Describe the bug
A clear and concise description of what the bug is.
When you run to python backend/server.py for the new UI it runs successfully on localhost:9090, but when you get on the site and enter a prompt then click Generate, nothing happens and it throws exception below on the console:
Here is the full log of the process I described above:
(ldm) burakkurkcu@Buraks-MacBook-Pro stable-diffusion % python backend/server.py
* Initializing, be patient...

>> GFPGAN Initialized
>> CodeFormer Initialized
>> ESRGAN Initialized
>> Loading model from models/ldm/stable-diffusion-v1/model.ckpt
LatentDiffusion: Running in eps-prediction mode
DiffusionWrapper has 859.52 M params.
making attention of type 'vanilla' with 512 in_channels
Working with z of shape (1, 4, 32, 32) = 4096 dimensions.
making attention of type 'vanilla' with 512 in_channels
>> Using more accurate float32 precision
>> Model loaded in 10.97s
>> Setting Sampler to k_lms
>> Starting server at http://localhost:9090
>> Latest images requested
>> System config requested
>> System config requested
>> Page 1 of images requested (page size 50 offset 0)
>> Image generation requested: {'prompt': 'blade runner istanbul', 'iterations': 1, 'steps': 50, 'cfg_scale': 7.5, 'height': 512, 'width': 512, 'sampler_name': 'k_lms', 'seed':<PHONE_NUMBER>, 'seamless': False, 'progress_images': False, 'variation_amount': 0}
ESRGAN parameters: False
GFPGAN parameters: False
/Users/burakkurkcu/stable-diffusion/ldm/modules/embedding_manager.py:155: UserWarning: The operator 'aten::nonzero' is not currently supported on the MPS backend and will fall back to run on the CPU. This may have performance implications. (Triggered internally at  /Users/runner/work/_temp/anaconda/conda-bld/pytorch_1659484612588/work/aten/src/ATen/mps/MPSFallback.mm:11.)
  placeholder_idx = torch.where(

Traceback (most recent call last):
  File "/Users/burakkurkcu/stable-diffusion/backend/server.py", line 792, in generate_images
    generate.prompt2image(
  File "/Users/burakkurkcu/stable-diffusion/ldm/generate.py", line 407, in prompt2image
    generator = self._make_txt2img()
  File "/Users/burakkurkcu/stable-diffusion/ldm/generate.py", line 655, in _make_txt2img
    self.generators['txt2img'].free_gpu_mem = self.free_gpu_mem
AttributeError: 'Generate' object has no attribute 'free_gpu_mem'

To Reproduce
Steps to reproduce the behavior:

Get into the repo folder (ex. "stable-diffusion" folder for me at home directory)
Pull the referenced commit on development (at this time of writing, it's latest commit on development branch)
run "conda activate ldm" to activate ldm environment
run "python backend/server.py" to get the new UI running at localhost:9090
go over at localhost:9090, enter a prompt and click the Generate button
see the error

Expected behavior
It should generate image like the old ui generates successfully.
Additional context
I discussed this bug on discord with @psychedelicious, and it seems broken on his side as well.

I've getting the same error, I think it have something to do with that commit: https://github.com/invoke-ai/InvokeAI/commit/485fe67c92f1ab6be3c96c9d7da20c2c9ebb1d7b

Reverting just that commit fixed it for me git revert 485fe67c92f1ab6be3c96c9d7da20c2c9ebb1d7b

Reverting just that commit fixed it for me git revert 485fe67c92f1ab6be3c96c9d7da20c2c9ebb1d7b

fatal: not a git repository (or any of the parent directories): .git

It is due to Generate having a new option free_gpu_mem, it is settable via an argument for dream.py, but not added to the server.
as a work-around i added generate.free_gpu_mem = False backend/server.py, line 151
It ought to be passed from an argument as it is with dream.py, I can make a PR for that tomorrow!

This is now fixed in dev. My apologies, but I was sight-seeing today and only checked back now.

Hi @lstein, thank you very much. Can you link here the commit that fixes this problem? I've already ran git pull on my development branch, but cannot get to work...

Looks like it's in this branch: https://github.com/invoke-ai/InvokeAI/commits/improve-metadata-retrieval

This is solved now!


Suggestions for visual improvements

I got inspired by the work you guys are doing to visualize network topologies. As network diagrams has been my passion for years I would like to contribute to this project by trying to describe some ideas to make the project even better.
Here I'm mostly focusing on Leaf / Spine type of networks. Many of these techniques apply to other type of topologies as well.
I already started to implement the features I'm going to describe here, but soon realized my most valuable contribution might be to share ideas in detail.
Limitations of current implementation
Current implementation works well with small topologies like this:

However, when trying to add more leafs to visualize production grade topologies, it starts to fall apart:

Here interface names starts to overlap. Links starts to overlap in the Spine end as well. It becomes really hard to see exactly what is connected where. Also in these examples we are using really short version of interface names. If you want to have something like "Gi0/0/0/34" it starts to become even more mesh. In other words the implementation is lacking visual scalability features.
Luckily there are techniques we can leverage to make diagrams way more scalable.
Suggestion for improvements
Let's take last diagram with 12 leafs and make it better. What if diagram looks like this:

Routing links more scalable way
First improvement is to route links between devices more scalable way. It means links are links are orthogonal (simple) with curved corners. Links should also have line jump style as gap so that we don't confuse jumps and corners.
Spine interfaces (read = upper level device interfaces) are moved further down the cable to the place where they have more space.
All interface names are rotated. In this diagram style you can easily fit in longer interface names.
Note, link between Spine and leaf consists of four separate connectors. Here they are colored for sake of clarity:

We need four to be able to have these arrow connectors for Grafana to visualize traffic rates. If that is not needed three would be enough.
Placement of shapes in adjacent layers
One additional need when using style like this is to prevent devices on adjacent layers (we could have more than 2 layers) to be located too close to each other in x-axis. If this is not done link routing becomes mesh:

So some spacing is needed to prevent this happening.
Something else
Hmmm.. I just got idea we could have four arrows to be able to illustrate both in and out traffic rates:

One additional thing I usually do when drawing diagrams like this is to locate device label (hostnames etc.) like this:

It makes it even more scalable as you can place leafs way more near to each other. For some reason shapes the code generates don't follow text positioning features of drawio (top, bottom etc..). Would be nice to fix this as well.
Small details

No need to group interfaces with their device
No need to adjust traffic rate labels randomly (as in current implementation)

Any comments
What do you think? Would it be useful to have something like this? Any other practices which could be used to make diagrams better?

Ideally these features should be configurable in styles.

I love it. Do you have any drawio file or even code?

Drawio file sent directly as I couldn't attach it here.


Query observations by custom field transect_id

Hi!
We are developing some new functionailities for the Drupal Inat plugin. We are working with an extra field called transect_id. By now, we have to query to all the observations of a project to get the observations related to this transect_id. We were wondering if it's possible to direct filter the query by this field (transect_id). The aim is to get observations not necessary related with projects, and highly improve the performance.
Thanks for the great work!!

I think what you want is doable, but not documented: http://www.inaturalist.org/observations.json?field:transect_id=
Is that what you need? E.g. filtering all observations by an observation field?

Thanks! works like a charm!

Until friday this query (with GET method) " http://www.inaturalist.org/observations.json?field:transect_id=67-48  " was working perfectly. But now get an "Internal Server Error" from.
Has been any change during the last week that can explain this?
Thank you very much!!

There have been a few changes to search recently. I think I found the problem, and am currently testing the fix. If all goes well we will deploy a fix later today. Thanks for the report

As far as I can tell this is fixed.


Add support for cte materialization

Currently, CTE materialization is dropped. This retains the materialization modifier for CTEs.

Thanks @tomquist for your contribution!
Successfully published:
 -<EMAIL_ADDRESS> -<EMAIL_ADDRESS>

Awesome, thanks @pyramation!


MVC 6 / Asp.net VNEXT how to use shared, separate Resource DLL with IViewLocalizer or IHtmlLocalizer and .resx

Moved from https://github.com/aspnet/Mvc/issues/4723
Opened by @MrWinky

There are lots of great VNEXT articles explaining how to use RESX resources when the \Resources folder are in the VNEXT  application's sub folder path.
However, I have an MVC application which requires I place the RESX files in a separate VNEXT class library dll in the solution and share it among projects (assume the separate project is called MyResourceProject).   Maybe I should be using a different project type for sharing resource strings in a  RESX?
The following does not work:
 services.AddLocalization(options => options.ResourcesPath = "MyResourceProject .Resources");

and
  services.AddMvc()
          .AddViewLocalization(options => options.ResourcesPath = "MyResourceProject .Resources")

How do I point to a separate library path in an MVC VNEXT application?

Possibly related: https://github.com/aspnet/Localization/issues/214

In 214,   I am not seeing a solution.   The problem is when I design a 3 tiered application this issue causes a circular reference.   The main web portal module suddenly becomes a dependency to the Data and Business layer modules.
For example:

EF 7 is kept in it's own project.  MyProject.Data.EntityFramework
Business logic layer objects which use the strings  MyProject.BLL.ViewModels
The web portal (with startup.cs) is in it's own project MyProject.Portal

This is pretty standard N tier architecture.
Each of these projects need the resx files.
However,   If I am forced to place  MyProject.Resources.resx in the web portal app, now I have a circular reference problem.   Because Portal project is dependent on  EntityFramework and ViewModel projects (as it should be).   Conversely,  EntityFramework and BLL need those SAME resource strings and now becomes dependent on the Portal project!?.

@MrWinky we did the work to allow class library resources in #283. To enable this scenario you need to add ResourceLocationAttribute to the AssemblyInfo of the class libraries so that the "main" project knows where to look for the resources.
Let us know if you have any trouble with that, or if I misunderstood and that doesn't actually resolve your issue.

On second thought I'll close this as it seems to be the exact use case #283, but feel free to re-open if the need arises.

@MrWinky we did the work to allow class library resources in #283. To enable this scenario you need to add ResourceLocationAttribute to the AssemblyInfo of the class libraries so that the "main" project knows where to look for the resources.

hi @ryanbrandenburg, could you please elaborate this answer? You say AssemblyInfo of the class libraries. Which libraries? Where exactly to put the attribute?

@fabercs you should decorate your assembly by adding ResourceLocationAttribute to the AssemblyInfo. Have a look to this line for instance https://github.com/aspnet/Localization/blob/master/test/ResourcesClassLibraryWithAttribute/AssemblyInfo.cs#L7

@hishamco thank you for answer, this is my solution structure;
|--MyProject.Infrastructure
|--MyProject.Core
|--MyProject.Web
    |--Controllers
    |--ViewModels
    |--Views
|--MyProject.Resources
    |--Controllers
    |--ViewModels
    |--Views

Should I create an AssemblyInfo.cs file under MyProject.Resources  and add the line [assembly: ResourceLocation("ResourceFolder")]? Should I wrap all the files in a ResourceFolder or keep it as is?

Yep, add it under MyProject.Resources

Should I wrap all the files in a ResourceFolder or keep it as is

Yes & No, but the important thing is resource naming, you can check the docs on this one

@fabercs seems this issue is died, could you please file a new issue in the AspNetCore repo and copy your latest comment

@hishamco actually I have already created a new issue, https://github.com/aspnet/Mvc/issues/8739
I have also moved my last comment to there..

That's great, waiting for your reply there


No email validation

Issue Template
Prerequisites
Please answer the following questions for yourself before submitting an issue. YOU MAY DELETE THE PREREQUISITES SECTION.

[Y ] I am running the latest version
[Y ] I checked the documentation and found no answer
[Y ] I checked to make sure that this issue has not already been filed
[Y ] I'm reporting the issue to the correct repository (for multi-repository projects)

Context
There is no validation for email anyone can register with a fake mail  i want to implement mail validation

Firmware Version:
Operating System:
SDK version:
Toolchain version:

Expected Behavior
it will check if the email is valid and then user can register
Current Behavior
user can register with any fake email
Failure Information (for bugs)
it will stop he user from registering if email is not  valid
Steps to Reproduce
Please provide detailed steps for reproducing the issue.

step 1
step 2
you get it...

Failure Logs
Please include any relevant log snippets or files here.

please assign this issue to me under GSSOC23

@shivvamm go ahead!

Okay gotcha 👍

I want to work on this issue


Mark flow types as inexact with the new ... syntax

Are you submitting a bug report or a feature request?
Feature request
What is the current behavior?
The flow typings for objects in redux-form are currently all inexact (i.e. they're defined as {} instead of {| |}). Example: https://github.com/erikras/redux-form/blob/master/src/FieldProps.types.js.flow
Flow is gradually moving towards "exact by default" behaviour. The new syntax for inexact objects is { foo: number, bar: string, ... } See https://medium.com/flow-type/on-the-roadmap-exact-objects-by-default-16b72933c5cf for more info on this.
What is the expected behavior?
Flow types for objects in redux-form should have ... to signify that they're inexact. This helps codebases transition to "exact by default" behaviour. Without ..., Flow considers those objects exact which usually results in a fair number of errors.
What's your environment?
master branch
Other information
Adding ... might require updating Flow and Babel to the relatively recent versions to support this syntax.

TypeScript dev notes:
https://github.com/Microsoft/TypeScript/issues/12936