3DMatch dataset

Hi,
I have a question regarding the D.2. section from the Supplementary material.
Could you please share which 3DMatch files you use for the evaluation?

Do you use those with overlap > 30%?
Do you use consecutive pairs of point cloud indices (the original 3DMatch filters the pairs (i,j) with i+1 < j)?

You mention that you use the files from PREDATOR, but PREDATOR has more pairs than the original 3DMatch dataset.
Can you please elaborate?
Thank you in advance for you response.
Hopefully we can clear all this confusion of the registration pairs used in the datasets. Every paper  seems to do it a bit differently.

Do you use those with overlap > 30%?

The point cloud pairs in 3DMatch are with overlap >30%, and those in 3DLoMatch are with overlap between 10% and 30%. And the point cloud pairs during training are with overlap >10%. We use the same data downloaded from Predator. The only modification is that we reorganize the metadata file to our format.

Do you use consecutive pairs of point cloud indices (the original 3DMatch filters the pairs (i,j) with i+1 < j)?

During training, yes. During testing, consecutive pairs are used for computing FMR and IR (following common practice), but not for RR (following 3DMatch official protocol). You can find the details from eval.py.

You mention that you use the files from PREDATOR, but PREDATOR has more pairs than the original 3DMatch dataset.

I did not notice this though. The testing data we used is the same as Predator.

Every paper seems to do it a bit differently.

The testing data used by most papers is from 3DMatch as they provide the fused testing fragments. But the training data is different as not fused fragments are available, but I think it is okay. And I suggest using the data preprocessed by Predator as a standard pipeline as low-overlap pairs are contained.

Thank you very much for the quick and thorough response!

The point cloud pairs in 3DMatch are with overlap >30%

If you mean that all the pairs from gt.log from 3DMatch have an overlap >30%, I don't think its completely accurate (see this Github issue)
I would like to focus on Table 8 from the paper from section D.2. from the Supplementary. Maybe I can ask a more concrete question to clear some issues I've been having:

Do you use the example pair (0,37) from the folder 7-scenes-redkitchen in the evaluation?
I'm asking because this example pair is in the gt.log in PREDATOR (as can be seen here), whilst PREDATOR says the overlap is less than 30% (as can be seen here). Therefore, this example should be eliminated? Do you elimnate it from the evaluation in Table 8?
Do you use consecutive pairs from 3DMatch in Table 8 to compute the RRE, RTE and RR measures?

Thank you once again for the response. I really appreciate it.

If you mean that all the pairs from gt.log from 3DMatch have an overlap >30%, I don't think its completely accurate (see this https://github.com/prs-eth/OverlapPredator/issues/7)

Yes, but it is okay. This is also mentioned in the paper of Predator. However, I don't really think it is important to strictly split the data around the overlap of 30%. There is little difference between 29.9% and 30.1%. As long as the same data split are used for comparison, the results already make sense.

Do you use the example pair (0,37) from the folder 7-scenes-redkitchen in the evaluation?

I make no changes about the data split. Again, this problem is not so important as long as all baselines use the same data split.

Do you use consecutive pairs from 3DMatch in Table 8 to compute the RRE, RTE and RR measures?

Yes, all pairs are used for evaluation, following common practice.

I don't really think it is important to strictly split the data around the overlap of 30%.

I agree, this should be insignificant. However, I just want to point out that when I compute the overlap ratio using the PREDATOR code on full point clouds (PREDATOR computes the overlap on voxel-downsampled point clouds), some overlaps differ drastically. More concretely, there are now 280 examples with overlap <30%, the lowest of them having 4% of overlap. There are only 10 pairs with <10% overlap, so as you've said this is not a big issue, but surely something to know.

I make no changes about the data split. Again, this problem is not so important as long as all baselines use the same data split.

I agree, the most important thing is that all the methods have a consistent comparison.
I am closing this issue since you answered all my questions. Thank you once again. Best wishes! :)


Improve Nginx config

Me again 😆 .You are (again) using default configurations. Which is not good.
I try to come-up with again a better Nginx configuration. I don't use Apache myself, but you most likely want to fine-tune that setup as well.
m6a.xlarge might be not large enough with only 2 cores to really stress the system.
For now I set the Nginx thread pool to use only 2 threads. However, if your test environment will have 4 or 8 cores, please increase the threads in the thread pool as well as max queue and worker_connections!
Last but not least, you're not running the latest Nginx version. Try to run nginx v1.27.2

@melroy89 You created PR against 219 not the main branch :(

You can git merge into main? Or should I create another pr?

@melroy89 You created PR against 219 not the main branch :(

ow that is because I searched for the code. And only found it initially here: https://github.com/antonputra/tutorials/tree/219/lessons/219


Invalid plots for out of range data

matplotlib2tikz generates invalid plots for functions with poles. In general, if any data is far outside the plotted axis (in particular, invisible in the plot), pgfplots may stop working with an error like
! Dimension too large.
<recently read> \pgfmath@x

l.19 \end{axis}

A minimal example to reproduce this is
import matplotlib.pyplot as plt
import matplotlib2tikz as m2t
plt.plot([0.0, 1.0], [0.0, 100000.0])
plt.ylim(0, 1)
m2t.save("test.pgf")

There are several ways of handling this, all of them involving tinkering with the data. I don't like this being done automatically. I'd say the best way to deal with these problems is to manually edit the output tex file. Perhaps mpl2tikz can issue a warning or so that this may be necessary.


Add support for SMTP over SSL

I tried to run Ciao and integrate it with Sendgrid. It did work perfectly but I got Timeout errors when the ActiveMailer tried to communicate with Sendgrid SMTP server.
After some investigations, I found that I need to set ssl: true in action_mailer.smtp_settings to support SMTP over SSL which is required by Sendgrid and probably any other reliable and save SMTP server.
This PR will enable the configuration of the SMTP over SSL using SMTP_SSL environment variable. If this variable was set to any value other than [false, 0, '0', 'f', 'F', 'false', 'FALSE', 'off', 'OFF'] then it will be considered true.

Fixes #17


Changing repo owner

Cool service. Just wondering if changing the repo owner/organization would mess with the link between CLA hub and the project at all. That might happen in the near future so I want to know if I should wait to do CLA hub until then. Thanks!

This should be resolved by #123. After digging into things it appears that changing the repo owner does not require change on the Github side, but I believe that if a repo changes an owner on the GitHub side then it will break on the CLAHub side until the agreement is transferred.


bootstrap vm failes to download ocp-release-nightly image from quay

Install fails at TASK [openshift-4-cluster : Waiting bootstrap to complete]
journalctl on bootstrap node has the following error:
Sep 17 09:25:21 bootstrap release-image-download.sh[1016]: Error: error pulling image "quay.io/openshift-release-dev/ocp-release-nightly@sha256:d48a15ea564293934eb188e6eb8737e56903453d50bc70830cdac2641fb63acc": unable to pull quay.io/openshift-release-dev/ocp-release-nightly@sha256:d48a15ea564293934eb188e6eb8737e56903453d50bc70830cdac2641fb63acc: unable to pull image: Error initializing source docker://quay.io/openshift-release-dev/ocp-release-nightly@sha256:d48a15ea564293934eb188e6eb8737e56903453d50bc70830cdac2641fb63acc: pinging docker registry returned: Get https://quay.io/v2/: dial tcp <IP_ADDRESS>:443: i/o timeout
Curling the quay api fails as well on bootstrap vm:
[root@bootstrap ~]# curl -v https://quay.io/v2/

Trying <IP_ADDRESS>...
TCP_NODELAY set
connect to <IP_ADDRESS> port 443 failed: Connection timed out
Trying <IP_ADDRESS>...
TCP_NODELAY set
After 85578ms connect time, move on!
connect to <IP_ADDRESS> port 443 failed: Connection timed out
Trying <IP_ADDRESS>...
TCP_NODELAY set
After 42789ms connect time, move on!
connect to <IP_ADDRESS> port 443 failed: Connection timed out
Trying <IP_ADDRESS>...
TCP_NODELAY set
After 21394ms connect time, move on!
connect to <IP_ADDRESS> port 443 failed: Connection timed out
Trying <IP_ADDRESS>...
TCP_NODELAY set
After 10696ms connect time, move on!
connect to <IP_ADDRESS> port 443 failed: Connection timed out
Trying <IP_ADDRESS>...
TCP_NODELAY set
After 5347ms connect time, move on!
connect to <IP_ADDRESS> port 443 failed: Connection timed out
Failed to connect to quay.io port 443: Connection timed out
Closing connection 0
curl: (7) Failed to connect to quay.io port 443: Connection timed out

Curling the quay API works fine from Hetzner root server or local laptop.

As requested:
[root@hetzner ~]# virsh net-list
Name                 State      Autostart     Persistent
default              active     yes           yes
ocp                  active     yes           yes
[root@hetzner ~]# virsh net-dumpxml ocp

ocp
5c2c34fa-a670-402c-8e6d-5ed4605b65da

bootstrap.compute.local

api-int.ocp.andyneeb.com
api.ocp.andyneeb.com

master-0.compute.local
etcd-0.ocp.andyneeb.com

master-1.compute.local
etcd-1.ocp.andyneeb.com

master-2.compute.local
etcd-2.ocp.andyneeb.com

As requested
ˋˋˋ
[root@hetzner ~]# virsh net-list
Name                 State      Autostart     Persistent
default              active     yes           yes
ocp                  active     yes           yes
[root@hetzner ~]# virsh net-dumpxml ocp

ocp
5c2c34fa-a670-402c-8e6d-5ed4605b65da

bootstrap.compute.local

api-int.ocp.andyneeb.com
api.ocp.andyneeb.com

master-0.compute.local
etcd-0.ocp.andyneeb.com

master-1.compute.local
etcd-1.ocp.andyneeb.com

master-2.compute.local
etcd-2.ocp.andyneeb.com

As requested
[root@hetzner ~]# virsh net-dumpxml ocp
<network connections='7'>
  <name>ocp</name>
  <uuid>5c2c34fa-a670-402c-8e6d-5ed4605b65da</uuid>
  <forward mode='nat'>
    <nat>
      <port start='1024' end='65535'/>
    </nat>
  </forward>
  <bridge name='virbr1' stp='on' delay='0'/>
  <mac addre
```ss='52:54:00:dc:e5:f2'/>
  <domain name='compute.local'/>
  <dns>
    <srv service='etcd-server-ssl' protocol='tcp' domain='ocp.andyneeb.com' target='etcd-0.ocp.andyneeb.com' port='2380' weight='10'/>
    <srv service='etcd-server-ssl' protocol='tcp' domain='ocp.andyneeb.com' target='etcd-1.ocp.andyneeb.com' port='2380' weight='10'/>
    <srv service='etcd-server-ssl' protocol='tcp' domain='ocp.andyneeb.com' target='etcd-2.ocp.andyneeb.com' port='2380' weight='10'/>
    <host ip='<IP_ADDRESS>'>
      <hostname>bootstrap.compute.local</hostname>
    </host>
    <host ip='<IP_ADDRESS>'>
      <hostname>api-int.ocp.andyneeb.com</hostname>
      <hostname>api.ocp.andyneeb.com</hostname>
    </host>
    <host ip='<IP_ADDRESS>'>
      <hostname>master-0.compute.local</hostname>
      <hostname>etcd-0.ocp.andyneeb.com</hostname>
    </host>
    <host ip='<IP_ADDRESS>'>
      <hostname>master-1.compute.local</hostname>
      <hostname>etcd-1.ocp.andyneeb.com</hostname>
    </host>
    <host ip='<IP_ADDRESS>'>
      <hostname>master-2.compute.local</hostname>
      <hostname>etcd-2.ocp.andyneeb.com</hostname>
    </host>
  </dns>
  <ip address='<IP_ADDRESS>' netmask='<IP_ADDRESS>'>
    <dhcp>
      <range start='<IP_ADDRESS>' end='<IP_ADDRESS>'/>
      <host mac='52:54:00:a8:32:02' name='bootstrap.compute.local' ip='<IP_ADDRESS>'/>
      <host mac='52:54:00:a8:32:0a' name='master-0.compute.local' ip='<IP_ADDRESS>'/>
      <host mac='52:54:00:a8:32:0b' name='master-1.compute.local' ip='<IP_ADDRESS>'/>
      <host mac='52:54:00:a8:32:0c' name='master-2.compute.local' ip='<IP_ADDRESS>'/>
      <host mac='52:54:00:a8:32:0d' name='compute-0.compute.local' ip='<IP_ADDRESS>'/>
      <host mac='52:54:00:a8:32:0e' name='compute-1.compute.local' ip='<IP_ADDRESS>'/>
      <host mac='52:54:00:a8:32:0f' name='compute-2.compute.local' ip='<IP_ADDRESS>'/>
    </dhcp>
  </ip>
</network>

@andyneeb please try: sysctl -w net.ipv4.conf.<PUBLIC INTERFACE>.forwarding=1 to enable ip forwaring on the public interface. (I had the same problem with my new hetzner box and sysctl -w net.ipv4.conf.enp4s0.forwarding=1 solved the problem.)

@rbo indeed ip forwarding on the public solves the vms connectivity issue (i can ping public hosts, which i couldn't before).
however the playbook or more likely installation of libvirt networks disables that behavior. so simply enabling forwarding and running install won't work as forwarding is being disabled during install
i try to dig a little bit deeper over the weekend

I have exactly the same problem. Added net.ipv4.conf.enp4s0.forwarding=1 to /etc/sysctl.conf run sysctl -p and reboot the host. Running the playbooks set net.ipv4.conf.enp4s0.forwarding back to 0....

Making some progress.
Activating the network in create-network.yml (step name: Active network {{ cluster_name }}) disables forwarding on the public interface.
So as a quick workaround I added
- sysctl:     name: net.ipv4.conf.enp0s31f6.forwarding     value: 1     sysctl_set: yes     state: present     reload: yes
which started the bootstrap process and downloading of images.
While waiting on etcd to start something (???) disabled ip forwarding again. I am pretty lost what might be the cause since at this point the playbook simply idles and waits for the api to come up.
Anyways manually enabling forwarding again did the trick, the bootstrap node picked up again and finished.

It looks like hetzner installimage use systemd.network and create /etc/systemd/network/10-mainif.network if you add IPForward=ipv4 to the [Network] part it solve our problem permanently.
My  /etc/systemd/network/10-mainif.network configuration:
### Hetzner Online GmbH installimage
[Match]
MACAddress=xxxxx

[Network]
Address=2a01:4f8:211:116::2/64
Gateway=<IP_ADDRESS>
Gateway=fe80::1
IPForward=ipv4

[Address]
Address=xxxxx
Peer=xxxxx

The code in hetzneronline/installimage is not new:

https://github.com/hetzneronline/installimage/blob/master/network_config.functions.sh#L677
https://github.com/hetzneronline/installimage/blob/master/network_config.functions.sh#L729

I don't know why this affects only our new hetzner server.

Might be related to datacenter?

@rbo confirmed. Fixed it for me as well. Thx.
It did NOT affect my server 10 days ago. Since this repo did not change, my server did not change, Hetzner install process did not change I am suspecting a CentOS package that got updated since then.

I reinstall my old hetzner server with a fresh Centos 7.6 installation and indeed the /etc/systemd/network/10-mainif.network appear.

For me the problem is solved - closed.


Create temporary security group in the same VPC as the subnet

When a subnet is specified but security groups are not, create the
temporary security group in the VPC of the given subnet.  When both are
specified, make sure that they are in the same VPC.
Change the return type of create_security_group(), so that it returns an
object instead of an id.  This is consistent with the other create_xxx()
methods in AWSService.
Remove log level cruft from command_encrypt_ami().  We initialize
logging in main().

lgtm


[BUG] CSS styles from global.css not applied in any starter

Qwik Version
0.0.30
Operating System (or Browser)
Linux 5.18.6, Chromium 103.0.5060.53
Node Version (if applicable)
18.3.0
Which component is affected?
Starters / CLI
Expected Behaviour
The global styles should be applied, in both, DEV and SSR builds
Actual Behaviour
The styles are never added to the websites. They only seem to be applied when loaded e. g. via useStyles$.
Additional Information
A workaround seems to add the styles to a component$ using useStyles$, which is also how it currently works in the packages/docs project:
import styles from '../../global.css';

import { component$, useStyles$ } from<EMAIL_ADDRESS>
export const App = component$(() => {
  useStyles$(styles)
  // [...]
})

Related (were closed although not solved, this issue is now the follow-up):

https://github.com/BuilderIO/qwik/issues/583
https://github.com/BuilderIO/qwik/issues/626

I hope this time we will be able to fix it before closing it prematurely!
Reproduction

npm init qwik@latest
Project Name -> qwik-app
Select a Starter -> Starter
Select a Server -> Setup later
Features -> Prettier
cd qwik-app
npm install
npm start
Add html { background-color: red } to global.css
Open localhost:3000 - no red background visible, rule not applied :sad

I think it works now if the CSS module is included in the entry module, in my case entry.ssr.tsx or entry.dev.tsx. If it is included in root.tsx or app.tsx, it does not work.

fixed by https://github.com/BuilderIO/qwik/commit/1dcf329a1b7654e56642e7bac26e4610073ebe12


regex to replace function block during extract doesn't work properly

In
commands/extract-extension.js
the function 'cleanUpScriptString' doesn't properly replace the opening 'function {' and closing bracket ('}').  Suggest we simplify the regex to instead only replace the opening part with empty string, and then in a second replace call deal with the closing bracket.  Currently we match the whole function and replace it with the body, and I believe the negative lookahead we're using doesn't work

Issue has been fixed!


(FACT-1478) EC2 facts intermittently unavailable due to overly optimistic timeouts

CLA signed by all contributors.

👍 From me and @Magisus


PostgreSQL getting connection info slowing down tracing

How do you use Sentry?
Sentry Saas (sentry.io)
Version
2.14.0
Steps to Reproduce

Use sentry-sdk with Django integration.
Profile a view with doing several SQL queries.
Notice there is expanduser shown on top of “Slowest Application Functions” in Sentry.

Expected Result
We don't invoke expanduser at all, so it should not be there. Definitely it should not be on top of the list, taking more time than template rendering.
Actual Result
expanduser being identified by Sentry as the slowest thing on this view:

Profile trace:

This seems to be invoked for each SQLCompiler.execute_sql invocation, so for every SQL query.
It is invoked from here:
https://github.com/getsentry/sentry-python/blob/dce589ca49a8e0e2d4eda3839836de6d8188f17b/sentry_sdk/integrations/django/__init__.py#L705
The expanduser then comes from psycopg3 via Path.home():
https://github.com/psycopg/psycopg/blob/af5bfa0ec2690571033e38205a98cfc8c6287134/psycopg/psycopg/_connection_info.py#L86

@nijel Thanks for writing in.
I am lacking full context on your problem, but from what you have shared so far, I think it is possible that what you are observing is expected. The profiler records the entire contents of the call stack over time (with a resolution of ~10ms, meaning that shorter function calls might be missed), so it is fully expected that some functions that are called not directly by you, but rather by libraries (for example, the expanduser here), could show up in your profile.
Does that make sense to you, or am I missing something here? If you still think what you are seeing is wrong, could you please provide more detail on what you are actually seeing, and what you would expect to see? It would be extremely helpful if you could link the page where you took the screenshot

What I think is wrong is that Sentry SDK gets PostgreSQL connection info with each SQL query executed makings it's overhead too big. Caching info per Django connection would heavily improve this (typically there is just one database connection in a request).

@nijel Ah okay, I see now. The problem is that the Sentry SDK is slowing down your app, and you discovered this through profiling, correct?
From the profile you shared, it does indeed look like the SDK is calling the slow function.

Yes, unfortunately psycopg3 get_parameters is not really an instant because it tries to be smart to return only changed parameters from the defaults. One of the steps leads to expanding the user home directory. A single call would not be noticeable, but Sentry SDK does it each SQL query which was executed, making it visible on views that make plenty of SQL queries.

https://github.com/getsentry/sentry-python/pull/3580 is my attempt to address this.

Thanks!


Some Stage Editor bugs

Describe your bug here.
guys, I went to download the new update from Psych to create ports to the mod folder for fun, but it has some pretty bad bugs
https://github.com/user-attachments/assets/1552f869-deb8-4160-a724-48eff5c73bbd
https://github.com/user-attachments/assets/00b51773-42bc-4a54-82c0-5e94c4b7fba7
Command Prompt/Terminal logs (if existing)
No response
Are you modding a build from source or with Lua?
Lua
What is your build target?
Windows
Did you edit anything in this build? If so, mention or summarize your changes.
No

The first one needs to be fixed asap, it essentially makes the stage editor unusable

Pensé que era el primero en reportar esto pero es real, en ciertas circunstancias eso no pasa como cuando los assets están solo en la carpeta "images"
I thought I was the first to report this but it is real, in certain circumstances that does not happen like when the assets are only in the "images" folder


Eval is not printing resulting disjunction correctly

What version of CUE are you using (cue version)?

$ cue version
cue version 0.4.0-beta.1 darwin/amd64

Does this issue reproduce with the latest release?
Yes
What did you do?

$ cat <<EOF > foo.cue
a: *1 | int
b: *2 | int
c: *(a & b) | 3

$ cat eval foo.cue

What did you expect to see?
a: 1
b: 2
c: 3

What did you see instead?
a: 1
b: 2
c: _|_

This issue has been migrated to https://github.com/cue-lang/cue/issues/950.
For more details about CUE's migration to a new home, please see https://github.com/cue-lang/cue/issues/1078.


Rename the repository to avoid confusion with Docker images

Docker images become somewhat as important as the Jenkins server in the project, and it would be great to rename the repo to avoid confusion. E.g. "librecores-ci-jenkins" or whatever

Now it is https://github.com/librecores/librecores-ci-jenkins-server


[CLOSED] Partial record selectors shouldn't use error

 Issue by sweirich
Thursday Dec 07, 2017 at 12:23 GMT
Originally opened as https://github.com/antalsz/hs-to-coq/issues/62

Once we get our partiality story more firm (default ? inhabited ? patternFailure?) we should update these selectors.
We should also allow edits to skip them.

 Comment by sweirich
Thursday Mar 15, 2018 at 00:30 GMT

The first part of this is closed.  But we don't have skip edits yet.

 Comment by sweirich
Saturday Mar 17, 2018 at 15:30 GMT

Closing and replacing with new issue.


BUG - ui5-proxy-middleware crashes on startup if the cwd is not the root of the project

Related Feature
Feature request: issue number
Description
If you have a project with the ui5-proxy-middleware configured in the ui5.yaml and you start it from the outside e.g. ui5 server --config ./my-project/ui5.yaml then the middleware crashes when trying to find the manifest.json.
Steps to Reproduce
Steps to reproduce the behavior:

Generate a project with the SAP Fiori generator
(install the ui5 cli globally)
Run ui5 serve outside the project directory but pointing to the config inside
See error

Expected results
The preview starts as expected,
Actual results
The middleware crashes because it cannot find the manifest.json to read the minUI5Version
Expected fix
This issue requires two fixes

Don't rely on the cwd but use the ui5 tooling provided fs to find project files
Even if a manifest.json is not found e.g. for an adaptation project, the middleware should not crash but just assume the latest UI5 version

Additional Information
Conversation with @petermuessig

The problematic code is the following here which just relies on the current working directory as you also mentioned above:
https://github.com/SAP/open-ux-tools/blob/main/packages/ui5-proxy-middleware/src/base/utils.ts#LL199C11-L199C22
If your middleware would work with the UI5 tooling version 3.0 only, you could run the following code to determine the project root in your custom middleware:
middlewareUtil.getProject().getRootPath()

If you need to support the old and the newer version in parallel having a specVersion < 3.0 then you may do the same workaround as I did in the transpile middleware / task:
https://github.com/ui5-community/ui5-ecosystem-showcase/blob/main/packages/ui5-tooling-transpile/lib/util.js#L291-L307
This function requires the project root collection to be passed, e.g.:
https://github.com/ui5-community/ui5-ecosystem-showcase/blob/main/packages/ui5-tooling-transpile/lib/middleware.js#L31

Screenshots
If applicable, add screenshots to help explain the problem.
Version/Components/Environment
Add any other context about the problem here
OS:

[ ] Mac OS
[ ] Windows
[ ] Other

Root Cause Analysis
Problem
{describe the problem}
Fix
{describe the fix}
Why was it missed
{Some explanation why this issue might have been missed during normal development/testing cycle}
How can we avoid this
{if we don’t want to see this type of issues anymore what we should do to prevent}

Fixed with #1054


[Bug]: JSONQueryEngine Exception - Parse Error at $s near token

Bug Description
The parameter llm_output of function default_output_processor can be a string of:

query instructions ("JSONPath Instructions...")
the final response from the engine, not the expected JSON Path (E.g. $.pages[*].url).

Exception: jsonpath_ng: Exception: Parse error at 1:5 near token task (ID)
Version
0.8.14
Steps to Reproduce

Setup JSONQueryEngine as usual with json_value, json_schema, and service context
Perform querying using .query()

The bug doesn't occur often, so that it might take some time.
Pay attention to the llm_output of  default_output_processor
Note: I have to use a custom output processor that mimics the default function to see the issue.
Relevant Logs/Tracbacks
  File "/virtualenv/texasfile/lib/python3.8/site-packages/llama_index/tools/query_engine.py", line 54, in call
    response = self._query_engine.query(query_str)
  File "/virtualenv/texasfile/lib/python3.8/site-packages/llama_index/indices/query/base.py", line 23, in query
    response = self._query(str_or_query_bundle)
  File "/virtualenv/texasfile/lib/python3.8/site-packages/llama_index/query_engine/transform_query_engine.py", line 79, in _query
    return self._query_engine.query(query_bundle)
  File "/virtualenv/texasfile/lib/python3.8/site-packages/llama_index/indices/query/base.py", line 23, in query
    response = self._query(str_or_query_bundle)
  File "/virtualenv/texasfile/lib/python3.8/site-packages/llama_index/indices/struct_store/json_query.py", line 116, in _query
    json_path_output = self._output_processor(
  File "/virtualenv/texasfile/lib/python3.8/site-packages/llama_index/indices/struct_store/json_query.py", line 48, in default_output_processor
    datum: List[DatumInContext] = parse(llm_output).find(json_value)
  File "/virtualenv/texasfile/lib/python3.8/site-packages/jsonpath_ng/ext/parser.py", line 172, in parse
    return ExtentedJsonPathParser(debug=debug).parse(path)
  File "/virtualenv/texasfile/lib/python3.8/site-packages/jsonpath_ng/parser.py", line 45, in parse
    return self.parse_token_stream(lexer.tokenize(string))
  File "/virtualenv/texasfile/lib/python3.8/site-packages/jsonpath_ng/parser.py", line 69, in parse_token_stream
    return new_parser.parse(lexer = IteratorToTokenStream(token_iterator))
  File "/virtualenv/texasfile/lib/python3.8/site-packages/ply/yacc.py", line 333, in parse
    return self.parseopt_notrack(input, lexer, debug, tracking, tokenfunc)
  File "/virtualenv/texasfile/lib/python3.8/site-packages/ply/yacc.py", line 1201, in parseopt_notrack
    tok = call_errorfunc(self.errorfunc, errtoken, self)
  File "/virtualenv/texasfile/lib/python3.8/site-packages/ply/yacc.py", line 192, in call_errorfunc
    r = errorfunc(token)
  File "/virtualenv/texasfile/lib/python3.8/site-packages/jsonpath_ng/parser.py", line 83, in p_error
    raise JsonPathParserError('Parse error at %s:%s near token %s (%s)'
jsonpath_ng.exceptions.JsonPathParserError: Parse error at 1:5 near token task (ID)

I am experiencing the same error sometimes. Digging into the llm_output it might be a hint that the stated problems seems to be a bad match for the json query engine.

llm_output=The task provided seems to be more related to data processing or machine learning, which involves creating new categories (codes) based on the provided cells. This is not something that can be achieved using JSONPath.
JSONPath is a query language for JSON, similar to XPath for XML, and it's used to retrieve data from a JSON document, not to process or generate new data.
...


Delete subaddresses when geocoded melissa data indicates none exist

See issue #1 for background.
When geocoded melissa data indicates no subaddresses exist for an address point and CSCL has subaddresses, delete the CSCL subaddresses.

Reminder - the code to ID the address points existed prior to this commit:
https://github.com/mattyschell/cscl-subaddress-matched/commit/dba9026c7c2550a2a4d086d85f6dbc1b59fc7454


FBAudienceNetwork doesn't work > 6.15.2

As also mentioned in this stack overflow topic. The current pod updates above version 6.15.2 which gives the following error:
Xcode build done.                                           36.8s
Failed to build iOS app
Error (Xcode): Undefined symbol: __swift_FORCE_LOAD_$_swift_Builtin_float

Error (Xcode): Undefined symbol: __swift_FORCE_LOAD_$_swift_errno

Error (Xcode): Undefined symbol: __swift_FORCE_LOAD_$_swift_math

Error (Xcode): Undefined symbol: __swift_FORCE_LOAD_$_swift_signal

Error (Xcode): Undefined symbol: __swift_FORCE_LOAD_$_swift_stdio

Error (Xcode): Undefined symbol: __swift_FORCE_LOAD_$_swift_time

Error (Xcode): Undefined symbol: __swift_FORCE_LOAD_$_swiftsys_time

Error (Xcode): Undefined symbol: __swift_FORCE_LOAD_$_swiftunistd

Error (Xcode): Linker command failed with exit code 1 (use -v to see
invocation)

currently I can still build by forcing my podfile.lock to version 6.15.2   - FBAudienceNetwork (6.15.2)
can you force the version to 6.15.2 or see what changes are brought in version 6.16.0

same issue here


Exits without any error message

I just try to fire up this thing, following the docs in USAGE.md, and it just exits without any particular error:
Attempt #1

 docker run \
  --env LICENSE=accept \
  --env MQ_QMGR_NAME=QM1 \
  --publish 1414:1414 \
  --publish 9443:9443  \
  --volume qm1data:/mnt/mqm \
  icr.io/ibm-messaging/mq
WARNING: The requested image's platform (linux/amd64) does not match the detected host platform (linux/arm64/v8) and no specific platform was requested
2024-05-27T10:36:17.409Z CPU architecture: amd64
2024-05-27T10:36:17.411Z Linux kernel version: 6.6.26-linuxkit
2024-05-27T10:36:17.412Z Container runtime: not-found
2024-05-27T10:36:17.412Z Base image: Red Hat Enterprise Linux 8.9 (Ootpa)
2024-05-27T10:36:17.412Z Running as user ID 1001 with primary group 0, and supplementary groups 0
2024-05-27T10:36:17.413Z Capabilities (bounding set): chown,dac_override,fowner,fsetid,kill,setgid,setuid,setpcap,net_bind_service,net_raw,sys_chroot,mknod,audit_write,setfcap
2024-05-27T10:36:17.414Z seccomp enforcing mode: disabled
2024-05-27T10:36:17.414Z Process security attributes: none
2024-05-27T10:36:17.414Z Detected 'ext4' volume mounted to /mnt/mqm

Container runtime: not-found

Not sure what "Container runtime: not-found", but it continues past that, so not important?
Attempt #2
Doing it again, this time supplying the platform parameter does the same thing, except one additional error (?) message:

❯ docker run   --env LICENSE=accept   --env MQ_QMGR_NAME=QM1   --publish 1414:1414   --publish 9443:9443    --volume qm1data:/mnt/mqm --platform linux/amd64   icr.io/ibm-messaging/mq
2024-05-27T10:40:42.162Z CPU architecture: amd64
2024-05-27T10:40:42.164Z Linux kernel version: 6.6.26-linuxkit
2024-05-27T10:40:42.165Z Container runtime: not-found
2024-05-27T10:40:42.165Z Base image: Red Hat Enterprise Linux 8.9 (Ootpa)
2024-05-27T10:40:42.165Z Running as user ID 1001 with primary group 0, and supplementary groups 0
2024-05-27T10:40:42.166Z Capabilities (bounding set): chown,dac_override,fowner,fsetid,kill,setgid,setuid,setpcap,net_bind_service,net_raw,sys_chroot,mknod,audit_write,setfcap
2024-05-27T10:40:42.167Z seccomp enforcing mode: disabled
2024-05-27T10:40:42.167Z Process security attributes: none
2024-05-27T10:40:42.167Z Detected 'ext4' volume mounted to /mnt/mqm
2024-05-27T10:40:42.244Z You cannot run more than one instance of this program

You cannot run more than one instance of this program

The You cannot run more than one instance of this program bit seems to indicate I am running an instance already, but there is no image running:
❯ docker ps | grep mq | wc -l
       0

SystemInfo
❯ npx -y envinfo  --system

  System:
    OS: macOS 14.4.1
    CPU: (12) arm64 Apple M2 Max
    Memory: 812.11 MB / 64.00 GB
    Shell: 5.2.26 - /opt/homebrew/bin/bash

There isn't a pre-built MQ Advanced for Developers image available for arm64, and the CPU emulation which Docker uses has a bug which prevents you from using the amd64 image on arm64.  See #476 and #492.  So you have two choices:

Use Podman 5.x instead of Docker, which allows you to run the amd64 image on arm64.
Build your own arm64 image: https://github.com/ibm-messaging/mq-container/blob/master/docs/building.md#building-a-developer-image

Following the instructions blindly did not work, as for some reason it did not find the image locally afterwards, so here's my adjustments for the next wanderer:
Trimmed output from docker images:

REPOSITORY                                TAG             IMAGE ID       CREATED              SIZE
ibm-mqadvanced-server-dev                 <IP_ADDRESS>-arm64   670c8c93f633   About a minute ago   1.53GB

AOK, it seems?
But alas:
ph-nbm-notification-batch-v1 on  master [$] via 🐳 desktop-linux is 📦 v1.0.203 via 🅶 v8.1 via ☕ v17 on ☁   (eu-north-1) on ☁
❯ docker run   --env LICENSE=accept   --env MQ_QMGR_NAME=QM1     ibm-mqadvanced-server-dev:<IP_ADDRESS>-arm64
Unable to find image 'ibm-mqadvanced-server-dev:<IP_ADDRESS>-arm64' locally
docker: Error response from daemon: pull access denied for ibm-mqadvanced-server-dev, repository does not exist or may require 'docker login': denied: requested access to the resource is denied.

It seems the previous starting of the non-developer image somehow screwed things up, as everything worked after deleting all existing containers and images. Upon doing that, everything worked fine:
❯ docker run   --env LICENSE=accept   --env MQ_QMGR_NAME=QM1     ibm-mqadvanced-server-dev:<IP_ADDRESS>-arm64
2024-05-29T09:44:59.895Z CPU architecture: arm64
2024-05-29T09:44:59.895Z Linux kernel version: 6.6.26-linuxkit
2024-05-29T09:44:59.895Z Container runtime: not-found
2024-05-29T09:44:59.895Z Base image: Red Hat Enterprise Linux 8.9 (Ootpa)
2024-05-29T09:44:59.895Z Running as user ID 1001 with primary group 0, and supplementary groups 0
2024-05-29T09:44:59.895Z Capabilities (bounding set): chown,dac_override,fowner,fsetid,kill,setgid,setuid,setpcap,net_bind_service,net_raw,sys_chroot,mknod,audit_write,setfcap
2024-05-29T09:44:59.895Z seccomp enforcing mode: disabled
2024-05-29T09:44:59.895Z Process security attributes: none
2024-05-29T09:44:59.895Z No volume detected. Persistent messages may be lost
2024-05-29T09:44:59.902Z Using queue manager name: QM1
2024-05-29T09:44:59.939Z Created directory structure under /var/mqm
2024-05-29T09:44:59.939Z Image created: 2024-05-29T09:29:34+00:00
2024-05-29T09:44:59.939Z Image tag: ibm-mqadvanced-server-dev:<IP_ADDRESS>-arm64
2024-05-29T09:44:59.946Z MQ version: <IP_ADDRESS>
2024-05-29T09:44:59.946Z MQ level: p935-001-240405
2024-05-29T09:44:59.946Z MQ license: Developer
2024-05-29T09:45:03.074Z FIPS cryptography is not enabled.
2024-05-29T09:45:03.074Z Creating queue manager QM1
2024-05-29T09:45:03.074Z Starting web server
2024-05-29T09:45:03.696Z product = WebSphere Application Server <IP_ADDRESS> (wlp-1.0.84.cl231220231127-1901)\nwlp.install.dir = /opt/mqm/web/\nserver.config.dir = /mnt/mqm/data/web/installations/Installation1/servers/mqweb/\njava.home = /opt/mqm/java/jre64/jre\njava.version = 1.8.0_392\njava.runtime = IBM Semeru Runtime Open Edition (1.8.0_392-b08)\nos = Linux (6.6.26-linuxkit; aarch64) (en_US)\nprocess =<EMAIL_ADDRESS>= /opt/mqm/web/bin/tools/ws-server.jar:/opt/mqm/web/bin/tools/ws-javaagent.jar\nJava Library path = /opt/mqm/java/jre64/jre/lib/aarch64/default:/opt/mqm/java/jre64/jre/lib/aarch64:/opt/mqm/java/lib64:/opt/mqm/lib64:/opt/mqm/lib:/usr/lib64:/usr/lib\n
2024-05-29T09:45:03.721Z CWWKE0001I: The server mqweb has been launched.
2024-05-29T09:45:03.907Z Created queue manager
2024-05-29T09:45:03.911Z Starting queue manager
2024-05-29T09:45:03.250Z AMQ6287I: IBM MQ V<IP_ADDRESS> (p935-001-240405). [CommentInsert1(Linux 6.6.26-linuxkit (MQ Linux (ARM 64-bit platform) 64-bit)), CommentInsert2(/opt/mqm (Installation1)), CommentInsert3(<IP_ADDRESS> (p935-001-240405))]
2024-05-29T09:45:03.322Z AMQ7229I: 4 log records accessed on queue manager 'QM1' during the log replay phase. [ArithInsert1(4), CommentInsert1(QM1)]
....


use trusted proxy list instead of cloudflare proxy header cause it works better

basically if you use TRUST_PROXY_LIST_PATH=cfaddresses.txt fastify will only trust proxy if the ip sending the request is cloudflare so people can't spoof ips
comes with cfaddresses.txt cause i know bob uses cloudflare
added support for # comments to the file cause why not

Goodbye merge conflicts :)


[Bug]: 404 error at URL: /txns/GMOt1X5J6b3LV8QzmQ7NAkJZpPCf_C0zUb8TXihyFdI

What happened?
A bug happened! Pending transaction is not being cleared on the Helium app. Unable to send tokens to wallet.
URL
https://explorer.helium.com/txns/GMOt1X5J6b3LV8QzmQ7NAkJZpPCf_C0zUb8TXihyFdI
What browsers are you seeing the problem on?
Chrome
Do you see the issue on Mobile or Desktop?
No response
Relevant log output
No response

this looks fixed


as icon set to be inside; the icon is not correctly displayed

The following is a screen dump; you can see the search icon of location input text field was moved to the left bottom corner now.

`final private LocationTextField ltf = new LocationTextField<>(GoogleGeocoder.getInstance());
final private Button find = new Button("Find");
final private CssLayout findByLocation = new CssLayout(ltf, find);
final private GoogleMap googleMap = new GoogleMap(apiKey, null, null);
final private Panel mapPanel = new Panel(googleMap);
@Autowired
private YardService yardService;
public FindView() {
super.setSizeFull();
super.setMargin(true);
super.setSpacing(true);
super.addComponents(findByLocation, mapPanel);
mapPanel.setSizeFull();
setLtf();
setMap();

}
private void setLtf() {
//ltf.setCaption("Find a shared Yard closing to you");
ltf.setWidth("400px");
ltf.setInputPrompt("Insert an location: ");
ltf.setStyleName(ValoTheme.TEXTFIELD_INLINE_ICON);
ltf.setIcon(VaadinIcons.SEARCH);
ltf.addLocationValueChangeListener((HasValue.ValueChangeEvent<GeocodedLocation> e) -> {
    googleMap.clearMarkers();
    LatLon ll = new LatLon(e.getValue().getLat(), e.getValue().getLon());
    setMapCenter(ll);
    setMapMarker(ll);
});

ltf.setDelay(800);

ltf.setLocation(new GeocodedLocation());

}`

I unfortunately don't have time to review this.  it sounds like your CSS is
getting messed up.  PRs are welcome!
Regards,
Mark Thomas
<EMAIL_ADDRESS>205.529.9013
"Commit to the Lord whatever you do,
and your plans will succeed." - Proverbs 16:3
On Wed, Sep 27, 2017 at 2:45 PM, Yichun Zhao<EMAIL_ADDRESS>wrote:

The following is a screen dump; you can see the search icon of location
input text field was moved to the left bottom corner now.
[image: image]
https://user-images.githubusercontent.com/17804600/30934150-f5fceb7c-a3cc-11e7-84bd-0fcceea427e7.png
`final private LocationTextField ltf = new LocationTextField<>(
GoogleGeocoder.getInstance());
final private Button find = new Button("Find");
final private CssLayout findByLocation = new CssLayout(ltf, find);
final private GoogleMap googleMap = new GoogleMap(apiKey, null, null);
final private Panel mapPanel = new Panel(googleMap);
@Autowired https://github.com/autowired
private YardService yardService;
public FindView() {
super.setSizeFull();
super.setMargin(true);
super.setSpacing(true);
super.addComponents(findByLocation, mapPanel);
mapPanel.setSizeFull();
setLtf();
setMap();
}
private void setLtf() {
//ltf.setCaption("Find a shared Yard closing to you");
ltf.setWidth("400px");
ltf.setInputPrompt("Insert an location: ");
ltf.setStyleName(ValoTheme.TEXTFIELD_INLINE_ICON);
ltf.setIcon(VaadinIcons.SEARCH);
ltf.addLocationValueChangeListener((HasValue.ValueChangeEvent e) -> {
googleMap.clearMarkers();
LatLon ll = new LatLon(e.getValue().getLat(), e.getValue().getLon());
setMapCenter(ll);
setMapMarker(ll);
});
ltf.setDelay(800);
ltf.setLocation(new GeocodedLocation());
}`
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/markathomas/LocationTextField/issues/10, or mute the
thread
https://github.com/notifications/unsubscribe-auth/AAd0GFSYSOC5iPQi4wQhvJN2_Y3UgMU5ks5smqXtgaJpZM4PmTFI
.


Test parameter save/load related to the BI Revive System.

As the BI Revive System Parameters (brought by BI itself) are executing functions on missionstart it has to be tested if you can alter these settings after missionstart with another function call or similar.
This would be an important thing for people who use ACE and need to reliable deactivate the BI Revive System (currently via editing the default value in the mission_params.hpp).

Thanks for already looking into it. I'll have a look at it at the weekend. I've not that much time as expected today and tomorrow.


Add replit login loop script

Thanks but I wasn't really looking for a review for this, a lot of this code is copy pasted from another script in the repo and it isn't intended for landing, I should have marked this a draft.


docker image

are docker images available for this? this would be useful so it could be configured via environment variables

all of the options you would need to usually put in a configuration file

FROM debian:latest
WORKDIR /ff_giga
ADD ff_giga /ff_giga/.
RUN chmod +x /ff_giga/ff_giga
RUN ln -s /ff_giga/ff_giga /usr/bin/ff_giga
CMD ["/bin/bash","-c","/usr/bin/ff_giga run -m cli"]
Then make a docker build .
You need prepare a config file and mount it as a volume each time to your container. Not a big deal if you know docker well.


Audio does not work in iOS 12

Hi guys! We use your SDK for video chat and faced with the problem that is described below.
Description
By event from android device server creating room for two devices (android and iOS). The server creates a room for video call and sends room id to mobile clients. Mobile clients after receiving the room are connected to it. But when we use device with iOS 12 there no audio in video call. At same time in iOS 11 with same code we don't have such problem.
Steps to Reproduce

Android device initiates video call
The server creates the room and send it to the mobile clients
iOS device gets push notification with room id and shows a call with CallKit. After the user takes the call we join to the room
Video Call is established but participants do not hear each other

Code
Just using the quickstart code. If you need some code example we are ready to provide them.
Expected Behavior
The Video Call is established and participants hear each other.
Actual Behavior
The Video Call is established and participants see but do not hear each other in iOS 12.
Reproduces How Often
100%
Logs
If logs are needed what level and at what point are logs needed?
Versions
Devices:
iPhone X running 12.0.1
android version 4.4.2
SDKs:
iOS SDK Version 2.7.0
android SDK (Version 2.0.2)
server php SDK (Version 5.21.0)

Hi Twilio Team! Faced with the same problem, this is the only thing that stops our team from release. We hope for your efficiency and help in the decision.

Hi @vkey,
It looks like you closed the issue, were you able to figure out why the iOS device was not producing audio?

If logs are needed what level and at what point are logs needed?

Usually debug level logs from before you connect, to after the problem occurred would be good.
Hi @polurezov8,

Faced with the same problem, this is the only thing that stops our team from release.

We aren't aware of any blanket issues where audio simply doesn't work on iOS 12. Can you please be more specific about what you are trying, with what hardware, version of our SDK, and what code (is it also 2.7.0)? If the issue is reproducible on our QuickStart, what steps should I take?
Best,
Chris


HBASE-23896 Snapshot owner cannot delete snapshot when ACL is enabled…

… and Kerberos is not enabled

:confetti_ball: +1 overall

Vote
Subsystem
Runtime
Comment

+0 :ok:
reexec
0m 33s
Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  0s
No case conflicting files found.

+1 :green_heart:
hbaseanti
0m  0s
Patch does not have any anti-patterns.

+1 :green_heart:
@author
0m  0s
The patch does not contain any @author tags.

-0 :warning:
test4tests
0m  0s
The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.

_ master Compile Tests _

+1 :green_heart:
mvninstall
5m 33s
master passed

+1 :green_heart:
compile
0m 57s
master passed

+1 :green_heart:
checkstyle
1m  8s
master passed

+1 :green_heart:
shadedjars
4m 41s
branch has no errors when building our shaded downstream artifacts.

+1 :green_heart:
javadoc
0m 39s
master passed

+0 :ok:
spotbugs
4m 23s
Used deprecated FindBugs config; considering switching to SpotBugs.

+1 :green_heart:
findbugs
4m 22s
master passed

_ Patch Compile Tests _

+1 :green_heart:
mvninstall
4m 58s
the patch passed

+1 :green_heart:
compile
0m 59s
the patch passed

+1 :green_heart:
javac
0m 59s
the patch passed

+1 :green_heart:
checkstyle
1m  7s
the patch passed

+1 :green_heart:
whitespace
0m  0s
The patch has no whitespace issues.

+1 :green_heart:
shadedjars
4m 44s
patch has no errors when building our shaded downstream artifacts.

+1 :green_heart:
hadoopcheck
16m  4s
Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.

+1 :green_heart:
javadoc
0m 38s
the patch passed

+1 :green_heart:
findbugs
4m 34s
the patch passed

_ Other Tests _

+1 :green_heart:
unit
62m 40s
hbase-server in the patch passed.

+1 :green_heart:
asflicense
0m 37s
The patch does not generate ASF License warnings.

120m 50s

Subsystem
Report/Notes

Docker
Client=19.03.6 Server=19.03.6 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1211/1/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hbase/pull/1211

Optional Tests
dupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile

uname
Linux 47bd97fe1f10 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 GNU/Linux

Build tool
maven

Personality
/home/jenkins/jenkins-slave/workspace/Base-PreCommit-GitHub-PR_PR-1211/out/precommit/personality/provided.sh

git revision
master / ecbed33092

Default Java
1.8.0_181

Test Results
https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1211/1/testReport/

Max. process+thread count
9387 (vs. ulimit of 10000)

modules
C: hbase-server U: hbase-server

Console output
https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1211/1/console

versions
git=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11

Powered by
Apache Yetus 0.11.1 https://yetus.apache.org

This message was automatically generated.

hi @wchevreuil, Is the given user only the owner of the table and don't have the all global permissions?

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Comment

+0 :ok:
reexec
1m 26s
Docker mode activated.

_ Patch Compile Tests _

+1 :green_heart:
mvninstall
7m  5s
the patch passed

+1 :green_heart:
compile
1m 12s
the patch passed

+1 :green_heart:
javac
1m 12s
the patch passed

+1 :green_heart:
shadedjars
5m 30s
patch has no errors when building our shaded downstream artifacts.

-0 :warning:
javadoc
0m 40s
hbase-server in the patch failed.

_ Other Tests _

-0 :warning:
unit
96m 17s
hbase-server in the patch failed.

130m 19s

Subsystem
Report/Notes

Docker
Client=19.03.8 Server=19.03.8 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1211/2/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile

GITHUB PR
https://github.com/apache/hbase/pull/1211

Optional Tests
javac javadoc unit shadedjars compile

uname
Linux 8f5eba3593f0 4.15.0-74-generic #84-Ubuntu SMP Thu Dec 19 08:06:28 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/hbase-personality.sh

git revision
master / f66cbe1a40

Default Java
2020-01-14

javadoc
https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1211/2/artifact/yetus-jdk11-hadoop3-check/output/branch-javadoc-hbase-server.txt

javadoc
https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1211/2/artifact/yetus-jdk11-hadoop3-check/output/patch-javadoc-hbase-server.txt

unit
https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1211/2/artifact/yetus-jdk11-hadoop3-check/output/patch-unit-hbase-server.txt

Test Results
https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1211/2/testReport/

Max. process+thread count
4509 (vs. ulimit of 10000)

modules
C: hbase-server U: hbase-server

Console output
https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1211/2/console

versions
git=2.17.1 maven=2018-06-17T18:33:14Z)

Powered by
Apache Yetus 0.11.1 https://yetus.apache.org

This message was automatically generated.

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Comment

+0 :ok:
reexec
4m 18s
Docker mode activated.

_ Patch Compile Tests _

+1 :green_heart:
mvninstall
5m 21s
the patch passed

-0 :warning:
checkstyle
1m  7s
hbase-server: The patch generated 1 new + 15 unchanged - 0 fixed = 16 total (was 15)

+1 :green_heart:
whitespace
0m  0s
The patch has no whitespace issues.

+1 :green_heart:
hadoopcheck
17m 55s
Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.

+1 :green_heart:
spotbugs
2m 13s
the patch passed

_ Other Tests _

+1 :green_heart:
asflicense
0m 14s
The patch does not generate ASF License warnings.

47m 43s

Subsystem
Report/Notes

Docker
Client=19.03.8 Server=19.03.8 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1211/3/artifact/yetus-general-check/output/Dockerfile

GITHUB PR
https://github.com/apache/hbase/pull/1211

Optional Tests
dupname asflicense spotbugs hadoopcheck hbaseanti checkstyle

uname
Linux 0b58c261c85c 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/hbase-personality.sh

git revision
master / 60de4c2e31

spotbugs
https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1211/3/artifact/yetus-general-check/output/branch-spotbugs-hbase-server-warnings.html

checkstyle
https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1211/3/artifact/yetus-general-check/output/diff-checkstyle-hbase-server.txt

Max. process+thread count
93 (vs. ulimit of 10000)

modules
C: hbase-server U: hbase-server

Console output
https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1211/3/console

versions
git=2.17.1 maven=2018-06-17T18:33:14Z) spotbugs=3.1.12

Powered by
Apache Yetus 0.11.1 https://yetus.apache.org

This message was automatically generated.

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Comment

+0 :ok:
reexec
9m 36s
Docker mode activated.

-0 :warning:
yetus
0m  2s
Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck

_ Prechecks _

_ master Compile Tests _

+1 :green_heart:
mvninstall
7m 41s
master passed

+1 :green_heart:
compile
1m 17s
master passed

-1 :x:
shadedjars
0m 10s
branch has 7 errors when building our shaded downstream artifacts.

-0 :warning:
javadoc
0m 44s
hbase-server in master failed.

_ Patch Compile Tests _

+1 :green_heart:
mvninstall
7m 19s
the patch passed

+1 :green_heart:
compile
1m 19s
the patch passed

+1 :green_heart:
javac
1m 19s
the patch passed

-1 :x:
shadedjars
0m  9s
patch has 7 errors when building our shaded downstream artifacts.

-0 :warning:
javadoc
0m 45s
hbase-server in the patch failed.

_ Patch Compile Tests _

+1 :green_heart:
mvninstall
7m  7s
the patch passed

+1 :green_heart:
compile
1m 15s
the patch passed

+1 :green_heart:
javac
1m 15s
the patch passed

-1 :x:
shadedjars
0m  9s
patch has 7 errors when building our shaded downstream artifacts.

-0 :warning:
javadoc
0m 41s
hbase-server in the patch failed.

_ Patch Compile Tests _

+1 :green_heart:
mvninstall
5m 55s
the patch passed

+1 :green_heart:
compile
1m 19s
the patch passed

+1 :green_heart:
javac
1m 19s
the patch passed

+1 :green_heart:
shadedjars
6m 51s
patch has no errors when building our shaded downstream artifacts.

-0 :warning:
javadoc
0m 40s
hbase-server in the patch failed.

_ Other Tests _

-0 :warning:
unit
67m 35s
hbase-server in the patch failed.

100m 47s

Subsystem
Report/Notes

Docker
Client=19.03.8 Server=19.03.8 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1211/5/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile

GITHUB PR
https://github.com/apache/hbase/pull/1211

Optional Tests
javac javadoc unit shadedjars compile

uname
Linux 87e46b794c1b 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/hbase-personality.sh

git revision
master / 52c101389e

Default Java
2020-01-14

javadoc
https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1211/5/artifact/yetus-jdk11-hadoop3-check/output/branch-javadoc-hbase-server.txt

javadoc
https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1211/5/artifact/yetus-jdk11-hadoop3-check/output/patch-javadoc-hbase-server.txt

unit
https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1211/5/artifact/yetus-jdk11-hadoop3-check/output/patch-unit-hbase-server.txt

Test Results
https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1211/5/testReport/

Max. process+thread count
5816 (vs. ulimit of 10000)

modules
C: hbase-server U: hbase-server

Console output
https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1211/5/console

versions
git=2.17.1 maven=2018-06-17T18:33:14Z)

Powered by
Apache Yetus 0.11.1 https://yetus.apache.org

This message was automatically generated.


Demo on 'CodeSandbox' seems broken

Lots of errors when it loads along with console errors and notices.

That's weird, I just check the CodeSandbox and there are no errors and everything works fine. Can you do screenshots of what you see and tell me which browser, version, os you are using please


Salesforce plugin - dataset creation

I'm not able to create a dataset from the Salesforce plugin when I choose the option "Readable with columns". More precisely, I cannot build the schema.
Error message: Test failed: java.lang.IllegalStateException: Expected BEGIN_OBJECT but was NULL at line 1 column 16 path $.schema, caused by: IllegalStateException: Expected BEGIN_OBJECT but was NULL at line 1 column 16 path $.schema
I can see the data in preview and it also works when I select "JSON" as the format, so I assume my connection has been set up correctly.
Anyone knows how to troubleshoot this? @jereze?
Thanks!

Hi Benoit,
Indeed, it seems that the connection works. Your problem seems specific to the output format with all columns.
I'm not able to reproduce. Can you please share the following information?

Which version of Dataiku DSS?
Which version of the plugin?
Which dataset?
What data are you fetching from Salesforce? If you try another Salesforce object or another plugin dataset, do you still have the issue?
How many columns? Anything special in the columns names? A special character?

As a workaround, you can use the JSON output format and then use a prepare recipe to parse the JSON.

Thanks for the quick reply.

DSS version: 5.0.0 (free edition)
Note: I'm running on Windows via Docker
Plugin version: 1.1.0
I have the same issue for all types of data that I'm trying to fetch (object list, records of specific objects)
Example: Opportunity dataset contains 45 columns and 934 rows. There is nothing special/unique about them.

Can you upgrade to 5.0.1 or 5.0.2? I know that a bug around plugin datasets was fixed. It might help.

Thanks for the info!
I will use your workaround solution for now. It seems very easy and I'm only testing some functionality for now, so it will be sufficient.


Input element sometimes won't get focus (with Superforms)

Describe the bug
As you certainly know, Superforms has an autoFocusOnError option, enabled as default, focusing on an error field when the form is submitted. I noticed that the Input component doesn't always get focus.
I've been debugging Superforms, changing the wait time before focusing from the current await tick() to setTimeout with 100 ms delay, but nothing seems to work, so I don't think it's a Superforms issue.
Reproduction
https://github.com/ciscoheat/shadcn-svelte-not-focusing
Instructions are included there.
Logs
No response
System Info
System:
    OS: Windows 10 10.0.19045
    CPU: (16) x64 Intel(R) Core(TM) i9-9900K CPU @ 3.60GHz
    Memory: 44.72 GB / 63.93 GB
  Binaries:
    Node: 21.4.0 - C:\Program Files\nodejs\node.EXE
    Yarn: 1.22.21 - ~\AppData\Local\pnpm\yarn.CMD
    npm: 9.3.1 - C:\Program Files\nodejs\npm.CMD
    pnpm: 8.15.5 - ~\AppData\Local\pnpm\pnpm.CMD
    bun: 1.0.32 - ~\.bun\bin\bun.EXE
  Browsers:
    Edge: Chromium (123.0.2420.81)
    Internet Explorer: 11.0.19041.3636
  npmPackages:
    @sveltejs/kit: ^2.0.0 => 2.5.5
    svelte: 5.0.0-next.100 => 5.0.0-next.100
    sveltekit-superforms: ^2.12.4 => 2.12.4

Severity
annoyance

Can you reproduce this with Svelte 4? I'm not able to. Or does the same thing happen with a regular (non-component) input?
You're on the money about usually using a tick() or otherwise, but it seems like in this case waiting for the state to update via $effect() then focusing would work but it shouldn't have to be like that.

True, I cannot reproduce it on Svelte 4 either. But it works with a regular input even on Svelte 5.
I could post an issue at the Svelte repo, but maybe a dependency on both Superforms and shadcn-svelte won't be appreciated. :)

We could just recreate an <Input /> component and use it with only Superforms to isolate the issue further before bringing it to their attention!

I think I managed to reproduce it without any of the libs, will post an issue at Svelte.

Nope, it was harder than I thought.

So you can't reproduce by creating an <Input /> component and using it in place of the one for shadcn-svelte? All it does is wrap a regular input.

Gonna close this as I haven't been able to reproduce and from my understanding it shouldn't be an issue with this lib as it's just rendering an HTML input :)


Zeek reader trims whitespace too aggressively

The code here trims any trailing whitespace: https://github.com/brimsec/zq/blob/master/zio/zeekio/reader.go#L46
A log in which the last column is a string type and there's a value that just consists of whitespace is valid but we fail to read it.  @philrz came across an example in the wild that looks like this:
#separator \x09
#set_separator	,
#empty_field	(empty)
#unset_field	-
#path	unknown_mime_type_discovery
#open	2020-04-10-18-15-32
#fields	ts	fid	bof
#types	time	string	string
1425634708.454143	FTBt2P3wJBdHGKpZwc

Its not visible in the text display but after the uid on the last line is a tab character and space character.

Here's a log file as attachment that contains this, for ease of verification when we have a fix:
unknown_mime_type_discovery.log

Verified in zq commit 4895043.
Just to briefly revisit the symptom using the attached test data, this is how it looked as of zq commit 8ed4a03:
# q -i zeek unknown_mime_type_discovery.log
too few values

Now with zq commit 4895043:
zq -i zeek unknown_mime_type_discovery.log
#0:record[_path:string,ts:time,fid:bstring,bof:bstring]
0:[unknown_mime_type_discovery;1425634708.454143;FTBt2P3wJBdHGKpZwc; ;]
0:[unknown_mime_type_discovery;1425634709.279048;FkyH2ivxvSBAv1iV9;\x0d\x0a;]

Thanks @aswan!


What have you done?

This sounds so much better compared to a year ago. I am impressed! SO IMPRESSED!
I just sent you a small donation and I hope that covers the coffee for a while. I really hope more people will help out getting you/this software attention and support.

@38github Hey thanks so much! It's really just from understanding how these neural networks operate better, the Wavenet model seems to sound the best in most cases, although cpu usage is still high.  I changed the default hyperparameters to use more layers with less channels, and that seems to sound better while dropping cpu usage slightly lower.  Also I normalize the data by default now, which improves accuracy and keeps volume consistent.  More improvements and more models coming so check back for updates!


Integration Test - Release - 2021/12/22 08:36:10

Auto create for integration test. IssueCommandFlow

#pri1


jellyfish-transaction p2wpkh should check elliptic pair before signing transaction

What would you like to be added:
jellyfish-transaction should validate that it can actually spend the transaction with the given elliptic pair before signing transaction.
Only for p2wpkh as it is the only one that is implemented.
Why is this needed:
Currently jellyfish-transaction will sign any transaction regardless of what prevout is given to it.
It should check it can actually spend the given transaction by, taking the prevout and HASH160 it.

should also validate vin is not empty when trying to sign a transaction.
const tx = {
  version: 0,
  vin: [],
  vout: [],
  lockTime: 0,
}


Domain proxy standalone improvements

Make byte buffer size configurable. Add configurable whitelist of proxy targets. Factor out common IO code. Switch to using Vert.x server. Add support for HTTPS. Handle exceptions seen when connection dies between client and server. Refactored domain proxy in general for consistency.
https://issues.redhat.com/browse/JBS-23

Tests still need to be added.

/test all


Expose rigid body mass properties

Why

Expose rigid property mass properties necessary for creating custom controllers in user-land, e.g. vehicle controllers
In particular, I have been porting the bullet/cannon RaycastVehicleController to rapier.js, which uses rigid body inertia properties to calculate impulses for braking
Addresses https://github.com/dimforge/rapier.js/issues/194

What

Expose rigid body MassProperties via rigidBody.massProperties()

Open Questions

Is exposing a new class MassProperties best? Should MassProperties methods just be on the rigid body?

pros:

mirrors the rust rapier API

cons:

creating a new class means that free() must be called on MassProperties

What is the current standard of testing for new contributions? Should I look to create unit tests for this functionality?

Will fix the formatting issues shortly. Unsure if the failing tests are related too this PR, will look into that too

I've updated the PR to expose mass properties via methods on RigidBody. Mirroring the rust rapier API didn't seem like a good enough justification to require manual memory management where nearly everything else doesn't.
Happy to revert this of course if it's preferred for some other reason.

Rebased, and testbed2d and testbed3d look good. I've done some manual verification in both testbeds of the newly exposed methods via the debugger.
Let me know if I should look to add any tests as well.

Thank you for this PR! I made a few small changes (you can see the commits I added). In particular I removed some mutability that were not needed (you can use &self instead of &mut self if the method doesn’t modify the objects).


Class lists: Revise MegaReadingImporter for use with aggregate K and 1 reading data

Who is this PR for?
K2 teaching teams
What problem does this PR fix?
Most recent F&P levels aren't yet imported for younger grades, for use in checks within class list maker tool.
What does this PR do?

move MegaReadingImporter to use FuzzyMatcher
fix FuzzyMatcher for multiple words in last names
updated MegaReadingImporter to use new column keys for K and 1
update validations on ReadingBenchmarkData to support new data point types

This doesn't update any controller or UI code yet.
Checklists
Which features or pages does this PR touch?

[x] Class lists
[x] Student Profile
[x] Reading

Does this PR use tests to help verify we can deploy these changes quickly and confidently?

[x] Manual testing made more sense here

selfie


docs: move internal code-blocks to docs/examples/**/*.py files to be automatically tested

Description
Authored by @Kumzy in https://github.com/litestar-org/litestar/pull/3392, moved here due to fork issues

Moving all code-block to files

Closes
#3362

Still remaining @Kumzy we just need to fix any pre-commit failures
pre-commit install
pre-commit run --all-files

and fix the ones in the new docs/examples dirs.
Basically most of them look like missing imports like
docs/examples/templating/template_file.py:1:2: F821 Undefined name `get`

@litestar-org/maintainers when we have examples like this, how do we want to handle the moving of them? Should we create my_app? or do we ignore and allow the test to not run (and then go stale, and so then why have we moved all of these code blocks 🙃)
 /opt/hostedtoolcache/Python/3.11.9/x64/lib/python3.11/importlib/__init__.py:126: in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
docs/examples/testing/test_request_factory_3.py:2: in <module>
    from my_app.guards import secret_token_guard
E   ModuleNotFoundError: No module named 'my_app'

from os import environ

from my_app.guards import secret_token_guard

from litestar import get

@get(path="/secret", guards=[secret_token_guard], opt={"secret": environ.get("SECRET")})
def secret_endpoint() -> None: ...

@litestar-org/maintainers when we have examples like this, how do we want to handle the moving of them? Should we create my_app? or do we ignore and allow the test to not run (and then go stale, and so then why have we moved all of these code blocks 🙃)
 /opt/hostedtoolcache/Python/3.11.9/x64/lib/python3.11/importlib/__init__.py:126: in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
docs/examples/testing/test_request_factory_3.py:2: in <module>
    from my_app.guards import secret_token_guard
E   ModuleNotFoundError: No module named 'my_app'

from os import environ

from my_app.guards import secret_token_guard

from litestar import get

@get(path="/secret", guards=[secret_token_guard], opt={"secret": environ.get("SECRET")})
def secret_endpoint() -> None: ...

Examples should all be self-contained. There are rare exceptions (like templates / static files), but this isn't one of them; The guard could very well be defined in the same file.
Having an app for every code example also give the benefit of us being able to auto-run them which, even if the example isn't tested explicitly, at least implicitly ensures that we don't have broken examples.

Had some question regarding latest changes to add import:

for channels, is it correct to fix the following with from litestar.channels import ChannelsPlugin as Channels and replace channels by Channels

subscriber = await channels.subscribe(["foo", "bar"])
try:
    ...  # do some stuff here
finally:
    await channels.unsubscribe(subscriber)

How should I fix the following, I have to create ctx_a ctx_b and hook_a and hook_b ?

from litestar import Litestar

app = Litestar(lifespan=[ctx_a, ctx_b], on_shutdown=[hook_a, hook_b])


Invalid non-string/buffer chunk parseAsync

Latest version
2.Chrome and on Node 12.4.0

  const fields = columns;
    const opts = { fields };

    const asyncParser = new AsyncParser(opts);

    let csv = '';
    asyncParser.processor
    .on('data', chunk => console.log(chunk)) //with or without this line same result, it logs a Uint8Array
    .on('data', chunk => (csv += chunk.toString()))
    .on('end', () => console.log(csv))
      .on('error', err => console.error(err));

      asyncParser.transform
      .on('header', header => console.log(header))
      .on('line', line => console.log(line))
      .on('error', err => console.log(err));

    asyncParser.input.push(data.data); // This data might come from an HTTP request, etc.
    asyncParser.input.push(null);

    return csv;

Sample data

[{category: "Ice cream", flavour: "vanilla"}, {category: "Ice cream", flavour: "chocolate"}]

Error: Invalid non-string/buffer chunk

Everything looks correct on your sample and the error also looks correct.
If the content of data.data is not a string or a Buffer, you can't pass it to the AsyncParser. I assume that you are using a library that parses the response of your request into JSON for you which is the problem.
Possible solutions:
1.- Use object mode:
const asyncParser = new AsyncParser(opts, { objectMode: true });
...
data.data.forEach(item => asyncParser.input.push(item));
asyncParser.input.push(null);

It's easy but you loose the advantage of streamming the data as it comes and the constant memory pressure.
2.- Use the convenience method parse async:
parseAsync(data.data, opts);

It does the exact same thing as option 1 under the hood.
3.- Stringify the JSON
...
asyncParser.input.push(JSON.stringify(data.data));
asyncParser.input.push(null);

4.- Actually stream the data. This depends on which HTTP library you are using.
If you are using this in node.js, Response is already a stream and can be passed as input asyncParser.fromInput(res).
If you are on the browser, you need to get the chunks of data as they arrive and push them to the parser.

Thanks for the reply, the first option solved my problem. Wondering if there is a method to modify a row value during the parsing process. For example if I had an ID column and wanted to wrap the ID in a URL, thanks

Unfortunately, not yet (at least in a very clean way).
It's something that I've been thinking of for a while so I've created #406 to add it for v5.
It should be possible for you anyway since you are using objectMode. However, there is a bug in the current library that prevents it from working. I'll try to push the fix later today and I'll give you an example of how to do it.

I managed to find another way around this task, thanks :)


Added support for syntax in audios, files and voices, edit_caption and Added pin unpin method

Added support for syntax in audios, files and voices, edit_caption and Added pin unpin method

This PR also includes #106's commits. Could you remove them (rebasing into master should be enough)?


Hmm, this is interesting. Can you tell when it became like this, or you just noticed now?

I've noticed now. It was for sure working earlier, I've watched the video multiple times after uploading and also later.

One of my videos is having a similar issue. I'm sure it worked when I uploaded it ~9 months ago, but now I'm seeing a bunch of artifacts. I tried downloading the asciicast and it was perfect when I played it locally.
https://asciinema.org/a/81251

at 0:06 the 2. is shifted to the left by one character
at 0:10 the scrolling cursor is totally messed up
at 0:53 the 2. is once again shifted to the left
starting at 1:33 there are a couple of pages with lines shifted to the left

It looks it happens whenever there's an indented line after a blank line?

Found it. The behavior of LF change in effe9a1cdef4990f9e93c2d1c96f32dae6dbe894. Looks like this isn't proper thing to do. I now need to find a reason for introducing this change (as I'm pretty sure it solved some other/related issue).

Thanks for bringing this up! I've deployed fix for this to asciinema.org.


Ability to execute fetching in a dedicated server

Describe the problem
Possibly duplicate, since Rich always talks about serverless, but didn't find any serious place it is being discussed.
Right now, especially because of Cloudflare Workers and Amazon Edge, people are thinking(and doing!) about running the frontend/SSR server in many locations wordwide by the mechanisms I mentioned before.
That gives the user the ability to SSR the initial result to the HTTP page from the nearest server, while reducing the computation efforts needed from the centeral backend server(s). It also might yield faster responses.
Since developer care about persistency and consistency, there is still a main backend server in a single(or sometimes in many) specific data centers.
That means, for fetching a page in SSR, the frontend server, running sveltekit instancey(e.g. with the adapter of cloudflare workers), is sending REST requests to the backend, while processing the sveltekit load function.
The problem is that in the load function, the SSR server might invoke many remote IO calls, or even need to wait for a return of an HTTP response for sending another HTTP request(for example, the first might be an auth request since the second need to use the credentials from the first).
Usually, because of a geographic gap, it is much easier and faster to compute the load function only in the backend.
Describe the proposed solution
Have the ability to execute a server that only answer the result of the load function, and also execute an SSR server calling for the former server for the response of load, instead of computing it by itself.
This way, in the centeral backend(s) the former will be executed, and the goe-spread SSR servers will enjoy easy and fast networking, and their job is only to precompute the HTML output, the same as what the user client should do.
Alternatives considered
Two obvious alternative:

Just give up on the geo-spreading concept and compute SSR in the main server(s).
Manually code the load function to send only a one HTTP big request designed specifically for every route. This isn't convenient for the backend developers. Additionally, this doesn't cover the separation of __layout.svelte which have additional load function.

Importance
nice to have

A lot of this sounds exactly like https://kit.svelte.dev/docs/routing#endpoints-page-endpoints - combine all of the requests for a page in one page endpoint that backs the page, and (automatically) make only that one request from the browser. Are you talking about something that wouldn't be covered by that?

A lot of this sounds exactly like https://kit.svelte.dev/docs/routing#endpoints-page-endpoints - combine all of the requests for a page in one page endpoint that backs the page, and (automatically) make only that one request from the browser. Are you talking about something that wouldn't be covered by that?

Hi!
Page Endpoints are just (good) alternative to the page/layout load function.
I'm seeking for the ability to compute the load or the page endpoint in a different server than the server instance which computes the initial SSR HTML response for the client.

This all sounds like userland concerns to me. E.g. you can create one app for the endpoints and deploy it separately from your frontend app

This all sounds like userland concerns to me. E.g. you can create one app for the endpoints and deploy it separately from your frontend app

Didn't fully understand you.
You're suggesting to do exactly what I wish: the user may already run one server instance delivering only endpoints/load function result, and another server instance (in an endpoint) for the user server, which the latter sends exactly one(or zero perhaps) HTTP request per page for the former server.
Do you mean you can already do it automatically in SvelteKit right now? For me, it seems you need to add an ability in the adapter API, allowing the adapter to build one instance of "preloading" server, and another instance of "SSR only" server.
Or you might suggest by the "user land" that the user should write the code yielding the page data in a project separated from SvelteKit? I think it goes against what the project designed for.

If you want your SSR server to make a single request to an API endpoint then you can write your application that way today. E.g. that's why GraphQL has become popular - you can write one query that joins together the different pieces of data into a single request

If you want your SSR server to make a single request to an API endpoint then you can write your application that way today. E.g. that's why GraphQL has become popular - you can write one query that joins together the different pieces of data into a single request

You right about it, but since SvelteKit is a flexible toolkit, can't we allow this out of the box?
I want to clarify again what I said since I see it's confusing, and also give a simple real life example.
Right now, the server node that SvelteKit generates(with the help of the adapters) works as follows (as far as I'm aware of):
Currently Frontend Server:

For every HTTP request:

For every layout component (sequentially), and also for the page component of the requested page (at the end):

Process load or page endpoint (if any).
Substitute the data from 1 in the component props.
Calculate the SSR result of the component(page/layout).

Combine them all together to an HTML output, and send this as an HTTP response.

The thing that seems so natural for me, is to decouple step 1 from this process, and getting the following two servers:
New Frontend Server:

For every HTTP request:

Call the intermediate server(see next) and ask the JSON-formatted props data for the specific page.
For every layout component (sequentially), and also for the page component of the requested page (at the end):

Substitute the data of the relevant component, given by the intermediate server, in the component props.
Calculate the SSR result of the component(page/layout).

Combine them all together to an HTML output, and send this as an HTTP response.

Intermediate Server:

For every data request:

For every layout component (sequentially), and also for the page component of the requested page (at the end):

Process load or page endpoint (if any).

Combine them all together to a JSON-formatted props data, and send this as a response.

I shall mark the generation and the communication between the new frontend server and the intermmediate server should be implemented in the adapter implementation by itself, this is my "user land".
In modern real life the user might put the new frontend server in the endpoint, and the intermediate server and the main backend(usually needed for logical decoupling) in its data center(s).
The advantages of this system, is that we'd have an automatic, simple and fast way to geo-spread the endpoints for efficiency, and yet avoid too much networking latency issues.
I'll mention two main examples, usually happen together, which demonstrate why my suggestion is useful, and it is hard to fix these issues in "user land":

A layout inside layout for a page: You will need to perform loading for the first layout and wait for response, and then perform loading for the second layout and wait for response, and then to the same for the page itself. -> Three rounds of communication
Call fetch A, and wait for the result. Sometimes you'd need to process the data of A in order to know what another request B you need to perform. (You can view here maybe some auth mechanism e.g.) -> Two rounds of communication

The solution I proposed doesn't decrees the number of rounds, but make the latency in between possible much shorter, since both the intermediate and the backend server can be in the same data center or even in the same machine.

By design, it's not possible to separate SSR from load — you can return non-serializable things from it, like (for example) components. This is an important use case that can't be handled with JSON, so I'm afraid this is a non-starter.
As mentioned, page endpoints (and soon, layout endpoints) are designed to make it possible to fetch all the data for a page that doesn't use load in a single go. But for pages with those endpoints, there's nothing to be gained by separating the data from the SSR — no matter how geographically distributed and instant-to-start-up your 'SSR nodes' are, browser -> SSR node -> data node will never be faster than if the browser makes a request direct to a server that computes the HTML response in the same place as the data lives.

By design, it's not possible to separate SSR from load — you can return non-serializable things from it, like (for example) components. This is an important use case that can't be handled with JSON, so I'm afraid this is a non-starter.
As mentioned, page endpoints (and soon, layout endpoints) are designed to make it possible to fetch all the data for a page that doesn't use load in a single go. But for pages with those endpoints, there's nothing to be gained by separating the data from the SSR — no matter how geographically distributed and instant-to-start-up your 'SSR nodes' are, browser -> SSR node -> data node will never be faster than if the browser makes a request direct to a server that computes the HTML response in the same place as the data lives.

You're totally right but you forgot one thing - load balancing.
Serverless is not only about geo-minimal-latency, but also good for balancing work load.
If a non-state-critical task can be on specific backend(s), and the rest of the work can be done in every edge location, you gain a much more robust system (both for DDoS and for global load balancing).

By design, it's not possible to separate SSR from load — you can return non-serializable things from it, like (for example) components. This is an important use case that can't be handled with JSON, so I'm afraid this is a non-starter.
As mentioned, page endpoints (and soon, layout endpoints) are designed to make it possible to fetch all the data for a page that doesn't use load in a single go. But for pages with those endpoints, there's nothing to be gained by separating the data from the SSR — no matter how geographically distributed and instant-to-start-up your 'SSR nodes' are, browser -> SSR node -> data node will never be faster than if the browser makes a request direct to a server that computes the HTML response in the same place as the data lives.

For potential future reference - The latency problem of the layout loading before page can be fixed by #5748 .


Test cleanup for tooling

A bunch of minor noop changes that make it easier for our tooling to work with the tests.

Last commit seems to have broken the linter :cry:

FWIW: Any tooling that needs to analyze user-code should know how to handle many of these edge cases. Not -1 on anything in this PR, but make sure there are separate issues to track any edge-cases removed from core.
Ex: We've known recognizers was harder to analyze/tool than Gestures.recognizers but didn't change it at the time because we knew we needed to handle our users doing this anyway.

Yeah. I've filed bugs for the main issues. The Gestures.recognizer name issue is a big one that we need to handle correctly.
Requiring that a project run under strict mode seems like a smaller deal to me. We can just document that when it's a limitation and normal linters can catch that stuff. (here the linter was explicitly configured to treat stamped as a global).
The rest of the changes are pretty obscure edge cases, IMO, and we can just document them as known limitations.


Smart Contract Audits

Just leaving a note here for any discussion relevant to the auditing of our smart contracts.
@nick mentioned that the identity contracts are very much in alpha status and may not be ready for auditing.
To-Dos

[ ] add disclaimer comment(s) to the identity contract(s) @franckc

CC @tyleryasaka since he is very involved in everything related to ERC 725

Yeah I'm researching identity heavily right now and have a lot of thoughts and ideas that I'm exploring. Agreed they will likely change a good bit in the near future.

Done ✅


Crash when search recipe in NEI

crash report and log
Used:
NEIIntegration-MC1.7.10-1.0.11
forestry_1.7.10-<IP_ADDRESS>3-unstable
and still happen with build 03ca427f3a9d689380e4c3f161e3f1e3f2f64168
crash report and log

This is getting quite ridiculous. I'd love for the Forestry devs (paging @mezz) to reconsider integrating NEI support with Forestry. That way, everything wouldn't have to break at every minor change made to the recipe code.
I'll probably add a way to disable different integrations in the mod so that it doesn't break as a whole.

This isn't unique to the Forestry 4.0.0 "unstable" builds.  I saw a similar crash with Forestry <IP_ADDRESS>.

Unlikely. I checked the code for <IP_ADDRESS> and the change that would cause this crash isn't in that version yet. By all means correct me if I'm wrong, but I'm going to need to see a crash log.

Sorry, I had somehow failed to notice that I was still using an old version - The similar-looking stack trace I got was using NEI integration 1.0.7 and Forestry <IP_ADDRESS>, but NEI integration 1.0.12 is okay.

From a maintainability point of view, it makes the most sense to have this integrated with Forestry. NEI is not being changed, all breaking issues are coming from Forestry. The recipe changes I'm making are tiny, so having NEI Integration included wouldn't really add to the maintenance load at all.
The main issue is that ChickenCode(tm) as a dependency in the dev environment has been a real pain. I'm willing to get over that if you can help set it up. The main holdout for NEI integration has been @CovertJaguar but I think he's been less focused on Forestry lately.

Here is my crash details: http://pastebin.com/2miqsbgn

NEIIntegration-MC1.7.10-1.0.12
forestry_1.7.10-<IP_ADDRESS>9-unstable

@Protheus disable forestry integration on neiintegration configs, now Forestry NEI Handlers are included in Forestry.

Ahh sweet thank you for the fix

@Tonius can you detect when Forestry version is 4.0+ and disable the NEI Handler?
Here's the code I wrote to check Mod version numbers:
https://github.com/ForestryMC/ForestryMC/blob/dev/src/main/java/forestry/core/proxy/ProxyCommon.java#L280-L298


Alt+F, A (i.e., Save As) triggers source R file

Type: Bug
Note that this may be a bug in an extension - I am not 100% sure which.
The keyboard shortcut in Default Keybindings:
{ "key": "ctrl+shift+s",          "command": "r.runSource",
                                     "when": "editorTextFocus && editorLangId == 'r'" },

To reproduce

Open and Save a .R file
Press Alt+F, A
The script gets sourced when it should trigger Save As.

VS Code version: Code 1.74.3 (97dec172d3256f8ca4bfb2143f3f76b503ca0534, 2023-01-09T16:57:40.428Z)
OS version: Linux x64 5.18.0-051800-generic
Modes:
Sandboxed: No

System Info

Item
Value

CPUs
12th Gen Intel(R) Core(TM) i7-1270P (16 x 2080)

GPU Status
2d_canvas: enabledcanvas_oop_rasterization: disabled_offdirect_rendering_display_compositor: disabled_off_okgpu_compositing: enabledmultiple_raster_threads: enabled_onopengl: enabled_onrasterization: enabledraw_draw: disabled_off_okskia_renderer: enabled_onvideo_decode: disabled_softwarevideo_encode: disabled_softwarevulkan: disabled_offwebgl: enabledwebgl2: enabledwebgpu: disabled_off

Load (avg)
2, 2, 1

Memory (System)
31.05GB (19.58GB free)

Process Argv
--unity-launch --crash-reporter-id 109ba974-f9f3-4dd2-ae16-615ad0e4b375

Screen Reader
no

VM
0%

DESKTOP_SESSION
ubuntu-xorg

XDG_CURRENT_DESKTOP
Unity

XDG_SESSION_DESKTOP
ubuntu-xorg

XDG_SESSION_TYPE
x11

Extensions (23)

Extension
Author (truncated)
Version

path-intellisense
chr
2.8.4

copilot
Git
1.71.8269

gc-excelviewer
Gra
4.2.56

path-autocomplete
ion
1.23.1

language-julia
jul
1.38.2

csharp
ms-
1.25.4

isort
ms-
2022.8.0

python
ms-
2022.20.2

vscode-pylance
ms-
2023.2.10

jupyter
ms-
2022.11.1003412109

jupyter-keymap
ms-
1.0.0

jupyter-renderers
ms-
1.0.14

vscode-jupyter-cell-tags
ms-
0.1.6

vscode-jupyter-slideshow
ms-
0.1.5

cmake-tools
ms-
1.13.45

cpptools
ms-
1.13.9

cpptools-extension-pack
ms-
1.3.0

quarto
qua
1.61.0

r-debugger
RDe
0.5.2

r
REd
2.7.0

tabletopsimulator-lua
rol
1.1.3

lua
sum
3.6.9

cmake
twx
0.0.17

(1 theme extensions excluded)

A/B Experiments
vsliv368cf:30146710
vsreu685:30147344
python383:30185418
vspor879:30202332
vspor708:30202333
vspor363:30204092
vslsvsres303:30308271
pythonvspyl392:30443607
vserr242:30382549
pythontb:30283811
vsjup518:30340749
pythonptprofiler:30281270
vshan820:30294714
vstes263:30335439
pythondataviewer:30285071
vscod805:30301674
binariesv615:30325510
bridge0708:30335490
bridge0723:30353136
cmake_vspar411:30581797
vsaa593:30376534
pythonvs932:30410667
cppdebug:30492333
vsclangdf:30486550
c4g48928:30535728
dsvsc012cf:30540253
azure-dev_surveyone:30548225
pyindex848:30577860
nodejswelcome1:30587005
3biah626:30602489
89544117:30613380
pythonsymbol12cf:30657549

Hi @kendonB :-)
Thanks for filing this issue!

Could you provide your keybindings.json file contents? (invoke command "Preferences: Open Keyboard Shortcuts (JSON)" to open it)

Could you please try the following:

Run the command "Developer: Toggle Keyboard Shortcuts Troubleshooting" (you can, for example, run it from the Command Palette).
This will activate logging of dispatched keyboard shortcuts and will open an output panel with the corresponding log file.

Press exactly the keybinding you desire

Check what VS Code detects

If you are having trouble understanding the output, please feel free to paste here and we'll be happy to help ☺

This issue has been closed automatically because it needs more information and has not had recent activity. See also our issue reporting guidelines.
Happy Coding!

Now that RStudio supports github copilot, VSCode probably isn't the right thing for R coding in general (I have switched back). Happy for this to be closed.


Ensure there is a dvc.yaml file when running experiment

Part of #3058
Creates an empty (seems to be all that is needed) dvc.yaml file when none exists before running experiment.
https://user-images.githubusercontent.com/3683420/215572713-4700089d-11c1-40a3-99fc-66d38be297b1.mov
Should we add a notification saying we created the file? Or even ask the user if they would like to create the file? Seems low impact enough to me to simply create the file for them.

Talked through ideas for the next step with @sroy3.
Ideas that came up:
Populating dvc.yaml
Run button shows a modal which asks the user if they want to add a dvc.yaml so they run an experiment.
Quick input then asks for the relative path to their training script.
dvc.yaml is created containing:
stages:
  train:
    cmd: python relative/path/to/train/script

Final step of onboarding
Add another step to the end of onboarding which shows the location of the run button (editor/title) and details what clicking it will do (see above idea).

Couple things to check

does running an experiment with an empty dvc.yaml still respect the params created by Dvclive?
does this create any other weirdness when running experiments?

This works great for already set up projects (like https://github.com/iterative/dvc-get-started-cv/tree/1-notebook-dvclive), but it seems like it needs more than that for newly created projects. With the dvc.yaml file, it'll run, but the table will still have no columns.

Closing this as this is too simple as a first step. Will add a prompt to the training script and re-open.


add python3.9 in CI

Tests are failing in 3.9 because of the change from #370

resource is the name of the resource to open within package; it may not contain path separators and it may not have sub-resources (i.e. it cannot be a directory).

I guess it work in 3.8 ... but it shouldn't have


Extra details required for entanglement intro

Describe the Issue
Certain topics are missing, that would be good for a description of entanglement
Density matrices
Just at a basic level

Noting that $|\psi\rangle \langle \psi |$ is just as good for getting statistics as $|\psi\rangle$
Showing that $\sum_j p_j |\psi_j\rangle \langle \psi_j |$ can be used to include classical statistics.
Looking at classical correlations in quantum states.

Projection
Showing that a superposition collapses to the parts consistent with the measurement result.
Expected Solution
Add a section to 'Multiple Qubits and Egtanglement'. I've assigned myself.

I’ll get on this before the big day.

I no longer think this is necessary


[WIP] Add BetterIonDrives.netkan

Closes #1906
Want to wait a few days to see if mod author corrects the folder name having an extra whitespace at the end.

Should be able to use a find_regexp of BetterIonEngine\\s* or (^|/)BetterIonEngine\\s*$ if you want to be stricter.

Oh yeah thanks for reminding me.

No response in thread, netkan refactor still has the same problem with a trailing whitespace. Netkan works as is and can change in future if things change: passes local, passes jenkins, merging.


feat: 🎸 support transaction details in response

return the details of fees and paying account for transaction as well as enable dryRun
JIRA Link
https://polymesh.atlassian.net/browse/DA-108
Changelog / Description

adds dryRun tag to enable testing the transaction without submitting it to blockchain
adds transactionDetails in the response (fees, paying account data)

Note: should carefully look if I haven't missed nay part where the dryRun should be added to
Checklist -

[x] New Feature ?
[x] Updated swagger annotation (if API structure is changed) ?
[x] Unit Test (if possible) ?
[] Updated the Readme.md (if required) ?

There are one/two linting errors left as well. Please take a look

:tada: This PR is included in version 2.2.0-alpha.4 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:

:tada: This PR is included in version 2.4.0-alpha.1 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:

:tada: This PR is included in version 2.4.0 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


The documentation error

I get this error by following the github readme docs:
info: macOS, python 3.11.2
1- Copy and past the script:
APPLICATION_ID = "my id"
APPLICATION_TOKEN = "my token"
APPLICATION_PUBLIC_KEY = "my public key"
app = discohook.Client(
    application_id=APPLICATION_ID,
    token=APPLICATION_TOKEN,
    public_key=APPLICATION_PUBLIC_KEY
)

@app.command(
    id="", # leave empty for now
    name="help",
    description="basic help command for the bot"
)
async def help_command(interaction: discohook.Interaction):
    await interaction.response(
        "Hello, World!",
        embed=discohook.Embed(title="Help", description="This is a help command"),
        ephemeral=True,
    )

2- run
error:
Traceback (most recent call last):
  File "/Users/yousifaladwani/Documents/code/python/iFlashy_Discord_Bot/discohook_test.py", line 8, in <module>
    app = discohook.Client(
          ^^^^^^^^^^^^^^^^
AttributeError: module 'discohook' has no attribute 'Client'. Did you mean: 'client'?

This happened to me the other day when I accidentally installed "discohook" from pypi which is a different package to this one. Make sure you install this one with the full git path given in the readme.
If you just do: pip install discohook it will install the wrong one

Oh this could be a reason!


[Doris On ES] Support create table with wildcard or aliase index

https://github.com/apache/incubator-doris/issues/3967
Create multiple index with same mapping in ES:
PUT wildcard_1
{
   "settings": {
      "number_of_replicas": 0,
      "number_of_shards": 1
   },
   "mappings": {
      "doc": {
         "properties": {
            "k1": {
               "type": "integer"
            },
            "index": {
               "type": "keyword"
            }
         }
      }
   }
}

PUT wildcard_2
{
   "settings": {
      "number_of_replicas": 0,
      "number_of_shards": 1
   },
   "mappings": {
      "doc": {
         "properties": {
            "k1": {
               "type": "integer"
            },
            "index": {
               "type": "keyword"
            }
         }
      }
   }
}

PUT wildcard_3
{
   "settings": {
      "number_of_replicas": 0,
      "number_of_shards": 1
   },
   "mappings": {
      "doc": {
         "properties": {
            "k1": {
               "type": "integer"
            },
            "index": {
               "type": "keyword"
            }
         }
      }
   }
}

Create wildcard_alias aliases contains those above three index:
POST /_aliases
{
   "actions": [
      {
         "add": {
            "indices": [
               "wildcard_3",
               "wildcard_2",
               "wildcard_1"
            ],
            "alias": "wildcard_alias"
         }
      }
   ]
}

Create ES external table within Doris:

Support aliase matched index:

CREATE EXTERNAL TABLE `wildcard_alias` (
  `k1` int COMMENT "",
   `k2`  varchar COMMENT ""
) ENGINE=ELASTICSEARCH
PROPERTIES (
"hosts" = "http://<IP_ADDRESS>:8200",
"user" = "root",
"password" = "root",
"index" = "wildcard_alias",
"type" = "doc",
"version" = "6.5.3",
"enable_docvalue_scan" = "true"
);

Support wildcard matched index:

CREATE EXTERNAL TABLE `wildcard_alias` (
  `k1` int COMMENT "",
   `k2`  varchar COMMENT ""
) ENGINE=ELASTICSEARCH
PROPERTIES (
"hosts" = "http://<IP_ADDRESS>:8200",
"user" = "root",
"password" = "root",
"index" = "wildcard_*",
"type" = "doc",
"version" = "6.5.3",
"enable_docvalue_scan" = "true"
);

And execute SQL on Doris:
 select * from wildcard_alias;
  or
 select * from wildcard;

Finally we get all document within those three index:
+------+-------------+
| k1   | k2          |
+------+-------------+
|  111 | wiladcard_1 |
| 1111 | wiladcard_1 |
| 1112 | wiladcard_1 |
|  110 | wiladcard_1 |
|  222 | wiladcard_2 |
|  223 | wiladcard_2 |
|  223 | wiladcard_2 |
|   33 | wiladcard_3 |
|   33 | wiladcard_3 |
|   33 | wiladcard_3 |
|   33 | wiladcard_3 |
|   33 | wiladcard_3 |
+------+-------------+

k2 indicate the data from which index

looks good.
but i have a question: sql like 'select k1 from wildcard_alias where k1 > '2020-05-20'', DSL will run on all related indices? or just on  wildcard_alias_2020_05_21, wildcard_alias_2020_05_22...

@blackfox1983  yes, run on all related indices.