Fix targeted attacks with AutoProjectedGradientDescent

Fixes #512
Signed-off-by: Beat Buesser<EMAIL_ADDRESS>Description
This pull request fixes the targeted attacks with AutoProjectedGradientDescent.
Fixes #512
Type of change
Please check all relevant options.

[x] Bug fix (non-breaking)
[ ] New feature (non-breaking)
[ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)
[ ] This change requires a documentation update

Checklist

[x] My code follows the style guidelines of this project
[x] I have performed a self-review of my own code
[x] I have commented my code
[x] I have made corresponding changes to the documentation
[x] My changes generate no new warnings
[x] I have added tests that prove my fix is effective or that my feature works
[x] New and existing unit tests pass locally with my changes

Codecov Report

Merging #513 into dev_1.3.2 will increase coverage by 0.38%.
The diff coverage is 8.33%.

@@              Coverage Diff              @@
##           dev_1.3.2     #513      +/-   ##
=============================================
+ Coverage      69.04%   69.43%   +0.38%
=============================================
  Files            132      132
  Lines          11234    11425     +191
  Branches        1892     1953      +61
=============================================
+ Hits            7757     7933     +176
- Misses          2797     2805       +8
- Partials         680      687       +7

Impacted Files
Coverage Δ

...attacks/evasion/auto_projected_gradient_descent.py
6.59% <8.33%> (+0.19%)
:arrow_up:

art/attacks/evasion/deepfool.py
91.05% <0.00%> (+0.25%)
:arrow_up:

art/attacks/evasion/carlini.py
93.04% <0.00%> (+1.25%)
:arrow_up:


.Net core 1.1 problem

Hi Everyone,
I have updated to .Net core 1.1. I would like to use IdentityServer4. So which version of it is working fine with .net core 1,1 and EF core 1.1.1.
It looks like there are some differences between EF core 1.1.0 and 1.1.1
I am having a problem with nuget confliction
Thanks

use the latest of all ;)

seems to be working fine..


Introduce license-maven-plugin

Pasted from IRC:
<ppalaga> tsegismont: I have submitted the license plugin chnages to metrics https://github.com/rhq-project/rhq-metrics/pull/128
<ppalaga> tsegismont: especially this change might be of some interest to you https://github.com/ppalaga/rhq-metrics/commit/b1fa4ca30fa964f7b622ca9f0390d1b25bb1eca0
<ppalaga> tsegismont: It is basically just putting some explicit file extension to those file names, so that the license plugin knows how to add the license header
<ppalaga> tsegismont: I hope it is acceptable how I did it.
<ppalaga> tsegismont: You may wonder why I made the empty lines ignored https://github.com/ppalaga/rhq-metrics/commit/b1fa4ca30fa964f7b622ca9f0390d1b25bb1eca0#diff-413be26e43d8c1884f0e1efc9e079b0dR56
<ppalaga> tsegismont: It is because I was lazy to create a new license header definition that would not add an empty line at the end of license header.
<ppalaga> tsegismont: Where necessary, I added the empty query explicitly in the test https://github.com/ppalaga/rhq-metrics/commit/b1fa4ca30fa964f7b622ca9f0390d1b25bb1eca0#diff-413be26e43d8c1884f0e1efc9e079b0dR48

I reviewed the Influx grammar tests changes, they look good to me. Actually, I find your solution with empty query hardcoded in the test class more elegant (less error-prone).
Is that all the code changes you made? Actually there are too much files to review and I'm too lazy to checkout your PR and look at 307 header changes. I'm for merging as soon as Travis is happy (the Hawkular build tools dependency is missing right now).

@tsegismont only the "License headers added or fixed" commit ba434ce is that large - that is the result of running mvn license:format. Indeed it probably makes little sense to review that one. But all other commits are rather small and I'll feel better if someone looks at them before merging.

as soon as Travis is happy (the Hawkular build tools dependency is missing right now).

But Travis has JBoss Nexus configured, does it not? Let's try to rebuild.

Build tools are indeed not in https://repository.jboss.org/nexus/content/groups/public-jboss/ yet. I asked the jboss.org guys for help.

Le 21/01/2015 22:01, Peter Palaga a écrit :

@tsegismont https://github.com/tsegismont only the "License headers
added or fixed" commit ba434ce
https://github.com/rhq-project/rhq-metrics/commit/ba434ceda5eb19f2c290356dca694f890316b151
is that large - that is the result of running |mvn license:format|.
Indeed it probably makes little sense to review that one. But all other
commits are rather small and I'll feel better if someone looks at them
before merging.

Just reviewed the other ones. LGTM

But Travis has JBoss Nexus configured, does it not? Let's try to rebuild.

Yes Travis builds the project with a custom Maven settings file, where
JBoss repos are configured.

Le 21/01/2015 22:27, Peter Palaga a écrit :

Build tools are indeed not in
https://repository.jboss.org/nexus/content/groups/public-jboss/ yet. I
asked the jboss.org guys for help.

OK. Ping me when the build is green.


puppet: enable --storeconfigs on 2.7

without --storeconfigs it's going to complain alot if you have any exported
resources in your manifests.
on 2.6 --storeconfigs complains if you don't have activerecord, so leaving it enabled only for 2.7.

pulled, cheers :)


Update missing docs and adding JS/TS support in React

Did you build the project before submitting the PR?

[ ] Yes
[x] No

@AlphaByte-RedTeam your branch is not updated to the latest commit, I think this condition will last for a few hours since all the open PR about terser package. Try to update your branch tomorrow. Everything looks fine though, good job!

thanks a lot

Whenever you want you can update branch and this will be merged


Maintenance job behavior questions

A few questions on the behavior of this maintenance solution -

Your readme calls out that the job is only supported for SQL 2016 SP2+ and 2017+, does that include 2019?
Some logging tables contain "one row per run of the maintenance solution" and "one row per attempted maintenance action" – do those ever get cleaned up, or will we need to implement our own solution for that? Or will they never get very large?
What happens if the job gets killed by another process? . Will it overwrite the jobs on the next run? Will it error out because it's trying to create jobs that already exist?

Welcome to GitHub and thank you for reaching out! Here are answers to your questions:

The maintenance solution supports SQL Server 2019. I have updated the readme to be more clear on that point. Code reference here: https://github.com/jobbish-sql/SQL-Server-Multi-Thread/blob/master/core/sp_AgentJobMultiThread.sql#L453
The cleanup job deletes any data older than 100 days from the logging tables. Code reference here: https://github.com/jobbish-sql/SQL-Server-Multi-Thread/blob/master/cci_maintenance/CCI_Reorg_Rebuild_Code.sql#L2287
As possible, I recommend using the @max_minutes_to_run parameter and scheduling the job to start such that no jobs are killed by any other process. All work should automatically terminate before the time limit. If a job is killed by another process, the outcome depends on which job is killed.

The parent job typically runs for less than a minute. If it is killed then the impact can range from no jobs getting created or partial jobs getting created. Any child jobs created by the parent are likely to run as usual.
If the child jobs are killed then that's not a big deal. They are designed to be terminated by another process because the cleanup job calls sp_stop_job as needed.
The cleanup job runs once a minute until the workload is done and typically completes in just a few seconds. If the cleanup job is killed then it won't rerun. That is by design because I didn't want some unexpected error to cause the job to run for once a minute for eternity. So you could end up in a state where not all child jobs are terminated properly. However, if you have a process that's killing jobs then I assume that same process would also take care of the child jobs.
I am happy to answer any further questions.


Resubscribe on Reconnect to web socket

I am using Apollo Grapqhl android lib v1.0.0, using Rx extensions as well.
In our app's implementation, the Android client itself closes the web socket connection every 5 mins (after it is opened, regardless of whether subscriptions are alive or not).
Say I am on a screen, where the subscription is active and the screen refreshes periodically based on this subscription event's data. While I stay on this screen, my auto close countdown has hit and the connection is closed (whilst the subscription is active). Now, as soon as the connection is closed, I reattempt to connect to the websocket and I am successful. But in this case I am not able to resubscribe. I need to reconnect and resubscribe in this scenario.
When I auto close the connection, I don't get any callback to my subscription (onError of the stream is not triggered). So my subscription screen has no idea if the connection is closed.
This autoclose and reconnect is happening in the transport layer (I have written a custom web-socket-transport class). Whereas the subscription is happening in an Activity/Fragment layer.
Any workaround here?

Hi ! I guess you'll have to signal to the upper layers that the subscription needs to be restarted, maybe by throwing an Exception or something similar. I'm assuming you're implementing your own SubscriptionTransport? Can you share your implementation?
Also I would strongly suggest updating from 1.0.0, the latest version is 2.4.1 and has a ton of important fixes.

Hi! version 2.4.2 is just out with SubscriptionManager.reconnect(). Maybe that can help?

@martinbonnin - We have upgraded to the latest version of Apollo library. Our use cases necessitate that we perform a socket close operation every "x" mins. So we now call, subscriptionmanager.stop()
but "stop" clears all subscription records as well. So when we simply reconnect, these subscription records are lost, and we cannot automatically resubscribe when we reconnect.
Say user is on the screen where the subscription happens. He has subscribed successfully and is able to receive data, but "x" mins have passed and the socket connection closed (as per above use case). Now, when user reconnects to websocket, the subscription records are lost. so this will require a manual resubscription. How is this done?
Do we receive an onError callback for subscription when socket connection is closed when subscription is active?

Can you try to replace subscriptionmanager.stop() with subscriptionmanager.reconnect()? Would that work? Or do you need to keep the WebSocket closed? If you need to keep the WebSocket closed, what would trigger a reconnect?

@gayathri-nair03 any new developments here? Did you manage to make it work?

Hi 👋 ! I'm going to assume you found a solution and close this bug. If you still have the issue, it's worth checking 3.0.0-alpha01 that has a lot of changes around WebSockets


fix(tests): get subset of integration tests passing

This gets four additional cases passing and disables some problematic tests for now. All enabled tests should be expected to pass after this, so we can build incrementally on this base and ensure things stay green. :green_heart:

We expecting people to handle known hosts in the tests?
------------------------------
Apps with a deployed app
  can't create an existing app
  /Users/sethgoings/go/src/github.com/deis/workflow-e2e/tests/apps_test.go:128
Logged in as test-81
Creating Application... done, created test-805056191
Git remote deis added
remote available at ssh://git@deis.<IP_ADDRESS>.xip.io:2222/test-805056191.git
The authenticity of host '[deis.<IP_ADDRESS>.xip.io]:2222 ([<IP_ADDRESS>]:2222)' can't be established.
RSA key fingerprint is d4:1a:c0:76:e8:0f:3b:3d:da:c7:d3:aa:40:c9:b0:4e.
Are you sure you want to continue connecting (yes/no)?

I had a few hiccups when running tests against the cluster:

see host key acceptance prompt above
public key failures:

-----------------------------
Apps with a deployed app
  can get app info
  /Users/sethgoings/go/src/github.com/deis/workflow-e2e/tests/apps_test.go:140
Logged in as test-81
Creating Application... done, created test-875748990
Git remote deis added
remote available at ssh://git@deis.<IP_ADDRESS>.xip.io:2222/test-875748990.git
Permission denied (publickey).
fatal: Could not read from remote repository.

Please make sure you have the correct access rights
and the repository exists.
Destroying test-875748990...
done in 0s

• Failure in Spec Setup (BeforeEach) [2.362 seconds]
Apps
/Users/sethgoings/go/src/github.com/deis/workflow-e2e/tests/apps_test.go:179
  with a deployed app
  /Users/sethgoings/go/src/github.com/deis/workflow-e2e/tests/apps_test.go:178
    can get app info [BeforeEach]
    /Users/sethgoings/go/src/github.com/deis/workflow-e2e/tests/apps_test.go:140

    No future change is possible.  Bailing out early after 0.481s.
    Got stuck at:
        Permission denied (publickey).
        fatal: Could not read from remote repository.

        Please make sure you have the correct access rights
        and the repository exists.

    Waiting for:
        Done, test-875748990:v2 deployed to Deis

    /Users/sethgoings/go/src/github.com/deis/workflow-e2e/tests/apps_test.go:114

all successful!
all successful!
failures == apps:with a deployed app:can't create an existing app + apps: with a deployed app: can get app info
all successful!
all successful!
failures == apps:with a deployed app:can't create an existing app + apps: with a deployed app: can get app info

How can we solve the two sporadic "with a deployed app" tests [can't create existing app, can get app info]?

We expecting people to handle known hosts in the tests?

No--I guess that means the GIT_SSH script needs to be updated to avoid known host checking. I'll fix that.

This works well with make test-integration outside a cluster, but now times out on the two test cases mentioned by @sgoings when run through the deis-tests helm chart. I think the problem with running this inside a container has to do with the tests still needing to go through the router rather than DEIS_WORKFLOW_SERVICE_*. I'll fix that next.


feat(start): automatically run the status command if already started

What kind of change does this PR introduce?
Rather than asking the user to run the command to get the values Run the command for him so start command always return the infos of the running stack.
What is the current behavior?
Please link any relevant issues here.
What is the new behavior?
Feel free to include screenshots if it includes visual changes.
Additional context
Add any other context or screenshots.

Pull Request Test Coverage Report for Build<PHONE_NUMBER>5
Details

2 of 2 (100.0%)  changed or added relevant lines in 1 file are covered.
5 unchanged lines in 1 file lost coverage.
Overall coverage decreased (-0.02%) to 59.721%

Files with Coverage Reduction
New Missed Lines
%

internal/gen/keys/keys.go
5
12.9%

Totals

Change from base Build<PHONE_NUMBER>7:
-0.02%

Covered Lines:
7652

Relevant Lines:
12813

💛  - Coveralls


XDP_TX action support for XDP program types

Currently XDP program type only supports XDP_PASS and XDP_DROP. This issue is to add support for XDP_TX return value.
The behavior for XDP_TX:
"The XDP_TX action result in TX bouncing the received packet-page back out the same NIC it arrived on. This is usually combined with modifying the packet contents before returning action XDP_TX."

This is related to #125


EnderIO Machines spill items when inserting into full containers

Issue Description:
When EnderIO machines export items if they have a full stack in store they will try to export it even if there isn't room enough for it in the adjacent container, the rest will spill out into the world. Is that intended?
It's only happened with Storage Drawers so far, haven't tried anything else.

Affected Versions (Do not use "latest"):

EnderIO: 3.1.169
EnderCore: <IP_ADDRESS>-beta
Minecraft: 1.10.2
Forge: 2185
Mods: list.txt

https://youtu.be/__WQO1HXQaw

What kind of container?

Yes. The inventory we are trying to insert is first asked if it can take the items. If it says "yes" but then rejects the items we try to put them back...but you cannot put items into an output slot. So they spill...

This is the related issue: https://github.com/jaquadro/StorageDrawers/issues/396

Oh, well then.


MapSets should delete their members when they are deleted

Replicate #1251 for MapSets.

Maybe not. Will have to discuss this more.

Done.


Schematica MC 1.12.2 not displaying textures properly

Heres a screenshot of the issue. The mini map mod is the only other mod installed and the issue was occuring before it was added.
Lunatrius/forge/schematica are all up-to-date as of today.
Please help!

Try toggling VBOs in video settings, or removing optifine (if you have it installed).  See #258 (and, apparently, there's also #161)

Amazing! thanks for the quick reply. turning off VBOs worked instantly.


[OASIS] Integrate Oasis platform

Add Oasis ROSE coin support
Implement GetCurrentBlock, GetBlockByNumber & GetTrxOfAddress
Add tests

Codecov Report

Merging #1 (ff66fe3) into master (92cbf63) will decrease coverage by 0%.
The diff coverage is 35%.

@@          Coverage Diff          @@
##           master     #1   +/-   ##
=====================================
- Coverage      44%    44%   -1%
=====================================
  Files         147    151    +4
  Lines        4296   4356   +60
=====================================
+ Hits         1898   1919   +21
- Misses       2225   2264   +39
  Partials      173    173

Impacted Files
Coverage Δ

platform/oasis/base.go
0% <0%> (ø)

platform/oasis/block.go
0% <0%> (ø)

platform/oasis/client.go
0% <0%> (ø)

platform/oasis/transaction.go
72% <72%> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 92cbf63...ff66fe3. Read the comment docs.

Nice work! We are almost there!


[Image Name] [variant/version] EOL scheduled for [date]

Depends on [add a reference link here]

[ ] Create a release (if necessary - which ensures images are up to date before deprecating )
[ ] Open a PR
[ ] Update templates (if necessary)
[ ] Update https://github.com/devcontainers/images/issues/90
[ ] Update Microsoft Artifact Registry docs

Looks like this was created by accident, closing. If needed, feel free to reopen with more details, thank you!


[Popup] - config.inverted does nothing

Steps to Reproduce

Do something
initialise popup with config.inverted = true

Expected
The Popup should be reverted
Result
The Popup does not do this

If anyone lands here, please use the "data-inverted" attribute as specified in the docs.

Please check https://github.com/Semantic-Org/Semantic-UI/issues/3367


[Question] Build with npcap embedded on windows?

Hi,
Thanks you so much for that package it is so nice.
I'm building a windows application that uses gopacket, and I was wondering if there was a way for me to distribute a binary file without requiring the final user to install npcap on his machine ?

It is also possible to use winpcap.
If you want packet capture, the only supported way so far is libpcap (via winpcap or npcap).
As far as I know, it is also possible to open raw sockets on windows via winsock, but then again you need a raw socket provider. I only know winpcap or npcap that provide that (I don't have much windows experience). As far as I know there is also another api native in newer windows versions, with which one can read packets (but not send), but this one is not supported by gopacket.

Hi
I sorry I didn't updated this. I finally built something in c# using raw sockets, and it looks like nothing is required on the host machine. Thank you !


Support relative path wheels

Surprisingly, this is a lockfile schema change: We can't store relative paths in urls, so we drop the wheel entry with url and hash for path wheels.
Fixes #4355

Why do we drop the hash?

If the hash is important, i can add a new wheels entry variant. Currently, it's dropped because we can't represent the relative path as the url that wheels entries use.

I think it's worth adding two variants to wheels.

We don't drop the hash anymore.

Thanks, this looks good. It would be nice to remove the duplicated filename but... not critical.

Debugging test failure, then will merge.

Ok this is an actual Windows bug. We're caching the file under file:///C:/Users/runneradmin/AppData/Local/Temp/.tmppQrNqo/wheels/ok-1.0.0-py3-none-any.whl, but we then look for it later under file:///C:/Users/RUNNER~1/AppData/Local/Temp/.tmppQrNqo/wheels/ok-1.0.0-py3-none-any.whl.

I'm going to skip this test on Windows while I fix it.

(Just hid the counts and added a TODO.)


SUGGESTION: Limit nested results

Take the following example:
{
  Get{
    Things{
      Publication{
        name
        HasArticles(
		limit: 10 # <== SUGGESTION
        ){
          ... on Article{
            title
          }
        }
      }
    }
  }
}

The suggestion is to be able to limit the amount of sub-items.

Is this different from #970 or a duplicate?


Drop 'PREVIEW' from V4 emulator

Github issues should be used for bugs and feature requests. Use Stack Overflow for general "how-to" questions.
Version
Latest
Describe the bug
We should drop 'PREVIEW' from the product name.
The new name should consistently be 'Bot Framework Emulator'.
[bug]

Addressed in #1039

reopening this ticket as we still see some areas displaying PREVIEW


INVALID_ARGUMENT when running in the multi-host environment.

System information

OS Platform and Distribution (e.g., Linux Ubuntu 16.04): Linux Ubuntu 20.04
Flax, jax, jaxlib versions (obtain with pip show flax jax jaxlib:
Flax: 0.6.4
jax: 0.4.5
jax: 0.4.5
Python version: 3.8.10
GPU/TPU model and memory: GPU, A100-80GB
CUDA version (if applicable): 11.8

Problem you have encountered:
I am implenting a mulit-process multi-device NN training examples via pjit + jax.distributed.initilze, but encounter some strange errors. The pjitted function passes in the first two step, BUT crashes on the third step. like
for i in range(5):
            rng, data_rng = jax.random.split(rng)
            inputs = get_synthesis_data(data_rng, GLOBAL_BATCH)
            loss, state, variables = pjitted_train_step(inputs, state, variables)
            if args.process_id == 0:
                print(f"Step {i} - Loss: {loss}")

# Step 0 - Loss: 3.67165e-05
# Step 1 - Loss: 0.000104904
# 2023-02-24 15:02:52.048815: E external/org_tensorflow/tensorflow/compiler/xla/pjrt/pjrt_stream_executor_client.cc:2410]Execution of # replica 0 failed: INVALID_ARGUMENT: Executable expected shape f32[512,32,1024]{2,1,0} for argument 0 butgot incompatible shape f32[512,256,1024]{2,1,0}

Besides, if I change batch size, each batch size can successfully pass exact two steps, like
for i in range(2):
            rng, data_rng = jax.random.split(rng)
            inputs = get_synthesis_data(data_rng, BATCH_1)
            loss, state, variables = pjitted_train_step(inputs, state, variables)
            if args.process_id == 0:
                print(f"Step {i} - Loss: {loss}")

for i in range(2):
            rng, data_rng = jax.random.split(rng)
            inputs = get_synthesis_data(data_rng, BATCH_2)
            loss, state, variables = pjitted_train_step(inputs, state, variables)
            if args.process_id == 0:
                print(f"Step {i} - Loss: {loss}")

I saw there is a similar issue 2900, but the solution in that issue not works to mine.
What you expected to happen:
Expected to running without errors, like
# Step 0 - Loss: 3.67165e-05
# Step 1 - Loss: 0.000104904
# Step 2 - Loss: xxxxxxxxxxxx
# Step 3 - Loss: xxxxxxxxxxxx
# Step 4 - Loss: xxxxxxxxxxxx

Logs, error messages, etc:
Step 0 - Loss: 3.67165e-05
Step 1 - Loss: 0.000104904
2023-02-24 15:02:52.048815: E external/org_tensorflow/tensorflow/compiler/xla/pjrt/pjrt_stream_executor_client.cc:2410]Execution of # replica 0 failed: INVALID_ARGUMENT: Executable expected shape f32[512,32,1024]{2,1,0} for argument 0 butgot incompatible shape f32[512,256,1024]{2,1,0}

Steps to reproduce:
Whenever possible, please provide a minimal example. Please consider submitting it as a Colab link.
The full reproducer: https://github.com/mingxu1067/flax_mpmd_issues

This issue is resolved by collecting all local arrays in each processes to a shared device array, like
def get_synthesis_data(data_rng, mesh, pspec):
    tensors = jax.random.normal(data_rng, [BATCH_PER_GPU, HIDDEN], jnp.float32)
    inputs_shared = jax.make_array_from_single_device_arrays(
                    (GLOBAL_BATCH, HIDDEN),
                    jax.sharding.NamedSharding(mesh, pspec),
                    [tensors])
    return inputs_shared

You have to do this at every step? Does it slow your code down a lot?

@samblouir I do that at every step. About performance, I have not tested on any benchmark (just on an example), could not give answer here.


geojson.utils.generate_random not working correctly for polygon with boundingBox

I'm trying to send custom values in boundingBox, to generate random geometry.  The functions seems to be working correctly  for Point and Linestring, but having problem in Polygon

I think I might also be having the same issue. We have a db constraint that does not allow certain lat/long points to be crossed. I was hoping to restrict it via the bounding box.
The following error is generated via a db procedure. You can see the point generated.
couldn't project point (54 -91 0): latitude or longitude exceeded limits (-14)

This is the call
generate_random("Polygon", boundingBox=[-14, -14, 14, 14])

Hello @krishnaglodha and @Amertz08 I have not been able to reproduce this error. generate_random("Polygon", boundingBox=[-14, -14, 14, 14]) works as expected for me when I run it. If you can provide a code block that reproduces the error I will reopen this issue and investigate.

Hey,
I'm working with the generate_random function in utils, and it's not working correctly.
python==3.9.2 (also tried with 3.10.8)
geojson==2.5.0
from geojson import utils
utils.generate_random(featureType = 'Polygon', boundingBox = [-14, -14, 14, 14], numberVertices=10)

Output:
{"coordinates": [[[43, 71], [-2, 34], [-47, 50], [-42, 8], [-64, -26], [-53, -79], [2, -44], [18, -20], [117, -23], [61, 25], [43, 71]]], "type": "Polygon"}
Let me know if you need more information.


Update request: paperless-ngx 1.16.5 → 1.17.0

Package name: paperless-ngx
Latest released version: 1.17.0

Current version on the unstable channel: 1.16.5
Current version on the stable/release channel: 1.16.5

[X] Checked the nixpkgs pull requests

Notify maintainers

Note for maintainers: Please tag this issue in your PR.

@erikarvstedt @gador @lukegb


Is there one bug in GatherLightSamples

in cl kernel function GatherLightSamples
float4 radiance = 0.f;
it make radiance.w is 0.
this result in highlighting of the final pixel increases with the number of samples
other codes to add output in cl. eg: ShadeBackgroundImage
float4 v = make_float4(0.f, 0.f, 0.f, 1.f);
ShadeBackgroundEnvMap
float4 v = make_float4(0.f, 0.f, 0.f, 1.f);

this result in radiance of the final pixel increases with the number of samples

sorry , i found it in AdvanceIterationCount.


Add DIRS to new TEMPLATES setting

This will allow the discovery of the non-app project templates and fixes the test failure in #23.

Sorry, some more fixes were necessary. Should be ready for a release now, what do you think @stephenmcd?

Looks great - thanks a lot for all this work!

0.4.1 is on pypi now with Django 1.9 support: https://pypi.python.org/pypi/django-overextends/0.4.1

@stephenmcd Alas, I just noticed that support in 0.4.1 for Django 1.9 is subtly broken. 7606e62c0b0f5e3340158d4e1c1c0cefc486fa79 fixes that. Mind releasing something as 0.4.2?


Use blocking communication socket.

This fixes a myriad of issues on mac and windows. See #23, #21, #12.

It would be something so simple. Thanks!


Add request ID to all requests

This adds the X-Request-ID header to all requests that have it.
This will result in the following change:
- requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: https://huggingface.co/api/login
+ requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: https://huggingface.co/api/login (Request ID: T97cILAtyKzdWeL6dRYYW)

Closes https://github.com/huggingface/huggingface_hub/issues/906

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint.

Thanks!! ❤


Use arrays with PHP types

Right now we have to use something like this (please correct me if I'm wrong) to create array types:
  #[LiteralTypeScriptType('App.Http.Resources.Email[]|null')]
  public ?array $emails;

It would be great if we could reference PHP types directly and generate an array based on it.

You could do something like this:
#[TypeScriptType('?'.Email::class.'[]')]
public ?array $emails;

Which should do the trick, or you could implement your own attribute extending: https://github.com/spatie/typescript-transformer/blob/master/src/Attributes/TypeScriptTransformableAttribute.php this will automatically be converted to TypeScript. You could create an TypeScriptArray attribute?

Closed due inactivity

Hi, i have similar situation: array which can contains more than 10 types, and likely, it works with this construction)
        /** @var array<WaveTextBlockResource|ResultsBlockResource|VideoBlockResource|AwardsBlockResource|ProductExplanationBlockResource|SchoolListBlockResource|ReviewsBlockResource> */

        public readonly ?array $content,

but yeah, because we can't use multiline in PHPDoc it looks awful, so i create custom attribute for this as you said)
        #[TypeScriptArrayOfTypes([
            WaveTextBlockResource::class,
            ResultsBlockResource::class,
            VideoBlockResource::class,
            AwardsBlockResource::class,
            ProductExplanationBlockResource::class,
            SchoolListBlockResource::class,
            ReviewsBlockResource::class,
            DelimiterBlockResource::class,
            FAQsBlockResource::class,
            BenefitsBlockResource::class,
            MediaTextBlockResource::class,
            TrainingListBlockResource::class,
        ])]
        public readonly ?array $content

but still can use phpdoc array for simple situation without any modification)


Allow run_infrastructure.py to bring up no datastores.

Purpose
I've noticed that in certain places in our util scripts we're passing in postgres perhaps thinking this spins up the application database. It actually spins up the example_postgres datastore that we use for integration testing. We may also be doing this to avoid spinning up all datastores in those utli commands, because the run_infrasructure.py script will create all datastores by default if none are specified (so specifying only postgres is the lesser of those evils).
This PR updates run_infrastructure.py to allow no datastores to be spun up if an empty list is explicitly passed, meaning we don't have to wait for example_postgres to come-up in our util commands.

@seanpreston smart change here! good catch

I'm closing this for now, until we've migrated fully over to using nox to avoid wasting time updating two use cases.


Cannot install jina because these package versions have conflicting dependencies

Macbook M1
steps:
run pip install langchain-serve
ERROR: Cannot install jina because these package versions have conflicting dependencies.
The conflict is caused by:
opentelemetry-instrumentation-aiohttp-client 0.33b0 depends on opentelemetry-instrumentation==0.33b0
opentelemetry-instrumentation-fastapi 0.40b0 depends on opentelemetry-instrumentation==0.40b0
opentelemetry-instrumentation-aiohttp-client 0.33b0 depends on opentelemetry-instrumentation==0.33b0
opentelemetry-instrumentation-fastapi 0.39b0 depends on opentelemetry-instrumentation==0.39b0
opentelemetry-instrumentation-aiohttp-client 0.33b0 depends on opentelemetry-instrumentation==0.33b0
opentelemetry-instrumentation-fastapi 0.38b0 depends on opentelemetry-instrumentation==0.38b0
opentelemetry-instrumentation-aiohttp-client 0.33b0 depends on opentelemetry-instrumentation==0.33b0
opentelemetry-instrumentation-fastapi 0.37b0 depends on opentelemetry-instrumentation==0.37b0
opentelemetry-instrumentation-aiohttp-client 0.33b0 depends on opentelemetry-instrumentation==0.33b0
opentelemetry-instrumentation-fastapi 0.36b0 depends on opentelemetry-instrumentation==0.36b0
opentelemetry-instrumentation-aiohttp-client 0.33b0 depends on opentelemetry-instrumentation==0.33b0
opentelemetry-instrumentation-fastapi 0.35b0 depends on opentelemetry-instrumentation==0.35b0
opentelemetry-instrumentation-aiohttp-client 0.33b0 depends on opentelemetry-instrumentation==0.33b0
opentelemetry-instrumentation-fastapi 0.34b0 depends on opentelemetry-instrumentation==0.34b0
To fix this you could try to:

loosen the range of package versions you've specified
remove package versions to allow pip attempt to solve the dependency conflict

There has been a new release of jina that should have fixed this. Can you make sure to install jina==3.20.2 ?

I met with the same issue and tried the different version of jina but still does not work for me.

@JoanFM Hi, I finally fix issue by these steps:
pip install langchain-serve --use-deprecated legacy-resolver
pip install jina==3.20.2
pip install langchain-serve
I don't know why, but it works.


address.jsonnet file format and CUDA error

Hi,
I'm trying to reproduce the results, and I found llm_server_address.jsonnet and retriever_address.jsonnet necessary.
Can you provide an example scripts for these?
Also, I'm getting torch.cuda.OutOfMemoryError: CUDA out of memory error message. If you can give me some tips to prevent cuda error (e.g. where to reduce the batch size), that would be appreciated.
Thank you in advance :)

Oops, it looks like those files didn't get added as they were in my .gitignore. I've added them now.
Regarding OOM: There is no batching happening anywhere in the inference. It's all one instance at a time. To reduce memory usage, however, there are two things you can do.

Instead of default flan-t5 models, use the bf16 versions. Let's say you want to use flan-t5-xxl-bf16 instead of flan-t5-xxl, you'll need to change the occurrences of the former with later in the experiment config of your choice. E.g., for IRCoT QA Flan-T5-XXL MuSiQue run, you'll make that change in this file. Look at the file/config names in this folder and it should be clear. We did our T5-Flan-XXL experiments using A100 (80Gs) and the rest with A6000 (48Gs) without BF16. If you use BM16, you can do all experiments using 48Gs. From a few experiments I tried, using Huggingface's bf16 versions gives the same performance, but I haven't made an exhaustive comparison.
If you still can't fit it in your GPU memory, you can reduce the max number of token allowance for the model. You can do this by changing the model_tokens_limit in the experiment config (e.g., this one) from 6000 to a lower number. This will have some impact on the performance, but it may not be large depending on how much you have to reduce the context.

Thank you for quick & detailed explanation.
I'm new to FastAPI, and for the jsonnet files you provided, can I use http://localhost when you are running on the server? I'm running the code on my GCP, but I wasn't sure if I'm properly running FastAPI.

You can ignore Token indices sequence length is longer than the specified maximum sequence length for this model (558 > 512)., it's coming from HF.
The Post request didn't succeed. Will wait 20s and retry. means that your client cannot connect to the server. The client may not be able to connect for many reasons. So try putting a breakpoint at that point and see response = requests.post(url, json=params) ; print(response.text) gives you. Feel free to post it here again if you need help.

Thank you for the answer,
The issue I'm having is with the retriever server.
I'm able to access localhost:8000 which returns
{
  "message": "Hello! This is a retriever server."
}

However, when I run predict.py code, it seems the code is post requesting tolocalhost:8000/retrieve
which says:
{
  "detail": "Method Not Allowed"
}

I'm running your predict.py and it seems the error message (Post request didn't succeed. Will wait 20s and retry.) I'm getting is from ircot.py. I think I should not get "Method Not Allowed."

Can you confirm Method Not Allowed message is not obtained by visiting the browser at localhost:8000/retrieve and is instead obtained by putting a breakpoint in this line and seeing response.text? The method not allowed says there is no available route to the requested path (/retrieve) and method (get, post, etc). If you visit it on the browser, it's a GET request whereas the server expects a POST request. Let me know if this was already based on response.text and I can dig into it later what's going on.
Also, can you also confirm that your Elasticsearch server is running fine and you've already run the indexing scripts? You can check it by running curl localhost:9200/_cat/indices. It should show different indices and their sizes (which should match up to what's given in the readme, but the exact size wouldn't be a failure).

It seems I'm having issue with elasticsearch. I cannot access port 9200 on GCP. Let me resolve this issue and come back if the issue persists. Thank you again for your prompt responses.

Hi @minjunp
How did you fix the problem of not being able to access port 9200 on remote server? I seem to encounter the same issue
much thanks


About the diffusion model

Amazing work!
I will appreciate it if you can tell me how to train the diffusion model (hallucinate)  or give me some advice on how to learn and start the work(about diffusion model) like this?

Hi,
Sorry for the delay. We are still refactoring the training code to fit the new dataset format. We plan to release them near the main conference, however our recent schedule is a bit tight.
We can send you the old training scripts (not cleaned and tested yet), but you will need to adapt the data loader. Please send an email to<EMAIL_ADDRESS>Thanks


tests/drivers: i2s: Fix use of k_sleep

k_sleep requires k_timeout_t as argument.
Use K_USEC helper when required in i2s driver tests.
Fixes #25180
Signed-off-by: Erwan Gouriou<EMAIL_ADDRESS>

Duplicate of https://github.com/zephyrproject-rtos/zephyr/pull/25163


Eureka Server replication is not working for Multi instance of the Eureka Server.

I am using the below configuration for Eureka Servers.
Eureka Server1 (application.properties)
server.port=8761

eureka.client.register-with-eureka=true
eureka.client.fetch-registry=true
eureka.client.health-check.enabled=true

logging.level.com.netflix.eureka=DEBUG
logging.level.com.netflix.discovery=DEBUG

eureka.server.eviction-interval-timer-in-ms: 25000
eureka.server.enableSelfPreservation=false

eureka.instance.hostname=localhost
eureka.client.service-url.defaultZone=http://localhost:8762/eureka/

Eureka Server2 (application.properties)
server.port=8762

eureka.client.register-with-eureka=true
eureka.client.fetch-registry=true
eureka.client.health-check.enabled=true

logging.level.com.netflix.eureka=DEBUG
logging.level.com.netflix.discovery=DEBUG

eureka.server.eviction-interval-timer-in-ms: 25000
eureka.server.enableSelfPreservation=false

eureka.instance.hostname=localhost
eureka.client.service-url.defaultZone=http://localhost:8761/eureka/

Micro service configuration (appsettings.json)
{
  "Logging": {
    "IncludeScopes": true,
    "LogLevel": {
      "Default": "Information",
      "Pivotal": "Debug",
      "Steeltoe": "Debug"
    }
  },
  "spring": {
    "application": {
      "name": "fortuneService"
    }
  },
  "eureka": {
    "client": {
      "serviceUrl": {
        "defaultZone": "http://localhost:8761/eureka/,http://localhost:8762/eureka/"
      },
      "shouldFetchRegistry": true,
      "ValidateCertificates": false,
      "registryFetchIntervalSeconds": 10
    },
    "instance": {
      "appName": "FortuneService",
      "hostName": "localhost",
      "port": 52701,
      "instanceId": "FortuneService2",
      "leaseRenewalIntervalInSeconds": 10,
      "leaseExpirationDurationInSeconds": 5
    }
  }
}

I am facing an issue with when I connect the Multi instance of the Eureka Servers to Eureka Client(Microservices) that is not working for below scenario –
Let’s consider I have two Eureka Servers(ES1 – 8761 and ES2-8762)
ES1 server registered with ES2 Server and vice-versa.
When I start the Microservices, both services are registered with ES1 Server only, but not registered with ES2 server.
After sometime intentionally, I have stopped the ES1 server. Which are registered with ES1 server’s services are not replicating with ES2 server.
Please help me.

Can you try giving each Eureka server a unique hostname property?

@habuma I know you just went through this, do you see anything out of place here?

I am running 3 Eureka Servers, all three are up, but the Eureka Server's Dashboard displaying the replicas in the unavailable-replicas section. I don't know, why replicas displaying in the unavailable-replicas section?
I am using below configuration for Eureka Servers and Micro service.
Eureka Server1 (application.properties)
server.port=8761

eureka.client.register-with-eureka=true
eureka.client.fetch-registry=true
eureka.client.health-check.enabled=true

logging.level.com.netflix.eureka=DEBUG
logging.level.com.netflix.discovery=DEBUG

eureka.server.eviction-interval-timer-in-ms: 25000
eureka.server.enableSelfPreservation=false

eureka.instance.hostname=localhost1
eureka.client.service-url.defaultZone=http://localhost:8762/eureka/,http://localhost:8763/eureka/

eureka.shouldBatchReplication=true
eureka.instance.appname=eureka-cluster
eureka.instance.metadataMap.zone=Zone1

Eureka Server2 (application.properties)
server.port=8762

eureka.client.register-with-eureka=true
eureka.client.fetch-registry=true
eureka.client.health-check.enabled=true

logging.level.com.netflix.eureka=DEBUG
logging.level.com.netflix.discovery=DEBUG

eureka.server.eviction-interval-timer-in-ms: 25000
eureka.server.enableSelfPreservation=false

eureka.instance.hostname=localhost2
eureka.client.service-url.defaultZone=http://localhost:8761/eureka/,http://localhost:8763/eureka/

eureka.shouldBatchReplication=true
eureka.instance.appname=eureka-cluster
eureka.instance.metadataMap.zone=Zone1

Eureka Server3 (application.properties)
server.port=8763

eureka.client.register-with-eureka=true
eureka.client.fetch-registry=true
eureka.client.health-check.enabled=true

logging.level.com.netflix.eureka=DEBUG
logging.level.com.netflix.discovery=DEBUG

eureka.server.eviction-interval-timer-in-ms: 25000
eureka.server.enableSelfPreservation=false

eureka.instance.hostname=localhost3
eureka.client.service-url.defaultZone=http://localhost:8761/eureka/,http://localhost:8762/eureka/

eureka.shouldBatchReplication=true
eureka.instance.appname=eureka-cluster
eureka.instance.metadataMap.zone=Zone1

Micro service configuration (appsettings.json)
{
  "Logging": {
    "IncludeScopes": true,
    "LogLevel": {
      "Default": "Information",
      "Pivotal": "Debug",
      "Steeltoe": "Debug"
    }
  },
  "spring": {
    "application": {
      "name": "fortuneService"
    }
  },
  "eureka": {
    "client": {
      "serviceUrl": {
        "defaultZone": "http://localhost:8761/eureka/,http://localhost:8762/eureka/,http://localhost:8763/eureka/"
      },
      "shouldFetchRegistry": true,
      "ValidateCertificates": false,
      "registryFetchIntervalSeconds": 10
    },
    "instance": {
      "appName": "FortuneService",
      "hostName": "localhost",
      "port": 52701,
      "instanceId": "FortuneService2",
      "leaseRenewalIntervalInSeconds": 10,
      "leaseExpirationDurationInSeconds": 5,

      "metadataMap": {
        "zone": "Zone1"
      }
    }
  }
}

Please find the below screen shot of the Eureka Server's Dashboard

Please help me.

Hello everybody.
I've been kicking my way through this issue as well, and as I was typing up my detailed complaint to add to this thread, I inadvertently fixed my problem. Maybe I can help you as well.
I had to do two things.

Edit my hosts file (I am currently running locally in preparation for a deployment) so that the values in eureka.client.serviceUrl.defaultZone have different host names. I read in several threads that you should not use localhost, or the same ip or dns name for replicated Eureka instances.

Make sure the value of eureka.instance.hostname is the same value from my hosts file.

So, here is my config.
hosts file:
	<IP_ADDRESS>       eureka1
	<IP_ADDRESS>       eureka2

Base properties:
eureka.client.register-with-eureka=true
eureka.client.fetch-registry=true
eureka.instance.appName=ServiceRegistryCluster
eureka.environment=local

peer1 profile properties:
server.port=8761
eureka.client.serviceUrl.defaultZone=http://eureka2:8762/eureka/,http://eureka1:8761/eureka/
eureka.instance.hostname=eureka1
spring.application.name=EUREKA_SERVICE_REGISTRY_DEV

peer2 profile properties:
server.port=8762
eureka.client.serviceUrl.defaultZone=http://eureka1:8761/eureka/,http://eureka2:8762/eureka/
eureka.instance.hostname=eureka2
spring.application.name=EUREKA_SERVICE_REGISTRY_DEV

Now when I look at the Eureka console for eureka1, I see eureka2 listed as an available replica, and vice-versa for the eureka2 console.

I have tried what is mentioned above, but I am facing the same issue. The available replicas is empty. Also, what is mentioned in the official documentation, it does not work.
Is there a sample available which can help us?

I hava a question, in my yml,
i set a properties
prefer-ip-address: true,
that's the problem,  could explain why ？

@liuzwei i dont see how your question is related.  If you have a question please post something on StackOverflow or in Gitter.  If you think there is a bug please open an issue with a project that reproduces the problem.

Closing due to lack of feedback

Hi @illingtonFlex,
I followed the guide you provided. I seem to replicate my instances. However, there is any value for available-replicas

Is this the expected behavior?

Is this the expected behavior?

No, this means your two Eureka registries are not replicated, they are running independently of each other. One apparent difference I see between your config and mine is that you have different values for spring.application.name. Both of my Eureka instances are named the same, yours have different names.
I'm not sure if this is your issue or not. I would check the logs. They will fail to replicate if they can't find each other, or if they can't authenticate to each other also.

Hi @illingtonFlex,
You are right about instance name, I now have the servers having same name and now, I can see: available-replicas having a value
My next question is: What will be the right configuration for the application using Eureka? More specifically: eureka.client.service-url.defaultZone
I'm currently using: eureka.client.service-url.defaultZone=http://localhost:8761/eureka/,http://localhost:8762/eureka/ is this correct? or Do I  only need to set it to http://localhost:8761/eureka/?
Cheers!

My next question is: What will be the right configuration for the application using Eureka? More specifically: eureka.client.service-url.defaultZone
I'm currently using: eureka.client.service-url.defaultZone = http://localhost:8761/eureka/,http://localhost:8762/eureka/ is this correct? or Do I only need to set eureka.client.service-url.defaultZone = http://localhost:8761/eureka/?

According to the documentation, which I recommend reading, the value for that property is a list of eureka servers the client will iterate through if the first one is unavailable. I don't recommend using localhost. Use the DNS/host name you configured for the replication. Also you have a typo in the property name.
eureka.client.service-url.defaultZone=http://eureka1:8761/eureka/,http://eureka2:8762/eureka/

I see it has been closed but though I read all the comments and tried to apply the solutions I'm still stuck with those unavailable replicas.
I have a very simple docker project here that you can try as example: https://github.com/ecornely/eureka-docker
I'm made sure one container can ping the other by name (aliases are working well) I have set the same application name as it is suppose to come from application.yml packaged in the jar, I use the hostname to reference the other replicas...
I also have a no-security branch without spring-security aso... really I don't understand what make my replicas unavaliable...
Please help


Error Attempt to call method 'complete' (a nil value)

Hello :)
I recently updated my plugins and after I did I was met with the following error

I did some investigating in the code and found the bug and I have a fix for it:
In source.lua line 57 opts.method gives the value getCompletionCycling and not getCompletionsCycling (The difference is the singular Completion vs Completions). Then when it's passed down to completion_functions.init in line 88, completion_functions don't have the method getCompletionCycling so everything returns back nil which causes the mentioned error above when trying to call the complete function from source
I would love to create a pull request for the fix myself but if that's not possible I can provide snippets for the fix :)
Thank you for making an amazing plugin, I use it everyday ⭐ 😁

I got the same error yesterday . Hope this can be fixed ASAP.

I checked in source.lua and this is what I found:
local completion_fn = opts.method or "getCompletionsCycling"
opts.method is the field corresponding to your configuration options. This is a config issue.
Since there's no longer multiple completion_fn options implemented due to changes in copilot itself, I went ahead and pushed a change which will make it impossible to override the value.
I kind-of want to keep it the way it is so people can write their own completion methods if they want, but I think it is more trouble than it is work atm.


 The model was tested on 4x down-scaled images from the ADNI brain dataset, in which the model used 4x up-scaling to bring the image back to the original resolution. Perceptual quality of the up-scaled images in comparison with the original images shows a reasonably clear image and good results. Here is an example of the perceptual quality of up-scaled images produced by the model:

Changes made:

Add dataset.py which preprocesses images from the ADNI brain dataset and sets up train, validation, and test data loaders.
Add modules.py which contains the ESPCN model.
Add train.py which trains the ESPCN model using the ADNI brain dataset train and validation data loaders.
Add predict.py which uses the test data loader to produce plots of the original, down-scaled, and up-scaled images for comparison.
Add images folder which stores images that are used for documentation.

Ensure that PyTorch (version 2.1.0+cu121) and PyTorch Vision (version 0.16.0+cu121) are installed. Whilst not a requirement, it is recommended that a GPU is available for training the model as it will greatly decrease the time taken to train the model. The ADNI brain dataset will need to be downloaded externally to the project and paths to the dataset will need to be set in the dataset.py file.
Author: Benjamin Guy (46972990)

This is an initial inspection - no action is required yet
Difficulty: Normal
General Comments:
[Recognition Problem]
"modules.py":

Implements PixelCNN without any architectural changes. Does allow for a variable upscaling factor. All looks ok.

"dataset.py":

SuperResolutionDataset has a redundant resize, otherwise the implementation is nice and makes use of ImageFolder.
Creates a train and validation set randomly.
Normalizes images in a way that changes the contrast, which can be seen in the README.

"train.py":

Nice training loop, correctly aggregates and reports training and validation losses at the end of each epoch.
Provides a mechanism to get average test loss on the test dataset at the end of training.
Saves model correctly and generates some figures.

"predict.py":

Doesn't provide a way to see metrics on the test dataset (but this is in "train.py").
Correctly loads trained weights and generates some input/output figures.

"README.MD":

Provides a description of the network architecture and prints the network structure.
Provides some examples of the inputs and outputs, results seem ok but with a slight change to the contrast of the images.
Provides the folder structure (same as provided as the dataloaders handle the AD and NC folders).
Provides a training and validation loss to demonstrate there is no over-fitting occurring, however, it does seem the network could have continued training for a few more epochs (only 10 run).
No dependencies noted.

[Commit Log]
Seems to have a thorough commit log.

Marking
Good Practice (Design/Commenting, TF/Torch Usage)
Adequate design and implementation
Good spacing and comments
Header blocks
Recognition Problem
Solves problem
Driver Script present
File structure present
Shows Usage & Demo & Visualisation & Data usage
Module present
Commenting
No Data leakage
Difficulty: Normal -5
Commit Log
Meaningful commit messages
Progressive commits used
Documentation
ReadMe good
Model/technical explanation
Good Description and Comments
Markdown used and PDF submitted
Pull Request
Successful Pull Request (Working Algorithm Delivered on Time in Correct Branch)
No Feedback required
Request Description good


Broken deployment

It seem the deployment is somehow broken on railway. Throbbers does not dissapear :(

Hi @LukasZubal,
I'll look into this but it may be a platform issue with Railway.
I'll try doing a deploy right now.

Hi @LukasZubal,
I was just able to deploy and configure a new instance of Plausible via Railway.
This might be an issue with your account or cache in your web browser. I would recommend reaching out to Railway directly on either the forum or their discord

Yes,bad account. Thank you for quick response. Lukas


Add ability to perform accuracy checks / repair sink data

Building on the work in https://github.com/openedx/aspects-dbt/issues/102 I think we should add some checks that an operator can run to see if Aspects matches the source of truth tables for important data. This would require connecting ClickHouse to MySQL and running some potentially large queries, but would also be expected to either be run manually or during low traffic times to prevent causing performance issues.
Some high level thoughts:

We should be able to run dbt test at any point to check the data in ClickHouse if the tests in the above issue are written in a performant way. My experience in the past with OLAP databases and dbt test makes me think we do want some kind of "fudge factor" for the fact that data is constantly flowing in, either only checking against data more than X minutes old or allowing for some amount of slop around the acceptable test conditions to account for it
We should be able to check event sink source tables fairly easily (give or take all of the xblocks in a course) by comparing counts between MySQL and ClickHouse tables, since they are effectively mirrors. We should be able to check course publish times to make sure we have the freshest courses.
For event sinks we should also be able to optionally "repair" those tables by triggering sink dumps for known missing IDs
We should be able to compare these items for users fairly easily: currently enrolled, passing/failing, enrollment track, current grade, current email address (if PII is on)
I don't think we should focus on engagement as most of those events are transient and have no analog source of truth
We may be able to identify and report outage times by aggregating timestamps in the missing data to direct operators to places where logs may need to be replayed. For example if there are 15 incorrect / missing rows in ClickHouse for enrollments, we should be able to pull the CourseEnrollment created datetime or CourseEnrollmentHistory rows and check when updates were missed
We could run in different check modes, like "last x days", "random sample", and "by course" to limit the amount of data processed

This ticket is just to start the conversation, but once we decide on a list of features it can be converted into an epic with a number of sub-tasks.

@Ian2012 @saraburns1 @pomegranited I'd love your thoughts and feedback on this and the accompanying aspects-dbt ticket. I think it's the next major chunk of work we can do while waiting on feedback from v1.

Sounds cool!
I think the sink repair and outage reports should be follow ups since getting the connections set up and doing all the validations should be first priority. Could either be a separate epic or just fast-follow tickets.
Also wanted to bring up a probably rare case, but we should think about what happens if MySQL is missing data that exists in Clickhouse (like if a SQL transaction failed after the data was already sent downstream). Would we delete CH data since SQL is the source of truth? Could there be mismatched data from a failed update (in which case CH might be more accurate)?

Another point to add is data bootstrapping:
Suppose I have an existing Open edX instance with lots of users / courses / enrollments, and I add Aspects to the deployment. The sinks would catch any newly triggered events, so would be partially populated, but they will need to be repaired to receive the old data.

@pomegranited right! It would be able to either run or form the correct management commands to backfill sinks where needed. One nit we should keep in mind is data that is older than the TTL, which we shouldn't alert or backfill on.


BUILD FAILED (Ubuntu 20.04 using ruby-build 20230717)

Steps to reproduce
ruby-build 3.1.2 ~/local/ruby-3.1.2 on ubuntu 20.0.4

Expected vs. actual behavior
To follow progress, use 'tail -f /tmp/ruby-build.20230803173252.76809.log' or pass --verbose
Downloading ruby-3.1.2.tar.gz...
-> https://cache.ruby-lang.org/pub/ruby/3.1/ruby-3.1.2.tar.gz
Installing ruby-3.1.2...

Logs
Inspect or clean up the working tree at /tmp/ruby-build.20230803173252.76809.Rjr4LZ
Results logged to /tmp/ruby-build.20230803173252.76809.log

Last 10 log lines:
installing bundled gem cache:       /home/adesoji/local/ruby-3.1.2/lib/ruby/gems/3.1.0/cache
The Ruby openssl extension was not compiled.
ERROR: Ruby install aborted due to missing extensions
Try running `apt-get install -y libssl-dev` to fetch missing dependencies.

Configure options used:
  --prefix=/home/adesoji/local/ruby-3.1.2
  --enable-shared
  LDFLAGS=-L/home/adesoji/local/ruby-3.1.2/lib
  CPPFLAGS=-I/home/adesoji/local/ruby-3.1.2/include

I have installed apt-get install -y libssl-dev`  countless number of times and it was succesful. Help!!!

Hi, not sure why this failed if you've installed libssl-dev! If you observe the Results logged to <file> line, you will find a full log file. You could paste that log into a https://gist.github.com and share the link here. Thanks

@mislav https://gist.github.com/Adesoji1/94742dba251d7c0d9d4ce291872340f0


If different object types generate the same HashCode the program can fail to find differences

I found that if a parent object have the same HashCode that its child object the program fails to find differences in the child object.
Example code:
In the code below I have a parent that always will get the same Hashcode that its Child. When testing the program cant find the difference between the child objects despite that one have Value=1 and the other Value = 2.
    public class Child
    {
        public int Value { get; set; }
        public override int GetHashCode()
        {
                return Value;
        }
    }
    public class Parent
    {
        public int Value { get; set; }
        public Child Child { get; set; }
        public override int GetHashCode()
        {
            return Child.Value;
        }
    }
    [Test]
    public void TestMethod()
    {
        var parent1 = new Parent() {Value= 1, Child = new Child() {Value = 1} };
        var parent2 = new Parent() {Value= 1, Child = new Child() {Value = 2} };

        var comparer = new CompareLogic();
        var result = comparer.Compare(parent1, parent2);

        Assert.IsFalse(result.AreEqual);
    }

Msdn states the following:
Two objects that are equal return hash codes that are equal. However, the reverse is not true: equal hash codes do not imply object equality, because different (unequal) objects can have identical hash codes.
•You should not assume that equal hash codes imply object equality.
https://msdn.microsoft.com/en-us/library/system.object.gethashcode(v=vs.110).aspx
Regards
Mikael W

Mikael,
I am not fixing this one.
Thanks,
Greg

Without digging into the code of Compare-Net-Objects it looks like Compare-Net-Objects only checks the hash for this case. Is this a correct assumption?

That is correct.


1.11 containers "already active" after ungraceful shutdown

(found during debugging of https://github.com/docker/docker/issues/22895 (https://github.com/docker/docker/issues/22895#issuecomment-220939087))
after ungraceful killing docker daemon (kill -9 <daemon-pid> and starting again, docker ps shows that the container is exited;
CONTAINER ID        IMAGE                COMMAND                CREATED             STATUS                      PORTS               NAMES
eb8eaa41b8b3        supertest2014/nyan   "/bin/sh -c nyancat"   18 minutes ago      Exited (0) 15 minutes ago                       nan

However, starting the container doesn't work, looks like the state of docker-containerd and docker daemon are out of sync in that case;
May 23 05:56:46 digitalocean docker[16723]: time="2016-05-23T05:56:46.201963383-04:00" level=error msg="Handler for POST /v1.23/containers/nyan/start returned error: Container eb8eaa41b8b36a56b34502458f4bf44c64e9a8a28c5bb815533525862e4e2210 is aleady active"

stopping and starting again doesn't work either;
docker stop nyan
nyan
docker start nyan
Error response from daemon: Container eb8eaa41b8b36a56b34502458f4bf44c64e9a8a28c5bb815533525862e4e2210 is aleady active
Error: failed to start containers: nyan

(and logs:)
May 23 05:59:06 digitalocean docker[16723]: time="2016-05-23T05:59:06.947435285-04:00" level=error msg="Handler for POST /v1.23/containers/nyan/stop returned error: Container nyan is already stopped"
May 23 05:59:20 digitalocean kernel: [ 4099.466155] aufs au_opts_verify:1597:docker[16740]: dirperm1 breaks the protection by the permission bits on the lower branch
May 23 05:59:20 digitalocean kernel: [ 4099.471178] device vethdfa5ed8 entered promiscuous mode
May 23 05:59:20 digitalocean kernel: [ 4099.471302] IPv6: ADDRCONF(NETDEV_UP): vethdfa5ed8: link is not ready
May 23 05:59:20 digitalocean systemd-udevd[16880]: Could not generate persistent MAC address for vethdfa5ed8: No such file or directory
May 23 05:59:20 digitalocean systemd-udevd[16879]: Could not generate persistent MAC address for veth7f497e4: No such file or directory
May 23 05:59:20 digitalocean kernel: [ 4099.488728] docker0: port 1(vethdfa5ed8) entered disabled state
May 23 05:59:20 digitalocean kernel: [ 4099.489824] device vethdfa5ed8 left promiscuous mode
May 23 05:59:20 digitalocean kernel: [ 4099.489828] docker0: port 1(vethdfa5ed8) entered disabled state
May 23 05:59:20 digitalocean docker[16723]: time="2016-05-23T05:59:20.346948775-04:00" level=error msg="Handler for POST /v1.23/containers/nyan/start returned error: Container eb8eaa41b8b36a56b34502458f4bf44c64e9a8a28c5bb815533525862e4e2210 is aleady active"

To resolve this, doing a "clean" restart of the daemon;
systemctl restart docker
docker start nyan
nyan
docker ps
CONTAINER ID        IMAGE                COMMAND                CREATED             STATUS              PORTS               NAMES
eb8eaa41b8b3        supertest2014/nyan   "/bin/sh -c nyancat"   22 minutes ago      Up 8 seconds

note that this is not the same issue as https://github.com/docker/docker/issues/22851, which is for experimental, and related to systemd

fixed by https://github.com/docker/docker/issues/22947

@ashleydw Any chance you have daemon logs from the time this exit/restart case happened?

@tonistiigi:
journalctl -fu docker.service
-- Logs begin at Sun 2016-11-27 15:15:48 UTC. --
Nov 27 17:57:05 ip-10-60-152-72 dockerd[25417]: time="2016-11-27T17:57:05.058760679Z" level=error msg="containerd: start container" error="oci runtime error: stat /var/lib/docker/devicemapper/mnt/be94f3f5d76976bab84181213f0bdc8af261f03181f744ef10f9e33984baa3cd/rootfs: input/output error\n" id=5bbb2aafd213af40eb50a6ffe833f028923786b2d62fc7628ff6612c02f1070f
Nov 27 17:57:05 ip-10-60-152-72 dockerd[25417]: time="2016-11-27T17:57:05.066872843Z" level=error msg="libcontainerd: error restarting rpc error: code = 13 desc = invalid header field value \"oci runtime error: stat /var/lib/docker/devicemapper/mnt/be94f3f5d76976bab84181213f0bdc8af261f03181f744ef10f9e33984baa3cd/rootfs: input/output error\\n\""
Nov 27 17:57:05 ip-10-60-152-72 dockerd[25417]: time="2016-11-27T17:57:05.068164351Z" level=error msg="libcontainerd: rpc error: code = 13 desc = invalid header field value \"oci runtime error: stat /var/lib/docker/devicemapper/mnt/be94f3f5d76976bab84181213f0bdc8af261f03181f744ef10f9e33984baa3cd/rootfs: input/output error\\n\""
Nov 28 08:45:04 ip-10-60-152-72 dockerd[25417]: time="2016-11-28T08:45:04.973627538Z" level=error msg="Create container failed with error: Container 5bbb2aafd213af40eb50a6ffe833f028923786b2d62fc7628ff6612c02f1070f is already active"
Nov 28 08:45:05 ip-10-60-152-72 dockerd[25417]: time="2016-11-28T08:45:05.112824811Z" level=error msg="Handler for POST /v1.24/containers/[redacted]/start returned error: Container 5bbb2aafd213af40eb50a6ffe833f028923786b2d62fc7628ff6612c02f1070f is already active"
Nov 28 08:48:55 ip-10-60-152-72 dockerd[25417]: time="2016-11-28T08:48:55.177377742Z" level=error msg="Create container failed with error: Container 5bbb2aafd213af40eb50a6ffe833f028923786b2d62fc7628ff6612c02f1070f is already active"
Nov 28 08:48:55 ip-10-60-152-72 dockerd[25417]: time="2016-11-28T08:48:55.324806854Z" level=error msg="Handler for POST /v1.24/containers/[redacted]/start returned error: Container 5bbb2aafd213af40eb50a6ffe833f028923786b2d62fc7628ff6612c02f1070f is already active"```

I've had a very similar problem
$ docker start reverse_nginx
Error response from daemon: Container f3e9fe7ba5eeed57f35c8c53413be71636acc2a796dc76533f6ef0328af3f56d is already active
Error: failed to start containers: reverse_nginx

There was a sudden power cut about a week ago, which if the journalctl command is to be believed is about right (didn't know this utility before so just copying above):
$ journalctl -fu docker.service
-- Logs begin at Wed 2016-11-23 22:45:37 GMT. --
Nov 26 17:49:58 hp dockerd[2289]: time="2016-11-26T17:49:58Z" level=info msg="Firewalld running: false"
Nov 28 12:39:47 hp dockerd[2289]: time="2016-11-28T12:39:47Z" level=info msg="Firewalld running: false"
Nov 28 12:39:48 hp dockerd[2289]: time="2016-11-28T12:39:48Z" level=info msg="Firewalld running: false"
Nov 28 12:39:48 hp dockerd[2289]: time="2016-11-28T12:39:48.892243088Z" level=error msg="containerd: start container" error="oci runtime error: exec: \"nginx\": executable file not found in $PATH" id=f3e9fe7ba5eeed57f35c8c53413be71636acc2a796dc76533f6ef0328af3f56d
Nov 28 12:39:48 hp dockerd[2289]: time="2016-11-28T12:39:48.912958832Z" level=error msg="libcontainerd: error restarting rpc error: code = 2 desc = oci runtime error: exec: \"nginx\": executable file not found in $PATH"
Nov 28 12:39:48 hp dockerd[2289]: time="2016-11-28T12:39:48.913366710Z" level=error msg="libcontainerd: rpc error: code = 2 desc = oci runtime error: exec: \"nginx\": executable file not found in $PATH"
Dec 03 18:41:38 hp dockerd[2289]: time="2016-12-03T18:41:38.900741998Z" level=error msg="Create container failed with error: Container f3e9fe7ba5eeed57f35c8c53413be71636acc2a796dc76533f6ef0328af3f56d is already active"
Dec 03 18:41:39 hp dockerd[2289]: time="2016-12-03T18:41:39.511293471Z" level=error msg="Handler for POST /v1.24/containers/reverse_nginx/start returned error: Container f3e9fe7ba5eeed57f35c8c53413be71636acc2a796dc76533f6ef0328af3f56d is already active"
Dec 03 18:42:06 hp dockerd[2289]: time="2016-12-03T18:42:06.285673204Z" level=error msg="Create container failed with error: Container f3e9fe7ba5eeed57f35c8c53413be71636acc2a796dc76533f6ef0328af3f56d is already active"
Dec 03 18:42:06 hp dockerd[2289]: time="2016-12-03T18:42:06.767394236Z" level=error msg="Handler for POST /v1.24/containers/reverse_nginx/start returned error: Container f3e9fe7ba5eeed57f35c8c53413be71636acc2a796dc76533f6ef0328af3f56d is already active"

Rebuilding the image worked fine, but I'd be concerned if this was connected to a storage volume.

@ashleydw @ndevenish Thanks you for the report. That issue shoud be fixed by https://github.com/docker/docker/pull/27169

@tonistiigi does the fix ship in 1.13 ?

@SamSaffron yes

@tonistiigi tangential but related, does this change have any impact or relation to docker-containerd-shim  we run --live-restore so upgrades are more ... seamless
I take it the change is isolated to containerd daemon and docker daemon, has no impact on the shim or runc?

@SamSaffron No. #27169 is docker-only issue. The original issue was with restoring old containers though, so --live-restore containers have a different code-path there.


Feat: Validation Rule Methods

Adds validation rule methods.
Let me know which other rules that should be added.

I'm not sure if we should have a method for every single available validation rule, since you can just pass it to the rule() or rules() method already.
What do you think, @danharrin?

I think we should cover every single Laravel rule 🤷♂ It doesnt add overhead and makes the syntax consistent

Okay, let's go all the way then.

What rules like exclude (we already have that functionality from ->dehydrate(false))?

Sorry I actually completely forgot about this, let me try to get this PR ready for review

A list of rules we dont need:

Any rule variants that use "if" or "unless" - you can do this with closures
Bail
Distinct
Exclude
Prohibited
Required *
String

Why don't we need the string rule, @danharrin? I wondered this recently as I usually add that rule to my validation but couldn't find any reference in Filament.

I don't see why anyone would really need it?

Couldn't potentially an array be passed as the value for an input that expects a string? Maybe that's guarded by a type hint, but I'm just evaluating the extremes here.

Apart from those, all done?

Thanks so much for your work on this!


add coveralls and travisCI badge to README

Changes Unknown when pulling 9e18839ce810d2e60a87a45d6c7f959f322e2594 on patch-1 into ** on master**.

Changes Unknown when pulling 8dfa91db9faa23648771174b65727aed4a0f40ac on patch-1 into ** on master**.


Migrate the portainer executor over to a self-contained pex file

Thanks @orls for implementing!

Would you mind updating the executor section of the readme to talk more about PEX?

Done; let me know your thoughts.

One thing that's maybe worth mentioning (but I didn't want to clutter the readme any more, it's getting rather long!):
Because of the way our 'traditional', un-pexed bin-scripts work, it is still possible to do things the old way and just use a zip of the raw source. The runtime invoke (made by the scheduler) is the same, bin/portainer build-executor (*), meaning that the pex is just a faster route to getting dependencies and python package faff out of the way. Functionally, they're identical.
(This is rather neat, and is a validation both of our bin/setup / virtualenv approach and of pex itself!)

-- as an aside, that's such a troll command name -- it's confusing and janky having bin/portainer build-executor, with "build" being a noun ("the executor for the build"),  and also having the util script bin/build-executor with "build" as a verb ("build the executor"). Gah.

:+1: :shipit:
Nice!


Posts should support oEmbed

http://oembed.com/
If you have a post that has a link to youtube, etc. we should be able to roll up that content's oembed data and present it nicely. Here's an example post: https://forum.firestormforum.org/categories/8/threads/11
The youtube link should cause a youtube embed to show up in the post

I'm going to try to use https://github.com/r8/elixir-oembed

This is working at a basic level but we need to add an LRU cache and set a max timeout for a reply, failing silently if it takes too long to chat with the remote service to get the oembed data


doctest: 2.3.7 -> 2.3.8

Semi-automatic update generated by nixpkgs-update tools. This update was made based on information from https://github.com/onqtam/doctest/releases.
meta.description for doctest is: "The fastest feature-rich C++11/14/17/20 single-header testing framework"
meta.homepage for doctest is: "https://github.com/onqtam/doctest"
Updates performed

Version update

To inspect upstream changes

Release on GitHub

Compare changes on GitHub

Impact

Checks done (click to expand)

built on NixOS

The tests defined in passthru.tests, if any, passed

0 of 0 passed binary check by having a zero exit code.

0 of 0 passed binary check by having the new version present in output.

found 2.3.8 with grep in /nix/store/srjqr92mx184sfj1absrr4m74mihm0gw-doctest-2.3.8

directory tree listing: https://gist.github.com/9356d04d8bba2d3f09adf4cadf535310

du listing: https://gist.github.com/c49661ad2a05aee21b3974a6dd7184db

Rebuild report (if merged into master) (click to expand)

6 total rebuild path(s)

2 package rebuild(s)

2 x86_64-linux rebuild(s)
2 i686-linux rebuild(s)
0 x86_64-darwin rebuild(s)
2 aarch64-linux rebuild(s)

First fifty rebuilds by attrpath
doctest
sycl-info

Instructions to test this update (click to expand)

Either download from Cachix:
nix-store -r /nix/store/srjqr92mx184sfj1absrr4m74mihm0gw-doctest-2.3.8 \
  --option binary-caches 'https://cache.nixos.org/ https://r-ryantm.cachix.org/' \
  --option trusted-public-keys '
  r-ryantm.cachix.org-1:gkUbLkouDAyvBdpBX0JOdIiD2/DP1ldF3Z3Y6Gqcc4c=
  cache.nixos.org-1:6NCHdD59X431o0gWypbMrAURkbJ16ZPMQFGspcDShjY=
  '

(r-ryantm's Cachix cache is only trusted for this store-path realization.)
For the Cachix download to work, your user must be in the trusted-users list or you can use sudo since root is effectively trusted.
Or, build yourself:
nix-build -A doctest https://github.com/r-ryantm/nixpkgs/archive/c644a17b004f91779acce907ac94134ed57027c7.tar.gz

After you've downloaded or built it, look at the files and if there are any, run the binaries:
ls -la /nix/store/srjqr92mx184sfj1absrr4m74mihm0gw-doctest-2.3.8
ls -la /nix/store/srjqr92mx184sfj1absrr4m74mihm0gw-doctest-2.3.8/bin

Pre-merge build results
We have automatically built all packages that will get rebuilt due to
this change.
This gives evidence on whether the upgrade will break dependent packages.
Note sometimes packages show up as failed to build independent of the
change, simply because they are already broken on the target branch.
Result of nixpkgs-review 1

2 packages built:
- doctest
- sycl-info

Maintainer pings
cc @davidtwco for testing.

Changelog looks reasonable.


rephrase a sentence

to make it more clear and self-explaining

@oshai thanks but it was changed because of the last pull request, can you rebase your changes please?

@Urigo I did that.

thanks!


GitHub package versioning

Is your feature request related to a problem? Please describe.
Users would like to be able to check what version of the R package they are using, and if they already have the most recent version installed.
Describe the solution you'd like
Add the version to the start up message when the package loads via library(TADA). See example code below.
See: https://stackoverflow.com/questions/67986577/how-to-create-custom-start-up-messages-for-r-packages
https://stackoverflow.com/questions/2192360/library-package-development-message-when-loading
.onAttach <- function(libname, pkgname) {
  packageStartupMessage("This is version ", packageVersion(pkgname),
                        " of ", pkgname)
}

Then, use “packageVersion” to get current version and “available.packages” to get CRAN version.
Probably need to use tryCatch to avoid timeout issues (or when user does not have internet).
get_cran_version <- function(package_name) {
  cran_version <- tryCatch(available.packages()[package_name, "Version"], error = function(x) NULL)
  return(cran_version)
}

> get_cran_version("baytrends")
[1] "2.0.11"

Here is what ggplot2 has at startup:
https://github.com/tidyverse/ggplot2/blob/main/R/zzz.R
That all assumes CRAN.  If working only on GitHub for the package it is more complicated.
Example code below
> library(httr)
> library(jsonlite)
>
> # Replace 'username' and 'repo' with the GitHub username and repository name
> github_url <- [https://api.github.com/repos/USEPA/TADA/releases/latest](https://gcc02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fapi.github.com%2Frepos%2FUSEPA%2FTADA%2Freleases%2Flatest&data=05%7C02%7CMullin.Cristina%40epa.gov%7C137e90358cd24781390308dc42b8b781%7C88b378b367484867acf976aacbeca6a7%7C0%7C0%7C638458608333286471%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C0%7C%7C%7C&sdata=Zj61D%2B6wXkFMoOMe1muQ2ajYMKcDaBnTa%2F73axjfLDM%3D&reserved=0)
>
> response <- GET(github_url)
> if (http_status(response)$category == "Success") {
+     latest_release <- content(response)
+     latest_version <- latest_release$tag_name
+     print(paste("Latest version:", latest_version))
+ } else {
+     print("Failed to retrieve latest release information.")
+ }
[1] "Failed to retrieve latest release information."

The kicker here is you have to use “releases” on GitHub.  If you do it works.
Here is a package I did for MD DNR.
https://github.com/leppott/MBSStools/releases
And it matches.
> # Replace 'username' and 'repo' with the GitHub username and repository name
> github_url <- [https://api.github.com/repos/leppott/MBSStools/releases/latest](https://gcc02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fapi.github.com%2Frepos%2Fleppott%2FMBSStools%2Freleases%2Flatest&data=05%7C02%7CMullin.Cristina%40epa.gov%7C137e90358cd24781390308dc42b8b781%7C88b378b367484867acf976aacbeca6a7%7C0%7C0%7C638458608333303187%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C0%7C%7C%7C&sdata=G2W2Fk2tASTPs0S6UFcUFUF6fmUCez0CVFyUzby3%2FH8%3D&reserved=0)
>
> response <- GET(github_url)
> if (http_status(response)$category == "Success") {
+     latest_release <- content(response)
+     latest_version <- latest_release$tag_name
+     print(paste("Latest version:", latest_version))
+ } else {
+     print("Failed to retrieve latest release information.")
+ }
[1] "Latest version: v1.1"

There might be other ways.
Hope this helps,
Erik

Consider releasing a new version every 2 or 4 months, before working group calls. Aim for next one before the Nov call.


About dataset

Hi,
Could you please let me know from where did you download the datasets for your work?
I would like to work with ppi dataset, but I am unable to find it in your format.

Hi, sorry, we didn't use the PPI dataset in this work - all datasets used in the experiments are available in the https://github.com/shchur/gnn-benchmark/tree/master/data folder.

Thanks for your reply,
But I would like to integrate PPI dataset with your work, and unfortuanately I can't find it the format your other datasets are,
It would be helpful if you could let me know from where you have downloaded these datasets, perhaps, I might find the PPI dataset from there...


Complex Pentagon

Write a short description about your art piece, such as what your artwork represents and your experience drawing it!
This piece is A mathematical challenge on the limits of blot

[x] I have read the steps to getting a blot
[x] I have read all the submission requirements and follow them
[x] I am submitting art that...

[x] is algorithmically generated (will meaningfully change each time the program is run)
[x] is your own work that is not copied from somewhere else
[x] is drawable through the editor(does not use outside tools)
[x] doesn't call Math.random() (See the documentation on randomness)
[x] is drawable on Blot itself (doesn't have lines overlap more than 5 times)

[x] Doesn't overlap lines more than 5 times
[x] Fits in the working area of 125x125mm
[x] Doesn't rely on colour to look good

If you used based your art on something else, used a tutorial, or remixed it from something else, please link it here:
Lastly, link a picture of your art piece here:

Hello! Sorry it's been so long. The main reviewer has been swamped lately, so I wanted to give you a few hints so you have the best chance of getting a blot.
This certainly would push the limits of the blot, and unless you are drawing on like some super super strong surface, it would definitely tear the paper. Generally the recommendation is no more than 5 overlapping lines so 100 pentagons on top of each other is... a lot. Because this is undrawable on the blot, it is not eligible to get a blot.
Also, for a project to be considered "blot-worthy", it has to have a higher level of complexity, having both more different elements as well as being either really technically impressive or artistically polished (or both), generally taking around 15-20 hrs to complete.
To be honest, I don't really know what you can do to try to edit your existing project to make it into something either drawable or more complex, so I would maybe suggest finding some other inspiration if you want to try to get a blot. I believe in you and I'm excited to see what you come up with! If you do end up getting a blot, it would be fun to run some experiments like this, though probably best to keep your finger on the stop button just in case :)

Ok Thankyou

I love this! Could you try to add some more elements. Also there are still some overlapping lines that need to be fixed!

Which lines need to be fixed and where do you want me to add the new elements ?


[HOLD] Native Source Editor Component - Part 2

Phabricator:
https://phabricator.wikimedia.org/T331936
Notes
This PR does a few things:

Updates the source editor components to reference a WKSourceEditorLocalizedStrings struct of strings instead of internally hardcoding them. This will allow us to inject localized strings from our client app.

Note that though the struct is injected at the public view model init point, I am referencing the strings internally like a singleton (label.text = WKSourceEditorLocalizedStrings.current.inputViewParagraph). I felt like it was nice to have the localized strings for a whole feature in one easy to read (though large) struct, instead of split up across several different view models. Referencing the singleton internally also allowed me to avoid passing the strings around everywhere in method parameters throughout the feature, which felt distracting. But it still feels a bit weird and could cause potential reuse issues down the line, so I'm definitely open to changes here.

This also adds Voice Over accessibility labels everywhere, using the same pattern.

This adds unit tests and UI tests that can be run locally (WKSourceEditorTests and WKSourceEditorUITests). Note that there isn't any CI set up for this, but maybe we can discuss adding Xcode Cloud integration if we like these. For UI tests, I had to add accessibility identifiers on certain elements, which were added in a similar pattern as WKSourceEditorLocalizedStrings.

This PR is ready to review, but is a breaking change against the client app and how https://github.com/wikimedia/wikipedia-ios/pull/4521 is instantiating the source editor. Since that PR is already in progress, I am marking this PR as draft until that is merged.

Merged in https://github.com/wikimedia/wikipedia-ios/pull/4682.


AMQ-6861 Allow customisation of network bridge creation logic.

I wouldn't hold my breath for Jenkins to validate this.
I like your patch. Chris gave another solution of achieving the same result. There is another one, less direct that what Chris pointed at, but your solution is cleaner. What I don't like about your patch is that it doesn't address the by far most common way of configuring a broker, which is xml. Without that this patch is not very useful.
Maybe you can add that too, or I will try to find some time for that. I do get the usefulness of your patch, if would allow for different forwarding strategies in larger nobs, such as different paths for small vs large messages, or priorities, or whatever.

I've reorganised logic and now it is possible to set up bridge factory per network connector. It is injectable property so it can be created as regular bean within spring/blueprint xml and reused across multiple connectors giving opportunity to have more advanced configurations of bridge factory implementations.

I expected something easier to configure, with less xml elements using FactoryFinder, not injection, not a big IoC fan.
However it works, ran tests. Merging for now, we can improve later if necessary.


Section 2.1.3. Extensions

removed github links prone to deprecation, will add process_lib links when it get synced


Ctcp 4181 Extra P4 audit events for failed scenario and CTCP-4180 Create audit event for success event

CTCP-4069

I'm a bit puzzled by this ticket as it totally replaces the work just completed on CTCP-4069!
This ticket is to add success status type event post data is successful persisted in db. CTCP-4069 to audit message type event post data is persisted in db.and with this both type are events are there. Where are you puzzled it is replaced with CTCP-4069? Also with this ticket I have added one failure status type event in case of movement does not exist in db.


Azure Firewall Subnet Name

The name of azure firewall subnet must be AzureFirewallSubnet
Reference https://docs.microsoft.com/en-us/azure/firewall/tutorial-firewall-deploy-portal

Fixed in  v1.1.0


Nodejs19 cannot run. It's a strange bug

As noted in the two issues you've created before: Issues with Node 18 and higher will be tracked in https://github.com/nuxt/nuxt.js/issues/10844
If you have an issue with Node16, please create a reproduction and share it in your previous issue, https://github.com/nuxt/nuxt.js/issues/10882#issuecomment-1372318449


🍒[cxx-interop] Do not emit C++ interop flag in textual interfaces

This makes sure that the compiler does not emit -enable-experimental-cxx-interop/-cxx-interoperability-mode flags in .swiftinterface files. Those flags were breaking explicit module builds. The module can still be rebuilt from its textual interface if C++ interop was enabled in the current compilation.
rdar://140203932
(cherry picked from commit 7ae2bebfe8fae265ed2d3a791ea4480d8f7a4291)

Please test with following PR:
https://github.com/swiftlang/swift-driver/pull/1748
@swift-ci please test

Please test with following PR:
https://github.com/swiftlang/swift-driver/pull/1748
@swift-ci please test

Please test with following PR:
https://github.com/swiftlang/swift-driver/pull/1748
@swift-ci please test


rpc error desc = unexpected EOF

I've been trying really hard to troubleshoot this issue and I can't understand what the issue might be. What happens is that one of my thanos clusters returns "unexpected EOF" in response to a query. I've checked all the timeouts, they all are reasonable (10m). The cluster receiving the query says:
rpc error: code = Canceled desc = context canceled

tcpdump doesn't show any resets on either side. One thing I do see is that the query service has a negative value for mint, like so:
Mint: -62167219200000 Maxt:<PHONE_NUMBER>854775807 queried

If I go directly to the query service for that cluster, everything works. It's when I use a global query service that it fails.
Any ideas how to troubleshoot this further?

After hours more of troubleshooting I finally see the problem in Wireshark:

In the screenshot 1 and 2 refer to the attempts by the server to send 1424 bytes to the client (the global query service). 3 refers to the acknowledgement of those attempts. But the client doesn't wait long enough for that and sends for RST_STREAM packets. Again, this is a slow link.


Add support for key-only request parameters

Closes #499

Codecov Report

Merging #500 (483574f) into master (0185d02) will increase coverage by 0.00%.
The diff coverage is 100.00%.

@@           Coverage Diff           @@
##           master     #500   +/-   ##
=======================================
  Coverage   98.75%   98.76%
=======================================
  Files          18       18
  Lines        1290     1293    +3
  Branches      185      187    +2
=======================================
+ Hits         1274     1277    +3
  Misses          8        8
  Partials        8        8

Impacted Files
Coverage Δ

requests_cache/cache_keys.py
100.00% <100.00%> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 0185d02...483574f. Read the comment docs.