"Writing is not allowed after writer was completed", with SignalR 1.1

Describe the bug
I'm receiving "Writing is not allowed after writer was completed" on the latest release of SignalR with .NET Core 2.2. We previously used 1.0.0-rc1-final without any issues, and all of a sudden started receiving this issue with 1.1 on the client. We also receive a lot of "Task was cancelled" from the RedisHubLifetimeManager. Attaching screenshots below.
We ran SignalR 1.1 on the backend with 1.0.0-rc1-final on the client without any issues, but when we upgraded our client to 1.1, we started receiving this in our logs.
Another change we did while upgrading was to add "skipNegotiate: true" on the client, as well as forcing websockets. Not sure if this is related. I can't reproduce the error locally, since it doesn't happen often and seems related to only a few of our clients.
Also, the server seems to go down quite often after the upgrade. Can't seem to find any reason for this, but it was stable before we upped our clients.
To Reproduce
Can't reproduce the error locally, we just see it in our production environment logs.
Expected behavior
Expected it to be gone with 1.1.0, since I saw previous reports of the problem on RC versions.
Screenshots
Screenshot of writing is not allowed message:

Screenshot of task cancelled exception:

Additional context
dotnet --info output:

This is on our production environment. Locally we have the 2.2 runtime.
EDIT: If this issue is misplaced or inproper, feel free to close it. I didn't know where to turn.

Closing this as we haven't heard from you. Please feel free to comment if you're able to get the information we're looking for and we can reopen the issue if we're able to identify the problem.

Hi,
I'm getting the same error with this scenario:
.NET Core 2.2, SignalR 1.1, scaling using Redis (2.x) and hosting into Docker.
Unfortunately, I'm unable to reproduce the problem and the log isn't so helpful (Writing is not allowed after writer was completed)
Is there anything I can do to provide more information? (add more logging somewhere, try another build or whatever?).
I'm also using Groups so, probably is the same problem of @viktorgullmark but I don't have the issue related to the Task Canceled exception.
Let me know.

We have the same errors, only in production inside Docker behind Nginx.
The messages appeared after upgrade to .NET Core 2.2.
It doesn't matter if we use SignalR 1.1 or 1.0 on the Client Side.
By the way, we don't use Groups or Redis.

@imperugo Enabling Debug level logs would be nice. I'd like to see the logs around the failure if possible, as they can give context on what is happening on the server.
@codingsteff Can you confirm that switching from SignalR 1.0.0 to 1.1.0 on the server causes the issue? And could you also collect logs please?

@BrennanConroy I'll switch the log only for "Microsoft.AspNetCore.SignalR.*" to debug.
Soon news

I rolled back our server to .NET Core 2.1 and now we have no errors in the log anymore.
Currently all our clients using JavaScript SignalR 1.1.0, the server runs with .Net Core 2.1.1 and Microsoft.AspNetCore.SignalR 1.0.3.
Next week I can switch the production to Microsoft.AspNetCore.SignalR 1.1.0, but because of the dependency to Microsoft.AspNetCore.Connections.Abstractions I need to switch to .NET Core 2.2 as well.
I'll send you some log entries.

@BrennanConroy here my logs

@BrennanConroy  here are the logs from the same ConnectionId

We have the same errors here in two applications.
One is running on .NET Core 2.2.1 (deployed as self-contained). The other is running on .NET 4.7.1.
They are built using the SDK 2.2.103 and runtime 2.2.1.
The Microsoft.AspNetCore.SignalR package version is 1.1.0.
The @aspnet/signalr package version is 1.0.4.
We enabled the SignalR log on our servers, then soon I'll be able to share more data about the connections and errors.
Microsoft.AspNetCore.SignalR.HubConnectionContext -> Failed writing message. Aborting connection.
System.InvalidOperationException: Writing is not allowed after writer was completed.
at System.IO.Pipelines.ThrowHelper.ThrowInvalidOperationException_NoWritingAllowed()
at System.IO.Pipelines.Pipe.GetMemory(Int32 sizeHint)
at System.IO.Pipelines.Pipe.DefaultPipeWriter.GetSpan(Int32 sizeHint)
at System.IO.Pipelines.PipeWriter.WriteAsync(ReadOnlyMemory`1 source, CancellationToken cancellationToken)
at Microsoft.AspNetCore.SignalR.HubConnectionContext.d__49.MoveNext()

This is a benign error as it looks like the client is already disconnected.
We'll look at making this either not try to write after the client is gone, or at a minimum not be an error log.

@BrennanConroy Alright, thanks for looking into it!

Is there any progress on this one?
Can anyone confirm that this type of error can be safely ignored by our log filter(as it constantly fire our alerting system based on Error log level) and does not indicate any issues in a running service?

Probably I can try to fix this and submit a PR if there is no one in the team already on this issue or you have focused on the more priority tasks.

This is also affecting us. We have roughly 30k connections on each server and we don't use any backplane between them. Might be a coincidence but i noticed an increase in the number of exceptions of this type when i updated the typescript clients from 1.0.0-rc-final to 1.1.4.
Here is an example of 1s of logs from one of the servers:
 2019-04-12 12:05:00.015 +00:00 [ERR] Failed connection handshake. 2019-04-12 12:05:00.064 +00:00 [ERR] Failed connection handshake. 2019-04-12 12:05:00.190 +00:00 [ERR] Failed connection handshake. 2019-04-12 12:05:00.297 +00:00 [ERR] Failed connection handshake. 2019-04-12 12:05:00.301 +00:00 [ERR] Failed connection handshake. 2019-04-12 12:05:00.306 +00:00 [ERR] Failed connection handshake. 2019-04-12 12:05:00.315 +00:00 [ERR] Failed writing message. Aborting connection. System.InvalidOperationException: Writing is not allowed after writer was completed.    at System.IO.Pipelines.ThrowHelper.ThrowInvalidOperationException_NoWritingAllowed()    at System.IO.Pipelines.Pipe.GetMemory(Int32 sizeHint)    at System.IO.Pipelines.Pipe.DefaultPipeWriter.GetSpan(Int32 sizeHint)    at System.Buffers.BuffersExtensions.Write[T](IBufferWriter1 writer, ReadOnlySpan1 value)    at System.IO.Pipelines.PipeWriter.WriteAsync(ReadOnlyMemory1 source, CancellationToken cancellationToken)
at Microsoft.AspNetCore.SignalR.HubConnectionContext.TryWritePingSlowAsync()
2019-04-12 12:05:00.322 +00:00 [ERR] Failed connection handshake.
2019-04-12 12:05:00.327 +00:00 [ERR] Failed connection handshake.
2019-04-12 12:05:00.329 +00:00 [ERR] Failed connection handshake.
2019-04-12 12:05:00.329 +00:00 [ERR] Failed connection handshake.
2019-04-12 12:05:00.331 +00:00 [ERR] Failed connection handshake.
2019-04-12 12:05:00.332 +00:00 [ERR] Failed connection handshake.
2019-04-12 12:05:00.334 +00:00 [ERR] Failed connection handshake.
2019-04-12 12:05:00.336 +00:00 [ERR] Failed connection handshake.
2019-04-12 12:05:00.339 +00:00 [ERR] Failed connection handshake.
2019-04-12 12:05:00.341 +00:00 [ERR] Failed connection handshake.
2019-04-12 12:05:00.344 +00:00 [ERR] Failed connection handshake.
2019-04-12 12:05:00.344 +00:00 [ERR] Failed connection handshake.
2019-04-12 12:05:00.347 +00:00 [ERR] Failed connection handshake.
2019-04-12 12:05:00.356 +00:00 [ERR] Failed connection handshake.
2019-04-12 12:05:00.368 +00:00 [ERR] Failed connection handshake.
2019-04-12 12:05:00.371 +00:00 [ERR] Failed writing message. Aborting connection.
System.InvalidOperationException: Writing is not allowed after writer was completed.
at System.IO.Pipelines.ThrowHelper.ThrowInvalidOperationException_NoWritingAllowed()
at System.IO.Pipelines.Pipe.GetMemory(Int32 sizeHint)
at System.IO.Pipelines.Pipe.DefaultPipeWriter.GetSpan(Int32 sizeHint)
at System.Buffers.BuffersExtensions.Write[T](IBufferWriter1 writer, ReadOnlySpan1 value)
at System.IO.Pipelines.PipeWriter.WriteAsync(ReadOnlyMemory1 source, CancellationToken cancellationToken)    at Microsoft.AspNetCore.SignalR.HubConnectionContext.TryWritePingSlowAsync() 2019-04-12 12:05:00.372 +00:00 [ERR] Failed connection handshake. 2019-04-12 12:05:00.374 +00:00 [ERR] Failed connection handshake. 2019-04-12 12:05:00.375 +00:00 [ERR] Failed connection handshake. 2019-04-12 12:05:00.385 +00:00 [ERR] Failed connection handshake. 2019-04-12 12:05:00.387 +00:00 [ERR] Failed writing message. Aborting connection. System.InvalidOperationException: Writing is not allowed after writer was completed.    at System.IO.Pipelines.ThrowHelper.ThrowInvalidOperationException_NoWritingAllowed()    at System.IO.Pipelines.Pipe.GetMemory(Int32 sizeHint)    at System.IO.Pipelines.Pipe.DefaultPipeWriter.GetSpan(Int32 sizeHint)    at System.Buffers.BuffersExtensions.Write[T](IBufferWriter1 writer, ReadOnlySpan1 value)    at System.IO.Pipelines.PipeWriter.WriteAsync(ReadOnlyMemory1 source, CancellationToken cancellationToken)
at Microsoft.AspNetCore.SignalR.HubConnectionContext.TryWritePingSlowAsync()
2019-04-12 12:05:00.389 +00:00 [ERR] Failed connection handshake.
2019-04-12 12:05:00.390 +00:00 [ERR] Failed connection handshake.
2019-04-12 12:05:00.401 +00:00 [ERR] Failed connection handshake.
2019-04-12 12:05:00.411 +00:00 [ERR] Failed connection handshake.
2019-04-12 12:05:00.414 +00:00 [ERR] Failed connection handshake.
2019-04-12 12:05:00.418 +00:00 [ERR] Failed writing message. Aborting connection.
System.InvalidOperationException: Writing is not allowed after writer was completed.
at System.IO.Pipelines.ThrowHelper.ThrowInvalidOperationException_NoWritingAllowed()
at System.IO.Pipelines.Pipe.GetMemory(Int32 sizeHint)
at System.IO.Pipelines.Pipe.DefaultPipeWriter.GetSpan(Int32 sizeHint)
at System.Buffers.BuffersExtensions.Write[T](IBufferWriter1 writer, ReadOnlySpan1 value)
at System.IO.Pipelines.PipeWriter.WriteAsync(ReadOnlyMemory1 source, CancellationToken cancellationToken)    at Microsoft.AspNetCore.SignalR.HubConnectionContext.TryWritePingSlowAsync() 2019-04-12 12:05:00.420 +00:00 [ERR] Failed connection handshake. 2019-04-12 12:05:00.420 +00:00 [ERR] Failed connection handshake. 2019-04-12 12:05:00.421 +00:00 [ERR] Failed connection handshake. 2019-04-12 12:05:00.422 +00:00 [ERR] Failed connection handshake. 2019-04-12 12:05:00.426 +00:00 [ERR] Failed writing message. Aborting connection. System.InvalidOperationException: Writing is not allowed after writer was completed.    at System.IO.Pipelines.ThrowHelper.ThrowInvalidOperationException_NoWritingAllowed()    at System.IO.Pipelines.Pipe.GetMemory(Int32 sizeHint)    at System.IO.Pipelines.Pipe.DefaultPipeWriter.GetSpan(Int32 sizeHint)    at System.Buffers.BuffersExtensions.Write[T](IBufferWriter1 writer, ReadOnlySpan1 value)    at System.IO.Pipelines.PipeWriter.WriteAsync(ReadOnlyMemory1 source, CancellationToken cancellationToken)
at Microsoft.AspNetCore.SignalR.HubConnectionContext.TryWritePingSlowAsync()
2019-04-12 12:05:00.513 +00:00 [ERR] Failed connection handshake.
2019-04-12 12:05:00.831 +00:00 [ERR] Failed connection handshake.
2019-04-12 12:05:00.865 +00:00 [ERR] Failed connection handshake.
2019-04-12 12:05:00.957 +00:00 [ERR] Failed connection handshake.`

Might be a coincidence but i noticed an increase in the number of exceptions of this type when i updated the typescript clients from 1.0.0-rc-final to 1.1.4

I reverted the client script to the version compiled with 1.0.0-rc1-final and the exceptions disappeared after an hour or so. Moved back to the version compiled with 1.1.4 and the System.InvalidOperationException: Writing is not allowed after writer was completed. exceptions start to occur.
I did this 3 times and the results were always the same.

To confirm, is anyone seeing a functional problem here or is it just a spurious exception message in the logs? I just want to make sure to understand if this is actually causing a functional problem. It looks like it's the writing of the "ping" message that's failing, which is fine (though annoying to see in the logs).
We'll look at ensuring the pings are stopped before the pipeline is closed in preview 6.

I believe that there is a functional problem. We saw a reduction of connected users, that was the main reason i was forced to move revert back to the version compiled with 1.0.0-rc-final.

Hrm, I don't think that would be directly related to the callstack you're seeing though. The ping logic is very carefully designed to be resiliant to failures like this. In fact, if that log message is written it means the exception is not bubbling up, since we catch it and don't re-throw it: https://github.com/aspnet/AspNetCore/blob/0b7458cc984c0c0f9c702f9831c1815a365c07ac/src/SignalR/server/Core/src/HubConnectionContext.cs#L305-L308
The log message is unfortunately unclear about this. It says "Failed writing message. Aborting connection.". This is because we share the same log message in multiple places and in the other places it occurs it causes the connection to terminate. In this specific call stack though, the connection is not terminated. I'll open a PR to fix that message since it's not super clear. I am, however, very confident that those log messages aren't causing connections to be terminated.
The "Failed Connection Handshake" messages (referenced in your other issue https://github.com/aspnet/AspNetCore/issues/9327) are more likely to indicate a problem.

So the message is confusing and unclear, can it please be changed ?

Yes. that is part of what we're doing.

Acceptance checklist (check one item)

[ ] We decided not to take this fix.
[ ] The fix is tests-only.
[x] The fix contains product changes (check all items below).

[x] Relevant XML documentation comments for new public APIs are present.
[x] Narrative docs (docs.microsoft.com) are updated. (check one item below)

[ ] The change requires a new article. An issue with an outline has been filed here: [ISSUE LINK]
[ ] The change requires a change to an existing article. A closed docs PR with these changes is linked here: [PR LINK]
[x] The change requires no docs changes.

[x] Verification has been completed. (check one item below)

[x] The change is in the shared framework and was verified against the following versions

SDK installer: [3.0.100-preview6-012096]
ASP.NET Core Runtime: [3.0.0-preview6-19277-03]
.NET Core Runtime: [3.0.0-preview6-27727-02]

[ ] The change is in an OOB NuGet/NPM/JAR package and was verified against the following version of that package: [PACKAGE ID] [VERSION]

Hi all, same problem.

This is a benign error as it looks like the client is already disconnected.

No, the client is not disconnected at the time of the error. In our case the client is still waiting for the response, and disconnects after timeout.
Here is exception from the client:

"lg-exception": "System.TimeoutException: Server timeout (30000.00ms) elapsed without receiving a message from the server.",
"lg-callsite": "Microsoft.AspNetCore.SignalR.Client.HubConnection+d__62.MoveNext:0",

Btw, why it says timeout is 30000.00ms though I see it should be only 5 seconds by default?

Hi, we don't track closed issues. If you're seeing a problem please open a new issue with details of the issue.
We have a nice guide for collecting information that is often useful to include in issues: https://docs.microsoft.com/en-us/aspnet/core/signalr/diagnostics?view=aspnetcore-2.2


[TE8] Instable chip-tool (bluez madness)

Problem
chip-tool is very unstable during the ble-thread pairing and it is shere torture to execute test cases. For me this happens 70% of the time with one of the following errors (these are all different errors):
bluez1.log
bluez2.log
bluez3.log
bluez4.log
also related issue: https://github.com/project-chip/connectedhomeip/issues/16178
Testing Environment: as recommended by the Test Case Instruction document.

Some suggested in the slack channel that sudo rfkill block wifi or sudo ifconfig wlan0 down which had 0 effect on my setup. I also disabled the wifi module at boot-up with:
ubuntu@matter-dm:~/new$ cat /boot/firmware/usercfg.txt
dtoverlay=disable-wifi

related issue with more infos: https://github.com/CHIP-Specifications/chip-certification-tool/issues/324

Any news about this problem ?
It is known issue since TE5 (and possibly more)
@eve-cxrp : Which Bluetooth dongle was you using ?
I am using nRF52840 with USB<>HCI firmware.
I don't know if the problem is Bluez, Hardware or Matter.

For people using chip-tool it's probably "ok" because after every request chip-tool restart and sometimes it works.
For people using the stack, on TE8 tag if a pairing fail, then the next pairing will fail (because of another issue), so this issue is a real pain !


Include the v6.0.0 of sendinblue/APIv3-php-library

Hello
Can you include the v6.0.0 of sendinblue/APIv3-php-library in this bundle ?
Thanks !
Poke @MatTheCat 🐱

v6 introduced some BC breaks; I'm not sure how to design the configuration yet.

Are there any plans or news concerning the support for sendinblue/api-v3-sdk >6 ?
I tried to get all list attributes via contact endpoint. It doesn't work, as the type boolean is not support in version 5.

This package has been deprecated. As an alternative https://github.com/sendinblue/APIv3-php-library can be used to integrate Sendinblue APIs.


Re-adds pickle reading to other data types

In the refactoring of FeatureIO we lost the ability to read pickle files. This fixes it (for a while, since it will be removed soon).

Codecov Report

Merging #445 (80bcc2e) into develop (6d6583e) will increase coverage by 0.03%.
The diff coverage is 75.00%.

@@             Coverage Diff             @@
##           develop     #445      +/-   ##
===========================================
+ Coverage    82.70%   82.74%   +0.03%
===========================================
  Files           59       59
  Lines         5598     5605       +7
===========================================
+ Hits          4630     4638       +8
+ Misses         968      967       -1

Impacted Files
Coverage Δ

core/eolearn/core/eodata_io.py
92.54% <75.00%> (+1.01%)
:arrow_up:

core/eolearn/core/extra/ray.py
92.68% <0.00%> (-2.44%)
:arrow_down:

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

I have a dataset that have bbox, metadata, and timestamp all in pickle format
the EOPatch is not able to read them and show that the format should be .geojson
is there any version that i can use to read this data or to convert them into .geojson format?
thanks

Hi @MustafaAlahmid , something similar was discussed in https://github.com/sentinel-hub/eo-learn/issues/582, maybe this will solve your problem.


Problems running your code

I'm trying to run your code and am having some difficulties. I was hoping you could clarify some issues for me.
In your repository I could not see what version of python you used. I'm using Python 3.7.
When I run
python main.py --epistemic_method varinf --aleatoric_method bayesdecomp
I get a pickling error due to the lambda function in the __init__ method in the BayesBasicBlock class. Replacing the lambda function with a proper function resolves that problem.
However, I then get a KeyError:
KeyError: Caught KeyError in DataLoader worker process 0.
Original Traceback (most recent call last):
  File "/home/jupyter/uncertainty/uncertainty/lib/python3.7/site-packages/pandas/core/indexes/base.py", line 3080, in get_loc
    return self._engine.get_loc(casted_key)
  File "pandas/_libs/index.pyx", line 70, in pandas._libs.index.IndexEngine.get_loc
  File "pandas/_libs/index.pyx", line 101, in pandas._libs.index.IndexEngine.get_loc
  File "pandas/_libs/hashtable_class_helper.pxi", line 4554, in pandas._libs.hashtable.PyObjectHashTable.get_item
  File "pandas/_libs/hashtable_class_helper.pxi", line 4562, in pandas._libs.hashtable.PyObjectHashTable.get_item
KeyError: 'id'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/home/jupyter/uncertainty/uncertainty/lib/python3.7/site-packages/torch/utils/data/_utils/worker.py", line 198, in _worker_loop
    data = fetcher.fetch(index)
  File "/home/jupyter/uncertainty/uncertainty/lib/python3.7/site-packages/torch/utils/data/_utils/fetch.py", line 44, in fetch
    data = [self.dataset[idx] for idx in possibly_batched_index]
  File "/home/jupyter/uncertainty/uncertainty/lib/python3.7/site-packages/torch/utils/data/_utils/fetch.py", line 44, in <listcomp>
    data = [self.dataset[idx] for idx in possibly_batched_index]
  File "/home/jupyter/uncertainty/project/utils/dataloader.py", line 141, in __getitem__
    id = self.path_labels['id'].iloc[idx]
  File "/home/jupyter/uncertainty/uncertainty/lib/python3.7/site-packages/pandas/core/frame.py", line 3024, in __getitem__
    indexer = self.columns.get_loc(key)
  File "/home/jupyter/uncertainty/uncertainty/lib/python3.7/site-packages/pandas/core/indexes/base.py", line 3082, in get_loc
    raise KeyError(key) from err
KeyError: 'id'

Any idea what is going on here? I'm wondering if the data formats have changed.
When I download the CPSC2018 validation set my filename is different than what you have in your config file. Namely

You have: CPSC2018_REFERENCES.csv
I have: REFERENCE.csv

The file has four columns:  Recording | First_label | Second_label | Third_label
Want to make sure this is the same as you.

Hi Brian,

In your repository I could not see what version of python you used. I'm using Python 3.7.

We used Python 3.7 for this project.

I get a pickling error due to the lambda function in the init method in the BayesBasicBlock class. Replacing the lambda function with a proper function resolves that problem.

I personally never had issues with pickling the lambda function, but it seems like you have resolved this issue?
Regarding the data loading:
You are correct, the file I used is indeed different. I currently don't have access to all the files, but thankfully it is only a small change. The dataloader does not support the A0001 format of the original REFERENCES.csv, but looks for a column called id. This column is simply an incrementing integer, the same as the Recording column with A000 stripped off.
I just pushed the correct file for the validation set (CPSC2018_REFERENCES.csv) to the repository, which can be found here.
For the other sets (train, test), you can simply modify the REFERENCES.csv file to contain an additional column with incremental id. For example using pandas:
import pandas as pd

df = pd.read_csv('REFERENCES.csv')
df['id'] = df.index + 1

pd.to_csv('CPSC2018_REFERENCES.csv')

Please let me know if this solves the issue.

Yes. Your tip resolved the problem. Sorry I didn't debug that on my own, but it was really deep in the call stack without the best interface on GCP for me to dig through the problem.

Great! Glad I could be of help. Please let me know if you run into any other issues.
I edited the README.MD to include these instructions, so future users of the repository will use the correct file.


Godo43 Tilemap renderer fix

When the tilemap rendere does not have a generator assigned, this produces a low level error. Its best to warn users explicitely, as per usual, of the missing implementation.

Could you please remove the other commits unrelated to the PR?

Also this could be added to the GridmapRenderer too, and then to the script templates for renderers added in the project.

Also this could be added to the GridmapRenderer too, and then to the script templates for renderers added in the project.

I don't really know how to do that unless my PR merges into main.

Thanks for contributing!

@BenjaTK Your addon is awesome, it was a meagre contribution, but a pleasure.


Dynamic font sizing

Dynamic font sizing

This update adds dynamic sizing for Text/Heading components, which
leverages CSS variables for compatible browsers with fallbacks for
non-supported browsers (IE).
Under the hood, the font styles now look like this:

Hashed styles generated by Fancy, with CSS variables + calc for the dynamic sizes, and fallbacks for IE.
The Tooltip component was also improved to better handle scenarios where
a title prop may not be present.
Lastly, smaller components were refactored with Fancy (:tada:). Tests and styles
were updated accordingly. As long as you're on Blue v0.5.9+, there should be no
change needed on your end for these updates.

Coverage remained the same at 100.0% when pulling ef4a1594583a57c66d2849cf6165cc27c78e8b03 on dynamic-font-size into f1dc629ef36b3a15191a35fe0325a677a2d0e8e9 on master.


Implement generators

Make it possible to turn quotes into interruptible programs.
Proposed example:
# Push an endlessly running quote onto the stack.
(
  0
  ( true )
  (
    dup yield  # New word similar to println on top level.
    1 +
  )
  while
)
*            # Turns the quote into a generator.
next         #=> 0
drop next    #=> 1
drop 5 take  #=> [2, 3, 4, 5, 6]
drop dup     # Saves generator state
2 take       #=> [7, 8]  (Takes from the duplicate instance)
2drop
3 take       #=> [7, 8, 9]  (Resumes taking from the first instance)

Some way of passing data back to the generator would also be nice.

Iterators with similiar API could be implemented without any modifications to the interpreter.

How would they work? Use an array as a stack or something?

This is how I implemented them:
{
  "prototype": {
    "constructor": (
      "quote" swap !
    ),

    "next": (
      "state" swap has-own? ( "state" swap @ swap ) if
      "quote" swap @ rot swap call
      dup rot "state" swap ! swap
    ),
  },
} "generator" const

Usage:
( 1 + ) generator new  # Turn quote into generator.
0 swap                 # Set's initial value of generator to 0.
next println           # Returns 1
next println           # Returns 2
next println           # Returns 3

If I understand correctly this only allows a single value to act as the state of the generator. It is also quite brittle if the quote happens to misuse the stack. Having a generator accidentally read or write onto your stack creates hard-to-debug issues.
In my proposed implementation any misuse would raise a range error on the generator's local stack.


Question about load data to virtuoso

Hi,
I'm sorry to bother you, I have some questions that may not be directly related to this project, but I thought you could help me.
I am trying to import the wikidata dataset into virtuoso, the total ttl file is about 800G, it worked fine in the beginning and loaded about 80G in the first day.
Now I've been loading for about a week and it's getting slower and slower and almost stopped today.
I also tried splitting the TTL into some smaller TTLs (I split it into 300 files), but the virtuoso.db file has not changed at all in the past day and is now 280G in size
Can you give some advice on importing large files, I thought at first that the whole 800G file was too big so it would get stuck at a later stage, but now it doesn't seem to be the case, even if I split the files and import them one by one, it still gets stuck when the database file gets bigger
Any help would be appreciated!

Hi,
I am sorry, but unfortunately I can not help you with this problem.
Actually, we faced similar problems with different existing solutions. This was also a reason why we implemented our own KB index from scratch.
Regards,
Philipp

Ok, thanks for your reply anyway！


integrate with SPA

deploy serverless:

add integration for lambda serverless

to integrate with token-handler-js-assistant:

change return field of LoginController
change input of handlePageLoad
add /session endpoint

OAuth Agent

Developed in Express.js by Curity
Can be deployed serverless as the API is stateless (in this case the integration is with AWS Lambda)
SPA (developed in React) interfaces with OAuth Agent using token-handler-js-assistant library written by Curity

Deployment

Run npm run build
Add node_modules folder (npm install if not available yet) into the generated dist folder
Add package.json, package-lock.json, tsconfig.json too
Zip the entire dist folder plus the files mentioned above into a .zip file
Upload to Lambda
Integrate with API Gateway

Create routes and attach lambda function
CORS handling at API Gateway level (at lambda level should be handled already by the Express.js code)
Create a custom domain name in API Gateway and create route 53 + ACM for it


About the rendering of G-objaverse

Hello, I am interested in some details of G-Objaverse. Are you using environment map or area light while rendering for RGB images?

Yes, we use environment maps or area light with various color temperatures.

Hello, I am interested in some details of G-Objaverse. Are you using environment map or area light while rendering for RGB images?

Yes, we use environment maps or area light with various color temperatures.

Hello, I am interested in some details of G-Objaverse. Are you using environment map or area light while rendering for RGB images?

Yes, we use environment maps or area light with various color temperatures.

thank you! And I have another question, you release 10 categories, including Human-Shape (41,557), Animals (28,882), Daily-Used (220,222), Furnitures (19,284), Buildings&&Outdoor (116,545), Transportations (20,075), Plants (7,195), Food (5,314), Electronics (13,252) and Poor-quality (107,001). However, for the json file shows that for each category there are Human-Shape (10,334), Animals (12,549), Daily-Used (99,365), Furnitures (7,296), Buildings&&Outdoor (25,820), Transportations (8,925), Plants (3,337), Food (2,590), Electronics (6,255) and Poor-quality (31,775). And the total number is 20,8246. I wonder whether the number in README is wrong, or whether some data is missed in json file.

Hi, a small part of the objaverse_280k rendering data that has been released lacks category annotations, and we are working hard to label this portion of the data. We will update the annotation files of all objaverse as soon as possible.

Hi, a small part of the objaverse_280k rendering data that has been released lacks category annotations, and we are working hard to label this portion of the data. We will update the annotation files of all objaverse as soon as possible.

ok, thank you!


Code refactoring

@rishi255  This PR does following:

Convert-KeyPressToString

Remove redundant $null when Escape is pressed
Emmit $keybind output directly

Invoke-OllamaApi

Use PowerShell naming convention for private functions
Replace backticks with splatting
Emit rest method output directly

Write-Completion

Use Write-Host, because Write-Output does not support colors (did you mean Write-Error?)
Fix misspelled word in the message

Set-CompletionKeybind

Replace backticks with splatting
Remove redundant System namespace reference

Initialize-Module-On-Import

Remove redundant System namespace reference
Refactor keybind code to not read environment variable twice

I've built and test the module locally.
PS: If you happy with this PR I can work on another that will start the Ollama automatically during module import.

Hey @kborowinski ,
Thanks a lot for the PR, and I see you've made many changes and improved the code quite a bit.
Sorry I've been a bit busy, I'll need some time to go through and I'll merge then. Cheers!


Psych gem version bump

Psych 2.0.12 fixed an issue with parsing hashes with instance variables when it is referenced multiple times.
This Psych issue caused the connection failure to Vim Broker.

Thanks @lfu @tenderlove  :+1:


Operation request: IEEE 754 Floating-Point Hex to/from decimal with Big/Little-Endian modes

Summary
Ability to convert between hexadecimal single & double-precision floating point in IEEE 754  to/from ascii decimal
Example

32-bit (Single-precision) BE:
0x42CF4AA1 = 103.64576
-2.457 = 0xC01D3F7D
64-bit (Double Precision) BE:
-1.5467 = 0xBFF8BF487FCB923A
0x40591630E7FF583A =  100.346735
Sample calculator can be found at https://www.h-schmidt.net/FloatConverter/IEEE754.html
Npm reference module at
https://www.npmjs.com/package/ieee754

How about this pull request? I'd love to see floating point conversion in CyberChef

Hey I want to contribute to this issue.
Can  I get started ?

@n1474335 Can I get started ?


mbsync path query

1.3.10
'beet mbsync -WM /some/path'
doesn't work
'beet mbsync -WM path:/some/path'
does

The mbsync command uses album queries. Path queries only work on items for now.

Weren't both of my examples path queries?

Oops! Sorry for the lapse. :flushed: It looks like the problem is that we're not automatically detecting path queries in album queries at all. That is, you can see the same issue in:
beet ls -a /some/path

vs.:
beet ls -a path:/some/path

or:
beet ls /some/path

For anyone interested: see parse_query_parts in library.py, where automatic path detection only occurs if the model_cls (i.e., Item or Album) has 'path' as a real field (i.e., defined in _fields).

Looks like a good solution; thanks, @tomjaspers!


Update Set-PnPSiteScriptPackage.md

Type

[ ] Bug Fix
[ ] New Feature
[x] Sample

Related Issues?
N/A
What is in this Pull Request ?
There is no Get-PnPSiteScriptPackage cmdlet. Checked code repository, documentation, and available modules. If it's coming, please ignore the PR.

Thank you  @PowershellScripts so much for all your updates and help !!


Preview build info json upload is broken

Preview build info json upload is broken after 7.2.0-preview.10

Already fixed


Parallelism cleanup

This pull request reformats std.parallelism to conform better to the Phobos style guide and removes workarounds for Bug 2443.

Gotta love it when dmd bug fixes allow for cleaner code. Merged.


Torch Version Requirement

In README, it says torch>=1.7 is fine. However, in the source code, the lietorch requires torch.linalg.pinv, which seems only exists in torch 1.9+.

Hi, thanks for catching this issue. pinv is in torch>=1.8. So everything should work in for 1.8 and 1.9 now. I've update the README


dodge declares output channel

Fixes one part of #928.
I was hoping there’d be a way to do this for the hexbin transform too, but I couldn’t wrap my head around it. The problem is that the initial options (passed to the Mark constructor) need to declare the channels prior to the initializer running, not the channels after the initializer runs; if we blindly declare the output channels in options, then we’ll overwrite the input channels to the hexbin transform. The dodge transform doesn’t have this problem because it doesn’t have a circular channel dependency (it consumes x and outputs y, or consumes y and outputs x; whereas the hexbin transform consumes x and y and outputs x and y, at a minimum).
Anyway, this seems like an improvement. 🤷

I am reverting this. #931 feels like a better fix, and this was causing issues in #929.


bat preview not working when ~/.config/bat/config exists

I have a file ~/.config/bat/config:
# Set the theme
--theme="GitHub"

--color=always

# Show line numbers, Git modifications, file header and grid
--style="numbers,changes,header,grid"

# Use italic text on the terminal (not supported on all terminals)
--italic-text=always

# Use "gitignore" highlighting for ".ignore" files
--map-syntax .ignore:.gitignore

If I use fzf-lua I get --italic-text provided more than once:

Workaround
The solution for me was to explicitly set the preview_cmd, e.g.:
    use {
      'ibhagwan/fzf-lua',
      requires = {
        'kyazdani42/nvim-web-devicons', -- optional for icons
        'vijaymarupudi/nvim-fzf',
      },
      config = function()
        require'fzf-lua'.setup {
          preview_cmd = 'bat',
        }
      end,
    }

I thought I'd open an issue to share in case you wanted to fix this / if someone else was running into the same issue.

Tysm, I didn’t know some options could conflict with others, I’ll fix it either by removing the —italic-text option or perhaps there is a flag that tells bat to ignore the config file.

Just removing --italic-text still may not resolve other conflicts. The easiest change is probably that bat_opts` should be empty by default?
https://github.com/ibhagwan/fzf-lua/blob/ea38de4d7c8b2a7a718b712ddd8530e71f4b7270/lua/fzf-lua/config.lua#L66
I imagine most people that use fzf with a preview either have a ~/.config/bat/config or have aliased their bat to be bat --italic-text=always ....
Alternatively, you can check if ~/.config/bat/config exists, and if it doesn't you can use the bat_opts that you are using right now.

Probably better to find that option that ignores the config file, I’m sure there has to be one, I’ll look for it later.
Testing for the config file in $XDG_DATA_HOME is also a good option, I plan to rework the preview part anyways and also add other preview options I might add it then.

https://github.com/sharkdp/bat#output-style
It looks like you can use the BAT_STYLE environment variables to override the config file. So you can probably just pass bat_opts to the environment variable when you spawn the bat process.

There’s also export BAT_CONFIG_PATH="/path/to/bat.conf", and you can put bat_opts in a file in this repo and use this instead.

One of these will easily solve it, tysm :)
I’ll leave this issue open until I commit the fix.

Should be fixed in latest commit, lmk if otherwise.

Hi @ibhagwan, this fix works in that it doesn't cause the bug but it has made it such that I cannot use my ~/.config/bat/config. Any suggestions?

Let me think about it, I’m rewriting the previewer code completely as we speak, I’ll address it there.

Just commited a fix for this, look at the new setup options for previewers in the README, in your case I'd set it up as follows:
previewers = {
...
    bat = {
      cmd             = "bat",
      args            = "",
      theme           = nil,
      config          = nil,            -- nil uses $BAT_CONFIG_PATH
    },
...

or
```lua
previewers = {
...
    bat = {
      cmd             = "bat",
      args            = "",
      theme           = nil,
      config          = "~/.config/bat/config"
    },
...

Just commited a fix for this, look at the new setup options for previewers in the README, in your case I'd set it up as follows:
previewers = {
...
    bat = {
      cmd             = "bat",
      args            = "",
      theme           = nil,
      config          = nil,            -- nil uses $BAT_CONFIG_PATH
    },
...

or
```lua
previewers = {
...
    bat = {
      cmd             = "bat",
      args            = "",
      theme           = nil,
      config          = "~/.config/bat/config"
    },
...

Tried both & I get an empty preview.

Just commited a fix for this, look at the new setup options for previewers in the README, in your case I'd set it up as follows:
previewers = {
...
    bat = {
      cmd             = "bat",
      args            = "",
      theme           = nil,
      config          = nil,            -- nil uses $BAT_CONFIG_PATH
    },
...

or
```lua
previewers = {
...
    bat = {
      cmd             = "bat",
      args            = "",
      theme           = nil,
      config          = "~/.config/bat/config"
    },
...

Tried both & I get an empty preview.

It doesn't seem like you're running the bat previewer, this seems like it's using the new builtin default previewer, in which case there might an issue here I need to fix but I'm confused if this is the default previewer why is there no title or scrollbar at the right side, if that's the case let's open a new issue about the default previewer so this doesn't get lost.
If you want to use the bat previewer please add default_previewer   = "bat" to your setup function.


I cannot download the dataset because i don't have permission to access /u/qyou/deepemotion/ on this server

Could you please offer an alternative source of the data？

I am sorry but I do not own the dataset, and thus I am unable to provide it. 😥 However, you could try (I have not tested it) looking at https://www.imageemotion.org

@DinghaoXi were you able to get the dataset?

@pohlinwei how were you able to get the dataset?


CLOUDSTACK-8793 Enable s2s VPN connection for projects

LGTM

Hi @pdion891 Can you let me know what you tested please? Thanks!

@pdube Thanks! Can you please rebase against current master? Then we can run the tests to verify.

@remibergsma I haven't test this PR yet on master. A previous fix has been pushed in the past to fix s2svpn in project but didn't completely fixed it. With this PR it fix it, @pdube  tested with 4.5.

Hi @pdion891 ,
But the PR is going against Master, so testing it against 4.5 only and giving a LGTM is a bit pointless.
Could you please execute tests agains master as well and put the result here?
I can also help with testing, but for that to happen @pdube has to write some details on his PR and let us know which steps to follow in order to test it.
Cheers,
Wilder

LGTM (did not test, just reviewed code), can you check why Jenkins failed and also re-push to trigger them if necessary. Thanks.

Hi @pdube Jenkins failed, it's probably unrelated to your change:
[ERROR] Internal error: java.lang.IllegalStateException: Invalid object ID 14 iota=530: Object was recently deallocated
[ERROR] #14 (ref.0) : object=null type=com.sun.proxy.$Proxy147 interfaces=[hudson.maven.MavenBuildProxy2]
[ERROR] Created at Mon Oct 05 14:46:07 UTC 2015

Can you please force push again? While you are at it, you may want to rebase against latest master. After that, I will run the tests again and post output. Thanks!

Hey guys,
I have been re-pushing the branch for it to build on Jenkins. It has been failing, but it doesn't seem to be related to my fixes (it seems like Jenkins issues). It finally worked
To test the fix:

Create a project
Create 2 vpcs (A and B)
Create a VPN gateway on each vpc
Create 2 customer gateways (pointing to each vpc's CIDR and vpn gateway)
Create a passive vpn connection from A to B
Create an active vpn connection form B to A
You can now ssh from A to B, or B to A

Bump

@pdube LGTM, based on a set of tests that I run on this branch:
nosetests --with-marvin --marvin-config=${marvinCfg} -s -a tags=advanced,required_hardware=true \
component/test_vpc_redundant.py \
component/test_routers_iptables_default_policy.py \
component/test_routers_network_ops.py \
component/test_vpc_router_nics.py \
smoke/test_loadbalance.py \
smoke/test_internal_lb.py \
smoke/test_ssvm.py

Result:
Create a redundant VPC with two networks with two VMs in each network ... === TestName: test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL | Status : SUCCESS ===
ok
Create a redundant VPC with two networks with two VMs in each network and check default routes ... === TestName: test_02_redundant_VPC_default_routes | Status : SUCCESS ===
ok
Test iptables default INPUT/FORWARD policy on RouterVM ... === TestName: test_02_routervm_iptables_policies | Status : SUCCESS ===
ok
Test iptables default INPUT/FORWARD policies on VPC router ... === TestName: test_01_single_VPC_iptables_policies | Status : SUCCESS ===
ok
Stop existing router, add a PF rule and check we can access the VM ... === TestName: test_isolate_network_FW_PF_default_routes | Status : SUCCESS ===
ok
Test redundant router internals ... === TestName: test_RVR_Network_FW_PF_SSH_default_routes | Status : SUCCESS ===
ok
Create a VPC with two networks with one VM in each network and test nics after destroy ... === TestName: test_01_VPC_nics_after_destroy | Status : SUCCESS ===
ok
Create a VPC with two networks with one VM in each network and test default routes ... === TestName: test_02_VPC_default_routes | Status : SUCCESS ===
ok
Test to create Load balancing rule with source NAT ... === TestName: test_01_create_lb_rule_src_nat | Status : SUCCESS ===
ok
Test to create Load balancing rule with non source NAT ... === TestName: test_02_create_lb_rule_non_nat | Status : SUCCESS ===
ok
Test for assign & removing load balancing rule ... === TestName: test_assign_and_removal_lb | Status : SUCCESS ===
ok
Test to verify access to loadbalancer haproxy admin stats page ... === TestName: test02_internallb_haproxy_stats_on_all_interfaces | Status : SUCCESS ===
ok
Test create, assign, remove of an Internal LB with roundrobin http traffic to 3 vm's ... === TestName: test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 | Status : SUCCESS ===
ok
Test SSVM Internals ... === TestName: test_03_ssvm_internals | Status : SUCCESS ===
ok
Test CPVM Internals ... === TestName: test_04_cpvm_internals | Status : SUCCESS ===
ok
Test stop SSVM ... === TestName: test_05_stop_ssvm | Status : SUCCESS ===
ok
Test stop CPVM ... === TestName: test_06_stop_cpvm | Status : SUCCESS ===
ok
Test reboot SSVM ... === TestName: test_07_reboot_ssvm | Status : SUCCESS ===
ok
Test reboot CPVM ... === TestName: test_08_reboot_cpvm | Status : SUCCESS ===
ok
Test destroy SSVM ... === TestName: test_09_destroy_ssvm | Status : SUCCESS ===
ok
Test destroy CPVM ... === TestName: test_10_destroy_cpvm | Status : SUCCESS ===
ok

----------------------------------------------------------------------
Ran 21 tests in 10163.375s

OK

And:
nosetests --with-marvin --marvin-config=${marvinCfg} -s -a tags=advanced,required_hardware=false \
smoke/test_routers.py \
smoke/test_network_acl.py \
smoke/test_privategw_acl.py \
smoke/test_reset_vm_on_reboot.py \
smoke/test_vm_life_cycle.py \
smoke/test_vpc_vpn.py \
smoke/test_service_offerings.py \
component/test_vpc_offerings.py \
component/test_vpc_routers.py

Result:
Test router internal advanced zone ... === TestName: test_02_router_internal_adv | Status : SUCCESS ===
ok
Test restart network ... === TestName: test_03_restart_network_cleanup | Status : SUCCESS ===
ok
Test router basic setup ... === TestName: test_05_router_basic | Status : SUCCESS ===
ok
Test router advanced setup ... === TestName: test_06_router_advanced | Status : SUCCESS ===
ok
Test stop router ... === TestName: test_07_stop_router | Status : SUCCESS ===
ok
Test start router ... === TestName: test_08_start_router | Status : SUCCESS ===
ok
Test reboot router ... === TestName: test_09_reboot_router | Status : SUCCESS ===
ok
test_privategw_acl (integration.smoke.test_privategw_acl.TestPrivateGwACL) ... === TestName: test_privategw_acl | Status : SUCCESS ===
ok
Test reset virtual machine on reboot ... === TestName: test_01_reset_vm_on_reboot | Status : SUCCESS ===
ok
Test advanced zone virtual router ... === TestName: test_advZoneVirtualRouter | Status : SUCCESS ===
ok
Test Deploy Virtual Machine ... === TestName: test_deploy_vm | Status : SUCCESS ===
ok
Test Multiple Deploy Virtual Machine ... === TestName: test_deploy_vm_multiple | Status : SUCCESS ===
ok
Test Stop Virtual Machine ... === TestName: test_01_stop_vm | Status : SUCCESS ===
ok
Test Start Virtual Machine ... === TestName: test_02_start_vm | Status : SUCCESS ===
ok
Test Reboot Virtual Machine ... === TestName: test_03_reboot_vm | Status : SUCCESS ===
ok
Test destroy Virtual Machine ... === TestName: test_06_destroy_vm | Status : SUCCESS ===
ok
Test recover Virtual Machine ... === TestName: test_07_restore_vm | Status : SUCCESS ===
ok
Test migrate VM ... SKIP: At least two hosts should be present in the zone for migration
Test destroy(expunge) Virtual Machine ... === TestName: test_09_expunge_vm | Status : SUCCESS ===
ok
Test Remote Access VPN in VPC ... === TestName: test_vpc_remote_access_vpn | Status : SUCCESS ===
ok
Test VPN in VPC ... === TestName: test_vpc_site2site_vpn | Status : SUCCESS ===
ok
Test to create service offering ... === TestName: test_01_create_service_offering | Status : SUCCESS ===
ok
Test to update existing service offering ... === TestName: test_02_edit_service_offering | Status : SUCCESS ===
ok
Test to delete service offering ... === TestName: test_03_delete_service_offering | Status : SUCCESS ===
ok
Test create VPC offering ... === TestName: test_01_create_vpc_offering | Status : SUCCESS ===
ok
Test VPC offering without load balancing service ... === TestName: test_03_vpc_off_without_lb | Status : EXCEPTION ===
ERROR
Test VPC offering without static NAT service ... === TestName: test_04_vpc_off_without_static_nat | Status : EXCEPTION ===
ERROR
Test VPC offering without port forwarding service ... === TestName: test_05_vpc_off_without_pf | Status : EXCEPTION ===
ERROR
Test VPC offering with invalid services ... === TestName: test_06_vpc_off_invalid_services | Status : SUCCESS ===
ok
Test update VPC offering ... === TestName: test_07_update_vpc_off | Status : SUCCESS ===
ok
Test list VPC offering ... === TestName: test_08_list_vpc_off | Status : SUCCESS ===
ok
test_09_create_redundant_vpc_offering (integration.component.test_vpc_offerings.TestVPCOffering) ... === TestName: test_09_create_redundant_vpc_offering | Status : SUCCESS ===
ok
Test start/stop of router after addition of one guest network ... === TestName: test_01_start_stop_router_after_addition_of_one_guest_network | Status : SUCCESS ===
ok
Test reboot of router after addition of one guest network ... === TestName: test_02_reboot_router_after_addition_of_one_guest_network | Status : SUCCESS ===
ok
Test to change service offering of router after addition of one guest network ... === TestName: test_04_chg_srv_off_router_after_addition_of_one_guest_network | Status : SUCCESS ===
ok
Test destroy of router after addition of one guest network ... === TestName: test_05_destroy_router_after_addition_of_one_guest_network | Status : SUCCESS ===
ok
Test to stop and start router after creation of VPC ... === TestName: test_01_stop_start_router_after_creating_vpc | Status : SUCCESS ===
ok
Test to reboot the router after creating a VPC ... === TestName: test_02_reboot_router_after_creating_vpc | Status : SUCCESS ===
ok
Tests to change service offering of the Router after ... === TestName: test_04_change_service_offerring_vpc | Status : SUCCESS ===
ok
Test to destroy the router after creating a VPC ... === TestName: test_05_destroy_router_after_creating_vpc | Status : SUCCESS ===
ok
----------------------------------------------------------------------
Ran 40 tests in 7667.102s

FAILED (SKIP=1, errors=3)

The 3 errors are due to cleanup problems that are were broken on master when this was branched off. It was fixed in PR #967.
Please note:

There is no test covering your change, so I didn't test that. I would appreciate it if you could somehow show here that it works, for example with some screen shots (or better, write a Marvin test, but that doesn't have to be done in this PR)
Jenkins failed, please force-push to have it run again. We can only merge once Jenkins is green.
While you're at it, if you rebase the 3 errors above will also disappear.

Thanks for the fix @pdube !

@pdube @pdion891 Could you please look at this PR? Would be nice to include it soon.

@remibergsma I rebased and repushed. I will take some screen shots later! Thanks!

code reviewed. nothing strange. lgtm

Will run the tests again since the commit changed.

@remibergsma The commit didn't change, I just rebased

@pdube I trust you, but the commit hash changed so I just run them again.
LGTM, based on a set of tests that I run on this branch (which I rebased myself first):
nosetests --with-marvin --marvin-config=${marvinCfg} -s -a tags=advanced,required_hardware=true \
component/test_vpc_redundant.py \
component/test_routers_iptables_default_policy.py \
component/test_routers_network_ops.py \
component/test_vpc_router_nics.py \
smoke/test_loadbalance.py \
smoke/test_internal_lb.py \
smoke/test_ssvm.py \
smoke/test_network.py

Result:
Create a redundant VPC with two networks with two VMs in each network ... === TestName: test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL | Status : SUCCESS ===
ok
Create a redundant VPC with two networks with two VMs in each network and check default routes ... === TestName: test_02_redundant_VPC_default_routes | Status : SUCCESS ===
ok
Test iptables default INPUT/FORWARD policy on RouterVM ... === TestName: test_02_routervm_iptables_policies | Status : SUCCESS ===
ok
Test iptables default INPUT/FORWARD policies on VPC router ... === TestName: test_01_single_VPC_iptables_policies | Status : SUCCESS ===
ok
Stop existing router, add a PF rule and check we can access the VM ... === TestName: test_isolate_network_FW_PF_default_routes | Status : SUCCESS ===
ok
Test redundant router internals ... === TestName: test_RVR_Network_FW_PF_SSH_default_routes | Status : SUCCESS ===
ok
Create a VPC with two networks with one VM in each network and test nics after destroy ... === TestName: test_01_VPC_nics_after_destroy | Status : SUCCESS ===
ok
Create a VPC with two networks with one VM in each network and test default routes ... === TestName: test_02_VPC_default_routes | Status : SUCCESS ===
ok
Test to create Load balancing rule with source NAT ... === TestName: test_01_create_lb_rule_src_nat | Status : SUCCESS ===
ok
Test to create Load balancing rule with non source NAT ... === TestName: test_02_create_lb_rule_non_nat | Status : SUCCESS ===
ok
Test for assign & removing load balancing rule ... === TestName: test_assign_and_removal_lb | Status : SUCCESS ===
ok
Test to verify access to loadbalancer haproxy admin stats page ... === TestName: test02_internallb_haproxy_stats_on_all_interfaces | Status : SUCCESS ===
ok
Test create, assign, remove of an Internal LB with roundrobin http traffic to 3 vm's ... === TestName: test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 | Status : SUCCESS ===
ok
Test SSVM Internals ... === TestName: test_03_ssvm_internals | Status : SUCCESS ===
ok
Test CPVM Internals ... === TestName: test_04_cpvm_internals | Status : SUCCESS ===
ok
Test stop SSVM ... === TestName: test_05_stop_ssvm | Status : SUCCESS ===
ok
Test stop CPVM ... === TestName: test_06_stop_cpvm | Status : SUCCESS ===
ok
Test reboot SSVM ... === TestName: test_07_reboot_ssvm | Status : SUCCESS ===
ok
Test reboot CPVM ... === TestName: test_08_reboot_cpvm | Status : SUCCESS ===
ok
Test destroy SSVM ... === TestName: test_09_destroy_ssvm | Status : SUCCESS ===
ok
Test destroy CPVM ... === TestName: test_10_destroy_cpvm | Status : SUCCESS ===
ok
Test for port forwarding on source NAT ... === TestName: test_01_port_fwd_on_src_nat | Status : SUCCESS ===
ok
Test for port forwarding on non source NAT ... === TestName: test_02_port_fwd_on_non_src_nat | Status : SUCCESS ===
ok
Test for reboot router ... === TestName: test_reboot_router | Status : SUCCESS ===
ok
Test for Router rules for network rules on acquired public IP ... === TestName: test_network_rules_acquired_public_ip_1_static_nat_rule | Status : SUCCESS ===
ok
Test for Router rules for network rules on acquired public IP ... === TestName: test_network_rules_acquired_public_ip_2_nat_rule | Status : SUCCESS ===
ok
Test for Router rules for network rules on acquired public IP ... === TestName: test_network_rules_acquired_public_ip_3_Load_Balancer_Rule | Status : SUCCESS ===
ok

----------------------------------------------------------------------
Ran 27 tests in 12312.625s

OK

And:
nosetests --with-marvin --marvin-config=${marvinCfg} -s -a tags=advanced,required_hardware=false \
smoke/test_routers.py \
smoke/test_network_acl.py \
smoke/test_privategw_acl.py \
smoke/test_reset_vm_on_reboot.py \
smoke/test_vm_life_cycle.py \
smoke/test_vpc_vpn.py \
smoke/test_service_offerings.py \
component/test_vpc_offerings.py \
component/test_vpc_routers.py

Result:
Test router internal advanced zone ... === TestName: test_02_router_internal_adv | Status : SUCCESS ===
ok
Test restart network ... === TestName: test_03_restart_network_cleanup | Status : SUCCESS ===
ok
Test router basic setup ... === TestName: test_05_router_basic | Status : SUCCESS ===
ok
Test router advanced setup ... === TestName: test_06_router_advanced | Status : SUCCESS ===
ok
Test stop router ... === TestName: test_07_stop_router | Status : SUCCESS ===
ok
Test start router ... === TestName: test_08_start_router | Status : SUCCESS ===
ok
Test reboot router ... === TestName: test_09_reboot_router | Status : SUCCESS ===
ok
test_privategw_acl (integration.smoke.test_privategw_acl.TestPrivateGwACL) ... === TestName: test_privategw_acl | Status : SUCCESS ===
ok
Test reset virtual machine on reboot ... === TestName: test_01_reset_vm_on_reboot | Status : SUCCESS ===
ok
Test advanced zone virtual router ... === TestName: test_advZoneVirtualRouter | Status : SUCCESS ===
ok
Test Deploy Virtual Machine ... === TestName: test_deploy_vm | Status : SUCCESS ===
ok
Test Multiple Deploy Virtual Machine ... === TestName: test_deploy_vm_multiple | Status : SUCCESS ===
ok
Test Stop Virtual Machine ... === TestName: test_01_stop_vm | Status : SUCCESS ===
ok
Test Start Virtual Machine ... === TestName: test_02_start_vm | Status : SUCCESS ===
ok
Test Reboot Virtual Machine ... === TestName: test_03_reboot_vm | Status : SUCCESS ===
ok
Test destroy Virtual Machine ... === TestName: test_06_destroy_vm | Status : SUCCESS ===
ok
Test recover Virtual Machine ... === TestName: test_07_restore_vm | Status : SUCCESS ===
ok
Test migrate VM ... === TestName: test_08_migrate_vm | Status : SUCCESS ===
ok
Test destroy(expunge) Virtual Machine ... === TestName: test_09_expunge_vm | Status : SUCCESS ===
ok
Test Remote Access VPN in VPC ... === TestName: test_vpc_remote_access_vpn | Status : SUCCESS ===
ok
Test VPN in VPC ... === TestName: test_vpc_site2site_vpn | Status : SUCCESS ===
ok
Test to create service offering ... === TestName: test_01_create_service_offering | Status : SUCCESS ===
ok
Test to update existing service offering ... === TestName: test_02_edit_service_offering | Status : SUCCESS ===
ok
Test to delete service offering ... === TestName: test_03_delete_service_offering | Status : SUCCESS ===
ok
Test for delete account ... === TestName: test_delete_account | Status : SUCCESS ===
ok
Test for Associate/Disassociate public IP address for admin account ... === TestName: test_public_ip_admin_account | Status : SUCCESS ===
ok
Test for Associate/Disassociate public IP address for user account ... === TestName: test_public_ip_user_account | Status : SUCCESS ===
ok
Test for release public IP address ... === TestName: test_releaseIP | Status : SUCCESS ===
ok
Test create VPC offering ... === TestName: test_01_create_vpc_offering | Status : SUCCESS ===
ok
Test VPC offering without load balancing service ... === TestName: test_03_vpc_off_without_lb | Status : SUCCESS ===
ok
Test VPC offering without static NAT service ... === TestName: test_04_vpc_off_without_static_nat | Status : SUCCESS ===
ok
Test VPC offering without port forwarding service ... === TestName: test_05_vpc_off_without_pf | Status : SUCCESS ===
ok
Test VPC offering with invalid services ... === TestName: test_06_vpc_off_invalid_services | Status : SUCCESS ===
ok
Test update VPC offering ... === TestName: test_07_update_vpc_off | Status : SUCCESS ===
ok
Test list VPC offering ... === TestName: test_08_list_vpc_off | Status : SUCCESS ===
ok
test_09_create_redundant_vpc_offering (integration.component.test_vpc_offerings.TestVPCOffering) ... === TestName: test_09_create_redundant_vpc_offering | Status : SUCCESS ===
ok
Test start/stop of router after addition of one guest network ... === TestName: test_01_start_stop_router_after_addition_of_one_guest_network | Status : SUCCESS ===
ok
Test reboot of router after addition of one guest network ... === TestName: test_02_reboot_router_after_addition_of_one_guest_network | Status : SUCCESS ===
ok
Test to change service offering of router after addition of one guest network ... === TestName: test_04_chg_srv_off_router_after_addition_of_one_guest_network | Status : SUCCESS ===
ok
Test destroy of router after addition of one guest network ... === TestName: test_05_destroy_router_after_addition_of_one_guest_network | Status : SUCCESS ===
ok
Test to stop and start router after creation of VPC ... === TestName: test_01_stop_start_router_after_creating_vpc | Status : SUCCESS ===
ok
Test to reboot the router after creating a VPC ... === TestName: test_02_reboot_router_after_creating_vpc | Status : SUCCESS ===
ok
Tests to change service offering of the Router after ... === TestName: test_04_change_service_offerring_vpc | Status : SUCCESS ===
ok
Test to destroy the router after creating a VPC ... === TestName: test_05_destroy_router_after_creating_vpc | Status : SUCCESS ===
ok

----------------------------------------------------------------------
Ran 44 tests in 9085.602s

OK

Again: these test do not cover your change, all they do is show you didn't break them.

Thanks @remibergsma I haven't got time to retest that branch again,  now that it's in master will retry...


Question about validation logic

Looking at the source I found this:
https://github.com/daltoniam/Starscream/blob/70fd033db6d1d0300f900bd05fd05c1246eb721d/Sources/SSLSecurity.swift#L177-L188
and I'm curious why all of the certificates from the server are required to match one of the certificates provided. I was under the impression that it is sufficient for at least one of the certificates to match.
Is this logic correct?
Thanks!

@mbrandonw The original behavior was to require the entire chain to be trusted. Like you, I am under the impression that only one cert needs to match. #412 added a boolean to control the behavior. If you set validateEntireChain=false, it will short circuit out of that loop. If any cert is trusted it will pass. (it's not super clear but a

oh wow, that's it! I saw that option but didn't look further into it. Thanks for the help!

I should add-- I left the existing behavior as default in the PR so that current Starscream users wouldn't suddenly have a change in their security model. I do think it should be the default behavior in a future major release such as 4.0 hint hint @daltoniam 😄


Challenge 19

In the instructions it's asked to assign a "string value that is at least 8 characters" to the tempPassword:

give ReturnTempPassword a prop of tempPassword and assign it a value of a string that is at least 8 characters long.

However there is a test case that requires the password to be exactly serrPbqrPnzc.

The ReturnTempPassword component should display the tempPassword serrPbqrPnzc within strong tags.

That must be new, I don't remember setting the tempPassword to "serrPbqrPnzc".


tf.cond() + tf.dynamic_rnn() gives AttributeError: 'NoneType' object has no attribute 'pivot'

Environment info
Operating System: ubuntu 14.04.5
Installed version of CUDA and cuDNN: cuda7.5 + cuDNNv5
Installed from pip package: python 2.7+0.11.0rc0
Code
import tensorflow as tf

def linear(input_, output_size, scope, init_bias=0.0):
    shape = input_.get_shape().as_list()
    with tf.variable_scope(scope):
        W = tf.get_variable("Matrix", [shape[-1], output_size], tf.float32, tf.random_normal_initializer(stddev=1.0 / math.sqrt(shape[-1])))
    with tf.variable_scope(scope):
        b = tf.get_variable("bias", [output_size], initializer=tf.constant_initializer(init_bias))
    return tf.matmul(input_, W) + b

batch_size = 64
hidden_size = 300
vocab_size = 10000

session = tf.Session()
source = tf.placeholder(tf.float32, [batch_size, 10, hidden_size])
src_len = tf.placeholder(tf.int32, [batch_size])
enc_holder = tf.placeholder(tf.float32, [batch_size, hidden_size])
decode_mode = tf.placeholder(tf.bool)
label = tf.placeholder(tf.int32, [batch_size])

def encoder():
    src_cell = tf.nn.rnn_cell.GRUCell(hidden_size)
    src_init = src_cell.zero_state(batch_size, tf.float32)
    src_hiddens, src_final = tf.nn.dynamic_rnn(src_cell, source, initial_state=src_init, sequence_length=src_len, scope="encoder")
    return src_final

decode_state = tf.cond(decode_mode, lambda:enc_holder, lambda:encoder())
outputs = linear(decode_state, vocab_size, "output")
loss = tf.nn.sparse_softmax_cross_entropy_with_logits(outputs, label)
optimizer = tf.train.AdamOptimizer().minimize(loss)

Error Message:
Traceback (most recent call last):
  File "issue.py", line 33, in <module>
    optimizer = tf.train.AdamOptimizer().minimize(loss)
  File "~/anaconda2/lib/python2.7/site-packages/tensorflow/python/training/optimizer.py", line 196, in minimize
    grad_loss=grad_loss)
  File "~/anaconda2/lib/python2.7/site-packages/tensorflow/python/training/optimizer.py", line 253, in compute_gradients
    colocate_gradients_with_ops=colocate_gradients_with_ops)
  File "~/anaconda2/lib/python2.7/site-packages/tensorflow/python/ops/gradients.py", line 469, in gradients
    in_grads = _AsList(grad_fn(op, *out_grads))
  File "~/anaconda2/lib/python2.7/site-packages/tensorflow/python/ops/control_flow_grad.py", line 91, in _MergeGrad
    return control_flow_ops._SwitchRefOrTensor(grad, grad_ctxt.pivot)
AttributeError: 'NoneType' object has no attribute 'pivot'

Note
If I change the line
decode_state = tf.cond(decode_mode, lambda:enc_holder, lambda:encoder())

to
decode_state = tf.cond(decode_mode, lambda:enc_holder, lambda:enc_holder)

or
decode_state = encoder()

No error thrown. So I guess there must be something wrong when tf.cond() + tf.dynamic_rnn() is combined.

Could it be that your use of "lambda:encoder()" should just be "encoder"?

Traceback (most recent call last):
  File "issue.py", line 30, in <module>
    decode_state = tf.cond(decode_mode, lambda:enc_holder, encoder())
  File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/ops/control_flow_ops.py", line 1694, in cond
    raise TypeError("fn2 must be callable.")
TypeError: fn2 must be callable.

I fixed something that is probably related to this a couple of weeks ago. Could you sync to the HEAD and try again?

I am seeing something similar for bucketize in wide_n_deep_tutorial
AttributeError: 'NoneType' object has no attribute 'bucketize'

Automatically closing due to lack of recent activity. We hope that you were able to resolve it on your own. However, since this is a support issue rather than a bug or feature request, you will probably get more information by posting it on StackOverflow.


Gaussian with user provided sqrtprec

fixed #419
It is only intended for being used with LinearRTO and RegularizedLinearRTO, as RTOs require only operations with sqrtprec (instead of prec).
What I did:

get_sqrtprec_from_sqrtcov in cuqi/distribution/_gaussian.py is updated to accept ascipy.sparse.linalg.LinearOperator object as sqrtprec;
get_indirect_variables in cuqi/utilities/_utilities.py is updated so a Gaussian initialized with a LinearOperator is not detected as a conditional distribution.

Thanks @nabriis for your review and suggestions. I've updated the code to address your comments and am now requesting your further review.

Thanks @nabriis , I'm now requesting @jakobsj 's review.


elasticsearch5 example

Hi
Any chance you provide an example with elasticsearch5.1 log4j2.properties  ?
thanks

@Strijd No, that's pretty specific and the official Log4j 2.x documentation is good enough in my opinion.
See #10 for a related issue.


DO NOT MERGE

Test Coverage decrease
We should get a comment with
total:													(statements)					29.8%
coverage

Release Note
NONE

This is wrong. We need to have a look and fix.


Bug fix 3.9/bts 1070

Scope & Purpose
Backport for https://github.com/arangodb/arangodb/pull/17391.

[x] :hankey: Bugfix
[ ] :pizza: New feature
[ ] :fire: Performance improvement
[ ] :hammer: Refactoring/simplification

Checklist

[x] Tests

[ ] Regression tests
[ ] C++ Unit tests
[x] integration tests
[ ] resilience tests

[ x] :book: CHANGELOG entry made
[ ] :books: documentation written (release notes, API changes, ...)

Related Information

[ ] Docs PR:
[ ] Enterprise PR:
[x] GitHub issue / Jira ticket: https://arangodb.atlassian.net/browse/BTS-1070
[ ] Design document:

@cla-bot check

@cla-bot check


Update TWILIO TO 4.7.1

What
What changes are being made? (e.g. feature, bug, docs etc.)
Why
Why are these changes necessary?
How
How were these changes implemented?
Checklist
Have you done all of these things?

[x] Documentation added
[x] Tests
[x] Typescript definitions updated
[x] Ready to be merged

@rejvban

@rejvban Can you please merge?


Not able to Download Practice Tests

Not able to Download Practice Tests

Yep same here. Would be useful if we could. They are not videos but forms/templates. Maybe they could be converted into some word/doc format ?

It's the same with me.Previously, attachments could be downloaded with version 1.82, but recently, I can't, so I can only ignore the attachment and download the course directly


ttnn.max_bw low PCC

Describe the bug
ttnn.max_bw has low PCC for some inputs. For all failures PCC is around 0.998
To Reproduce
Steps to reproduce the behavior:
Checkout branch: dveizovic/binary-bw-ops-migration
Sweep test for tan is located in 'tests/sweep_framework/sweeps/eltwise/binary_backward/max_bw/max_bw.py'

Go to 'tests/sweep_framework/sweeps/eltwise/unary_backward/rdiv_bw/rdiv_bw.py'
Generate new parameter vectors and run the sweep test

python3 tests/sweep_framework/parameter_generator.py --elastic cloud --module-name eltwise.binary_backward.max_bw.max_bw
python3 tests/sweep_framework/runner.py --elastic cloud --module-name eltwise.binary_backward.max_bw.max_bw --suite-name nightly

See the error. Results can be found on elastic cloud as explained here: https://github.com/tenstorrent/tt-metal/tree/main/tests/sweep_framework

Hi @dveizovicTT ,
I ran the above mentioned sweep test and found that the test has also been written for ROW_MAJOR Layout and bfloat8_b datatype. But according to the documentation,

ttnn.max_bw only supports bfloat16 with TILE Layout combination.
Updating the test with above changes passes the test

From PR https://github.com/tenstorrent/tt-metal/pull/14133 ,
final_test suite is passing, Hence closing issue


Replace string concatenation as argument StringBuffer.append() with chained append() calls

https://issues.apache.org/jira/browse/FLEX-34946

I don't see any reasoning behind why this was done - is this approach more performant or something ?

I would like to help in the development of the compiler.
But there is no desire to work with code that looks bad to say the least.
Using string concatenation contradicts the sense of using StringBuffer.
And yes, this has a negative impact on performance.

I'd think the compiler optimizes the string concatenation, so there's no difference in performance:
http://stackoverflow.com/questions/1532461/stringbuilder-vs-string-concatenation-in-tostring-in-java
Is that not the case?
I think "looks bad" is a personal preference. Simple string concatenation is definitely more legible.

"I think "looks bad" is a personal preference."
Perhaps, but in this situation, combined the two approaches StringBuffer.append and string concatenations.. in this case, the compiler can not generate correct optimization.

Hi SlavaRa,
(Apologies if this gets posted twice.  I think email replies as comments isn't working)
Do you have a link that supports your claim that the compiler cannot
generate the correct optimization?  This article seems to imply that it
can [1]
IMO, the string concatenation is easier to read.  I would want to see
actual profiling that shows that the string concatenation is affecting
compile times in a significant way.
But the most important question to me is:  Is there a reason you want to
work on the mxmlc compiler?  The “falcon” compiler in the flex-falcon repo
is under much more active development and it would be lower risk to be
doing optimizations in that code base.  The “falcon” compiler is the
compiler for the new FlexJS framework and I believe there is still a
reasonable chance it could replace the mxmlc compiler in Flex SDKs some
day.
-Alex
[1]
http://stackoverflow.com/questions/1532461/stringbuilder-vs-string-concatenation-in-tostring-in-java


Load balancing for multiple IPs of a FQDN in dynmic fwding proxy

Title: Supporting load balancing for mulitple IPs of a FQDN in dynamic fwd proxy, Similar to strict DNS
Description:
Currently dynamic fwd proxy , dns resolution works similar to LOGICAL DNS, where the very first IP resolved from IP list of an FQDN is getting cached and used for communication.
In a load run case, its like though there are many end points available for a single FQDN, only the same IP will get used, which is not correct.
in our case the number of originators are 1-2 pods, but the serving end has more end points. If two originators are there means only two IP can get used .
[optional Relevant Links:]
I have raised a  query regarding this n slack , but didnt get any clarification.
https://envoyproxy.slack.com/archives/C78HA81DH/p1620188772051000?thread_ts=1611234659.004800&cid=C78HA81DH

any update on this?

Yeah right now this is a tricky feature because the upstream host only gets one dns result.
@DavidSchinazi will be landing improvements to DFP soon, to handle multiple addresses serially (for happy eyeballs) and it while I don't think we'll have the cycles to work on doing multiple in parallel, we'll at least do loads of refactoring work to make that work easier. If anyone's up for springboarding off those changes to work on parallel connections we'd be happy to help brainstorm design and do reviews.

any brainstorm happening, on how this can be achieved?

I think it's a reasonable feature but someone would have to sign on to do the work :-)

@alyssawilk can you please add the "no stalebot" label to this issue? I think we'll want to keep this issue alive even if we won't address it very soon

@Sooryaa-A can you clarify something please? Are you saying you would like DFP to send requests between DNS results round robin, or you saying that you would like to make sure we try multiple DNS results until we find one that works? Thanks!


Hello, i've problem after install some packages

After installing this two package i got this problem below in screenshot. When i go to Settings->Velocity showing me just white blank page. My added packages is:
1.Show price after login
2.Hide Shop for guest
Please help me to solve this. Thanks for all

Hello @Davronjuraev,
It looks like you are using the paid extension. Please open a support ticket for that as this is not related to the core part,
https://bagisto.uvdesk.com/en/

no it's not, i'm using free exts. All two ext also free

Hello there,
This is only for the Bagisto Core part,
Please open a support ticket for that as this is not related to the core part.
https://bagisto.uvdesk.com/en/


fix: Package build

What does this change?
This just substitutes the use of tsc for build, and uses tsup instead.
This also adds specifications for esm and cjs interoperability on the package.json so
that imports/requires don't get mixed up.
Why is it necessary?
The missing interoperability between esm and cjs caused problems on next builds
and due to that some issues were openned on react-email reporting problems on build.
For the record, here is the error that was happening before:
<EMAIL_ADDRESS>+ 24 modules
Cannot get final name for export 'encodeXML' of ./node_modules/entities/lib/esm/index.js

Also, here is the original issue from react-email.
How does this solve the issue?
After investigating for a bit and testing out a few things I found out the problem
was on the Resend SDK, and after searching found out about this issue on NextJS that said this kind of error was due to missing interoperability between esm and cjs.
Besides this evidence, I have tested and confirm this works by copying the dist and substituting the
resend module with the newly compiled one and the build worked on an existing project.

Fixes #256


{Suggestion} Migrate to SupportClass/lfg-sounds

A suggestion would be to migrate sounds to SupportClass/lfg-sounds

That looks pretty cool. I think it'd be a great addition. Is it safe to assume that most installs of NodeCG meet the 0.7.2 requirement?

Any 0.7 should upgrade as required. I see no problem with it ;)

Sounds good! Didn't want to alienate any potential users. I should have some time to attack this tomorrow evening.

There's a PR open for branch lfg-sounds, if you'd like to take a look and let me know if everything works as expected.


Categorical_Method LHS Input Encoding Error

Operating System: Windows 11 OS
Python version: 3.9.17
summit version used: 0.8.9

Description
I am currently testing a future experimental setup condition in which I am trying to create initial experiments using LHS as a strategy whilst containing categorical and continuous data. When running the code I am getting an area when generating the experimental conditions. I am working within JupyterLab, I have removed some of the names from the file path but everything is the same.
What I Did
import cython
import summit
from summit.benchmarks import ExperimentalEmulator
from summit.domain import *
from summit.utils.dataset import DataSet
from summit.strategies import SOBO, MultitoSingleObjective, LHS
import numpy as np
import pandas as pd
import pkg_resources
import pathlib

DATA_PATH = pathlib.Path("F:/Python Programs/NKData")
input_df = pd.read_csv(DATA_PATH / 'BoundariesV2.csv')

domain = Domain()
for idx, row in input_df.iterrows():
    name = row[0]
    description = row[5]
    data_type = row['Type']

    if data_type == 'Categorical':
        levels = row[2].split(',')

        domain += CategoricalVariable(
            name=name,
            description=description,
            levels=levels
        )
    elif data_type == 'Continuous':
        bounds = [row[3], row[4]]

        domain += ContinuousVariable(
            name=name,
            description=description,
            bounds=bounds
        )
    elif data_type == 'Objective':
        bounds = [row[3], row[4]]
        maximize = row[6]

        domain += ContinuousVariable(
            name=name,
            description=description,
            bounds=bounds,
            is_objective=True,
            maximize=maximize
        )

domain

categorical_method: str = "one-hot"
StartStrat = LHS(domain, random_state = np.random.RandomState(808), categorical_method=categorical_method)
StartExp = StartStrat.suggest_experiments(10)
StartExp

Output

Name
Type
Description
Values

Temperature
continuous, input
Reaction temperature in degrees Celsius (ºC)
[40.0,80.0]

Catalyst_Amount
continuous, input
Catalyst amounts in molar equivalents (Equiv.)
[0.01,1.0]

Starting_Reagent
continuous, input
2-Methylimidozole amounts in molar equivalents (Equiv.)
[1.1,2.0]

Solvent
continuous, input
Solvent amount in milliliters (mL)
[0.1,0.35]

Time
continuous, input
Duration of reaction in hours (hr)
[2.0,24.0]

Base
continuous, input
Base amount in molar equivalents (Equiv.)
[1.0,5.0]

Catalyst_Type
categorical, input
Catalyst Types
3 levels

Main_Product
continuous, maximize objective
LCAP of Main Product
[0.0,1.0]

Main_Impurity
continuous, minimize objective
LCAP of Main Impurity
[0.0,1.0]

Error I get from running the very last cell
AttributeError                            Traceback (most recent call last)
Cell In[4], line 4
2 categorical_method: str = "one-hot"
3 StartStrat = LHS(domain, random_state = np.random.RandomState(808), categorical_method=categorical_method)
----> 4 StartExp = StartStrat.suggest_experiments(10)
5 StartExp
File ~\AppData\Roaming\Python\Python39\site-packages\summit\strategies\random.py:286, in LHS.suggest_experiments(self, num_experiments, criterion, exclude, **kwargs)
284 design = DataSet.from_df(design)
285 design[("strategy", "METADATA")] = "LHS"
--> 286 return self.transform.un_transform(
287     design, categorical_method=self.categorical_method
288 )
File ~\AppData\Roaming\Python\Python39\site-packages\summit\strategies\base.py:324, in Transform.un_transform(self, ds, **kwargs)
318 # Categorical variables using one-hot encoding
319 elif (
320     isinstance(variable, CategoricalVariable)
321     and categorical_method == "one-hot"
322 ):
323     # Get one-hot encoder
--> 324     enc = self.encoders[variable.name]
326     # Get array to be transformed
327     one_hot_names = [f"{variable.name}_{l}" for l in variable.levels]
AttributeError: 'Transform' object has no attribute 'encoders'
I apologise for any formatting issues I am new to this but I would greatly appreciate any help or advice for workarounds. Thank you for providing this library it is amazing.

I am so sorry that I did not see this. If it is still relevant for me to take a look, please respond @HiddenBao
I will take a look later this week.

No worries! I briefly went back and redid the code again without requiring the .csv file to see if it was the issue however I get the same error.
What I Did
import summit
from summit.benchmarks import ExperimentalEmulator
from summit.domain import *
from summit.utils.dataset import DataSet
from summit.strategies import LHS, MTBO

domain = Domain()

domain += CategoricalVariable(
    name = "Catalyst",
    description = "Test",
    levels = [
        "A",
        "B",
        "C",
        "D"
    ],
)

domain += ContinuousVariable(
    name = "Temperature",
    description = "Test",
    bounds = [40, 80]
)

domain += ContinuousVariable(
    name = "Catalyst_Amount",
    description = "Test",
    bounds = [0.01, 1.0]
)

domain += ContinuousVariable(
    name = "Reagent",
    description = "Test",
    bounds = [1.1, 2.0]
)

domain += ContinuousVariable(
    name = "Solvent",
    description = "Test",
    bounds = [0.1, 0.35]
)

domain += ContinuousVariable(
    name = "Time",
    description = "Test",
    bounds = [2.0, 24]
)

domain += ContinuousVariable(
    name = "Base",
    description = "Test",
    bounds = [1.0, 5.0]
)

domain += ContinuousVariable(
    name = "Main_Product",
    description = "Test",
    bounds = [0, 1],
    is_objective = True,
    maximize = True
)

domain += ContinuousVariable(
    name = "Main_Impurity",
    description = "Test",
    bounds = [0, 1],
    is_objective = True,
    maximize = False
)
domain

The domain gets created perfectly fine to my knowledge, I then tried running the transform in the LHS and MTBO strategy using the following.
strategy = LHS(domain,
                 random_state = np.random.RandomState(808),
                 categorical_method="one-hot"
                )
StartExp = StartStrat.suggest_experiments(10)
StartExp

strategy = MTBO(domain,
                 random_state = np.random.RandomState(808),
                 categorical_method="one-hot"
                )
StartExp = StartStrat.suggest_experiments(10)
StartExp

And both return the same error still.
---------------------------------------------------------------------------
AttributeError                            Traceback (most recent call last)
Cell In[15], line 5
      1 strategy = MTBO(domain,
      2                  random_state = np.random.RandomState(808),
      3                  categorical_method="one-hot"
      4                 )
----> 5 StartExp = StartStrat.suggest_experiments(10)
      6 StartExp

File ~\AppData\Roaming\Python\Python39\site-packages\summit\strategies\random.py:286, in LHS.suggest_experiments(self, num_experiments, criterion, exclude, **kwargs)
    284 design = DataSet.from_df(design)
    285 design[("strategy", "METADATA")] = "LHS"
--> 286 return self.transform.un_transform(
    287     design, categorical_method=self.categorical_method
    288 )

File ~\AppData\Roaming\Python\Python39\site-packages\summit\strategies\base.py:324, in Transform.un_transform(self, ds, **kwargs)
    318 # Categorical variables using one-hot encoding
    319 elif (
    320     isinstance(variable, CategoricalVariable)
    321     and categorical_method == "one-hot"
    322 ):
    323     # Get one-hot encoder
--> 324     enc = self.encoders[variable.name]
    326     # Get array to be transformed
    327     one_hot_names = [f"{variable.name}_{l}" for l in variable.levels]

AttributeError: 'Transform' object has no attribute 'encoders'

Thank you again for creating this library, it is great and extremely useful. I greatly appreciate all the work that has been done for it.

This definitely seems like a bug - I will take a look this weekend!

Can confirm that I can reproduce the bug. Going to look into a fix now


Add React Loads as an example to the readme

😄

Thank you very much, @jxom.
I had this item in my todo list:

[x] add Loads to Automata


Spread operator ...

How to enable spread (...) es6 operator?
I use webpack-2 branch
ERROR in ./src/reducers/calendar.js
Module build failed: SyntaxError: ./src/reducers/calendar.js: Unexpected token (12:11)

  10 |  switch (action.type) {
  11 |          case actionTypes.SHIFT_CALENDAR_DAY_BACK:
> 12 |                  return  {...state, startDate: state.startDate - 1000 * 60 * 60 * 24}
     |                           ^
  13 |
  14 |          case actionTypes.SHIFT_CALENDAR_DAY_FORWARD:
  15 |                  return  {...state, startDate: state.startDate + 1000 * 60 * 60 * 24}

 @ ./src/reducers/index.js 9:16-37

@xfo Sorry for the late reply. I hope you sorted this already, however I've created a pull request so you can see what you need to add to enable the spread operator.
You can find it here: https://github.com/rbartoli/react-boilerplate/pull/7/files


Android Compose Change the App Icon

Name of the Codelab or Codelab URL
https://developer.android.com/codelabs/basic-android-kotlin-compose-training-change-app-icon?continue=https%3A%2F%2Fdeveloper.android.com%2Fcourses%2Fpathways%2Fandroid-basics-compose-unit-3-pathway-2%23codelab-https%3A%2F%2Fdeveloper.android.com%2Fcodelabs%2Fbasic-android-kotlin-compose-training-change-app-icon#5
Describe the problem
A clear and concise description of what the problem is.
The image of foreground file provided by codelab is different from the preview of codelab.
In which lesson and step of the codelab can this issue be found?
Lesson number + step number.
Android Basics with Compose
Unit 3: Display lists and use Material Design
Pathway 2: Build a scrollable list
Change the icon codelab
step 6: Change the app icon
How to reproduce?
What are the exact steps to reproduce the problem?
I think the foreground file should be changed or preview should be changed.
Versions

What version of Android Studio are you using?
What API level are you targeting?

Additional information
Add any other context about the problem here.

codelab: basic-android-compose-training-add-scrollable-list

Duplicate of #25

Closing as duplicate.


instances using convoy in "starting" loop after docker restart on host

When restarting Docker service on a Rancher Host, containers on that host utilizing the convoy-gluster volume driver are stuck in a perpetual "starting" state with rancher-agent logs shown below.

crate glusterfs from catalog
create convoy-gluster from catalog
launch service with convoy-gluster backed volume
systemctl restart docker on Rancher host with said container
container in perpetual starting state with errors shows below in rancher-agent
delete and re-create of sevice on same host works (presumably because it was after convoy-gluster containers started)

Could there be some race condition in this case causing the start of the container to use an older referenced uuid for volume info?
rancher-agent log entry after systemctl docker restart
2016-02-17 21:32:48,342 ERROR agent [139948994872176] [event.py:112] Error in request : 26dc773b-1cb7-4375-a139-e64f4be427f8
Traceback (most recent call last):
  File "/var/lib/cattle/pyagent/cattle/agent/event.py", line 95, in _worker_main
    resp = agent.execute(req)
  File "/var/lib/cattle/pyagent/cattle/agent/__init__.py", line 15, in execute
    return self._router.route(req)
  File "/var/lib/cattle/pyagent/cattle/plugins/core/event_router.py", line 13, in route
    resp = handler.execute(req)
  File "/var/lib/cattle/pyagent/cattle/agent/handler.py", line 34, in execute
    return method(req=req, **req.data.__dict__)
  File "/var/lib/cattle/pyagent/cattle/plugins/docker/compute.py", line 481, in instance_activate
    self._do_instance_activate(instance, host, progress)
  File "/var/lib/cattle/pyagent/cattle/plugins/docker/compute.py", line 559, in _do_instance_activate
    client.start(container_id)
  File "/var/lib/cattle/pyagent/dist/docker/utils/decorators.py", line 21, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/var/lib/cattle/pyagent/dist/docker/api/container.py", line 343, in start
    self._raise_for_status(res)
  File "/var/lib/cattle/pyagent/dist/docker/client.py", line 142, in _raise_for_status
    raise errors.APIError(e, response, explanation=explanation)
APIError: 500 Server Error: Internal Server Error ("Cannot start container a0fa8ff22cfcfd54c18777e60449d31f1f39ed05c268351e0160c433f8a9ce54: Unable to setup mount point, neither source nor volume defined")

docker info
Containers: 29
Images: 1919
Server Version: 1.9.1
Storage Driver: devicemapper
 Pool Name: docker-253:0-46007121-pool
 Pool Blocksize: 65.54 kB
 Base Device Size: 10.74 GB
 Backing Filesystem:
 Data file: /dev/loop0
 Metadata file: /dev/loop1
 Data Space Used: 34.27 GB
 Data Space Total: 107.4 GB
 Data Space Available: 73.1 GB
 Metadata Space Used: 86.9 MB
 Metadata Space Total: 2.147 GB
 Metadata Space Available: 2.061 GB
 Udev Sync Supported: true
 Deferred Removal Enabled: false
 Deferred Deletion Enabled: false
 Deferred Deleted Device Count: 0
 Data loop file: /var/lib/docker/devicemapper/devicemapper/data
 Metadata loop file: /var/lib/docker/devicemapper/devicemapper/metadata
 Library Version: 1.02.107-RHEL7 (2015-10-14)
Execution Driver: native-0.2
Logging Driver: json-file
Kernel Version: 3.10.0-327.3.1.el7.x86_64
Operating System: CentOS Linux 7 (Core)
CPUs: 24
Total Memory: 62.86 GiB
Name: **SCRUBBED
ID: **SCRUBBED**
WARNING: bridge-nf-call-iptables is disabled
WARNING: bridge-nf-call-ip6tables is disabled

rancher info
Component Version
Rancher v0.59.0
Cattle  v0.148.0
User Interface  v0.90.0
Rancher Compose v0.7.2

I see this has been released from the 1.0 Milestone.
Is there any workaround in the meantime, as this prevents applications from coming back online in the event of any docker restarts, such as on a server reboot.

It looks like #3670 is a duplicate of this one, but #3670 has a lot more discussion so this one should probably be closed.

I'm getting this for NFS too. Same steps to reproduce, just replace gluster with nfs, basically. What's weird is that I have another service that uses NFS mounts too, and that starts up properly after a system reboot.
$ docker start b03fd52327fe
Error response from daemon: Cannot start container b03fd52327fe: Unable to setup mount point, neither source nor volume defined
Error: failed to start containers: [b03fd52327fe]

$ docker inspect b03fd52327fe
...
"Mounts": [
        {
            "Name": "test",
            "Source": "/var/lib/rancher/convoy/convoy-nfs-bd8e9f43-dfe2-4c1c-9161-b4a4541e7c1a/mnt/test",
            "Destination": "/data",
            "Driver": "convoy-nfs",
            "Mode": "",
            "RW": true
        },
        {
            "Name": "e27d2186593f82228765e52c82ee9b034525b5e32f2c03156b6893160ec2a517",
            "Source": "",
            "Destination": "/usr/local/etc/service",
            "Driver": "local",
            "Mode": "",
            "RW": true
        }
    ],
...

As you can see, Source for one of the volumes is empty...I think that this is the cause for this error.
I'm still investigating and doing a diff against my other service that works like it should...

Closing due to inactivity, please reopen if you think this is still relevant to current releases & important


Unable to use @aws-solutions-constructs/aws-kinesisstreams-kinesisfirehose-s3 with latest CDK versions

Attempting to update dependencies in a project using @aws-solutions-constructs/aws-kinesisstreams-kinesisfirehose-s3 fails due to a pinned version of CDK in the package definition. this seems the opposite of the goals of the project.

AWS Solutions Constructs and the AWS CDK are independent teams and have different release schedules. Each release of AWS Solutions Constructs is built against a specific version of the AWS CDK. The CHANGELOG.md file lists the CDK version associated with each AWS Solutions Constructs release. For instance, AWS Solutions Constructs v2.39.0 was built against AWS CDK v2.76.0. This means that to use AWS Solutions Constructs v2.39.0, your application must include AWS CDK v2.76.0 or later. You can continue to use the latest AWS CDK versions and upgrade the your AWS Solutions Constructs version when new releases become available.

Reproduction Steps

npm install aws-cdk-lib
npm install @aws-solutions-constructs/aws-kinesisstreams-kinesisfirehose-s3

Error Log

npm ERR! code ERESOLVE
npm ERR! ERESOLVE unable to resolve dependency tree
npm ERR!
npm ERR! While resolving<EMAIL_ADDRESS>npm ERR! Found<EMAIL_ADDRESS>npm ERR! node_modules/aws-cdk-lib
npm ERR!   dev<EMAIL_ADDRESS>from the root project
npm ERR!
npm ERR! Could not resolve dependency:
npm ERR! peer<EMAIL_ADDRESS>from<EMAIL_ADDRESS>npm ERR! node_modules/@aws-solutions-constructs/aws-kinesisstreams-kinesisfirehose-s3
npm ERR<EMAIL_ADDRESS>from the root project
npm ERR!
npm ERR! Fix the upstream dependency conflict, or retry
npm ERR! this command with --force or --legacy-peer-deps
npm ERR! to accept an incorrect (and potentially broken) dependency resolution.
npm ERR!
npm ERR!
npm ERR! For a full report see:
npm ERR! /Users/turacma/.npm/_logs/2024-04-03T19_00_21_247Z-eresolve-report.txt

npm ERR! A complete log of this run can be found in: /Users/turacma/.npm/_logs/2024-04-03T19_00_21_247Z-debug-0.log

Environment

CDK CLI Version      : 2.118.0 (build a40f2ec)
CDK Framework Version<EMAIL_ADDRESS>AWS Solutions Constructs Version<EMAIL_ADDRESS>OS                   : MacOS
Language             : Typescript

Other

This is :bug: Bug Report

Thanks for reaching out - we'll take a look. First impression is that we may be able to address this quickly.

We just dropped 2.54.1, I believe it will fix this issue. We updated the version of CDK underlying the constructs to the latest - so 2.54.1 will require CDK 2.135.0 or later (the or later aspect is what we fixed).

(Please reopen is the issue is not fully addressed, thanks)


CASSANDRA-18230 CEP 20: DDM cleanup language, rearrange code examples.

Authored by Lorina Poland (polandll); Reviewed by ?? for CASSANDRA-18230.
Thanks for sending a pull request! Here are some tips if you're new here:

Ensure you have added or run the appropriate tests for your PR.
Be sure to keep the PR description updated to reflect all changes.
Write your PR title to summarize what this PR proposes.
If possible, provide a concise example to reproduce the issue for a faster review.
Read our contributor guidelines
If you're making a documentation change, see our guide to documentation contribution

Commit messages should follow the following format:
<One sentence description, usually Jira title or CHANGES.txt summary>

<Optional lengthier description (context on patch)>

patch by <Authors>; reviewed by <Reviewers> for CASSANDRA-#####

Co-authored-by: Name1 <email1>
Co-authored-by: Name2 <email2>

The Cassandra Jira

I see you have commented out SASI https://github.com/apache/cassandra/pull/3090/files#r1489145896
I dont think this change has anything to do with the patch and I would just move it back. We might put a note into SASI that a user should consider using SAI instead but I dont think that this PR is a good vehicle for that. If we are on the same page here, I ll merge the PR into trunk (minus sasi change).

Oh geez, this is what happens when you get pulled to another task before truly finishing the first. I have refactored the SASI docs into its own section in developing/cql/indexing/sasi. In another repo. And I didn't finish the task of pulling that writing over to this repo. I will just add the original back in, as you say, for this ticket, and open another PR for the indexing stuff. Thanks for the catch!

@polandll no worries, I'll take care of that. Thanks for the PR!

Yes, this can be merged to trunk, 5.1, 5.0.

merged here https://github.com/apache/cassandra/commit/0f2da96c6c617bb08c15303eb8b3cea3a55daf37


Change license to MIT OR Apache-2.0

Fixes #21

Dear @twistedfall, @samoylovfp, @hdhoang,
Kindly requesting to re-license your work in serde-rustsqlite under MIT or Apache-2.0, so that the users of Burn project  can distribute binaries. Please see #21 for more details.

Permission is hereby granted by me (samoylovfp) to re-license the changes I have made to the source code of this project (serde_rusqlite). My contributions can now be licensed under MIT AND/OR Apache 2 licenses.
Thank you  for maintaining this project.

I (hdhoang) dedicate my contributions in this project to the public domain, and hereby disown any and all copyright on them.
Wish you all lucks.

I have released version 0.34.0 with that change (and rusqlite bump)

@twistedfall Than you very much!


memberOf  may not work correctly for some codings

Current implementation of memberOf relies on strict equality of SimpleCodings tested tested for membership and returned in the intersection from the terminology server.
It appears however that Ontoserver may change the value of the coding version so that the input and output coding are not longer strictly equal.
This can work in both directions, e.g.:

the request includes unversioned codings and the response versioned codings  (this happens only sometimes, e.g. when two different codings systems are included in the request)
the request includes versioned codings and the response unversioned codings (this always happens)

Here is a link to the postman collection with two request that illustrate this issue:
https://www.getpostman.com/collections/9328c88ceb7925aa0e58

It's becoming clear to me that the current implementation of memberOf is not going to work for a range of different cases, including:

Versioned codings / versioned ValueSets, as @piotrszul describes above
SCT post-coordinated codings
Case-insensitive codes

I think the way to reliably fix this is to revert back to the implementation of this method that used $validate-code. However, I think that there are a few ways that we can offset the performance difference between it and the current ValueSet $expand intersection method:

Do away with batching requests, and use a plain GET, which is cacheable.
Issue the GET requests in parallel, at a configurable level of parallelism.
Use conditional requests and maintain a shared cache of $validate-code results keyed on ETag.

If we can do this well, it can also provide us with a pattern for an efficient implementation of #366, and also possible further optimisation of other terminology functions such as subsumes/subsumedBy and translate, through caching.

Following some initial investigations, this is going to be difficult to implement for a number of reasons:

Performance using $validate-code, particularly when not using batch, is currently unacceptable, even with parallelism (using Ontoserver).
The current implementation of memberOf (and the "mapper with preview" pattern in general) does not seem to de-duplicate Codings. This performs quite well with the ValueSet intersection method, but is a problem with the $validate-code method.
Any sort of caching done on terminology requests also brings up the question of when we would invalidate this cache - this needs some more thought.

I think this will be resolved by #757.

Resolved in v6.1.0.