Asyncio support async/await

Now I'm working on Asynchronous application. And using asyncio library which is built in python3. And uses async/await syntax.
Good to have possibility to return ffmpeg process as a coroutine and use it in a asyncio way.
For example:
process = await (
    ffmpeg
    .input('input.mp4')
    .output('pipe:', format='rawvideo', pix_fmt='rgb24')['v']
    .run_asyncio(pipe_stdout=True, quiet=False)
)

while True:
    frame_bytes = await process.stdout.read(video_frame_size)
    if len(frame_bytes) == 0:
        break

await process.wait()

It would be very handy for asynchronous applications.

+1

@akolpakov Shouldn't it be possible to run the output of https://kkroening.github.io/ffmpeg-python/#ffmpeg.compile via an awaited https://docs.python.org/3/library/asyncio-subprocess.html#asyncio.create_subprocess_exec with minimal code changes in the meantime?

FYI, this supports aysnc i/o : https://github.com/jonghwanhyeon/python-ffmpeg

@akolpakov Shouldn't it be possible to run the output of https://kkroening.github.io/ffmpeg-python/#ffmpeg.compile via an awaited https://docs.python.org/3/library/asyncio-subprocess.html#asyncio.create_subprocess_exec with minimal code changes in the meantime?

I've being using something like that and it's been working fine. Although I just have a single use case, so it's not exhaustively tested. https://gist.github.com/fedej/7f848d20205efbff4db4a0fc78eae7ba


Please add 'Claim All' on Earn

Hi team, i have a suggestion about feature request. Right now if user want to claim rewards, user need to claim it one by one. How about add Claim all features so user will be easier to claim all rewards they get from farming LP and staking KDEX? it will be a plus point for Klaytn DEX.
Also on wallet address section it will be good if provided with link to klaytn explorer. Lastly, i think it will be good if Charts is available on Trade rather than on different section.
I think it's only suggestion i can give for Klaytn DEX. Hopefully this can help, thanks

@kevinyusuf1607sw Thank you for your suggestions, we've taken your request and noted it within our potential enhancement document list!


'az sql server create' mishandling password string

Describe the bug
az sql server create --admin-password argument tries to interpret the password and fails on less-than sign.
I've tried single quotes, double quotes, putting in equal sign, variable... No Luck so far.
Errors:
PS C:\> az sql server create --admin-user "admin" --admin-password a<b
The system cannot find the file specified.
PS C:\> az sql server create --admin-user "admin" --admin-password 'a<b'
The system cannot find the file specified.
PS C:\> az sql server create --admin-user "admin" --admin-password "a<b"
The system cannot find the file specified.
PS C:\> az sql server create --admin-user "admin" --admin-password='a<b'
The system cannot find the file specified.
PS C:\> az sql server create --admin-user "admin" --admin-password="a<b"
The system cannot find the file specified.
PS C:\> $sqlPassword="a<b"
PS C:\> az sql server create --admin-user "admin" --admin-password $sqlPassword
The system cannot find the file specified.
PS C:\> az sql server create --admin-user "admin" --admin-password=$sqlPassword
The system cannot find the file specified.

To Reproduce:
az sql server create --admin-user "admin" --admin-password "a<b"
Expected Behavior
Fails with az sql server create: error: the following arguments are required: --resource-group/-g, --name/-n
Environment Summary
Windows-10-10.0.17134-SP0
Python 3.6.6
Shell: powershell.exe

azure-cli 2.0.71 *

Additional Context
Right-sided parenthesis also breaks this in different way:
PS C:\> az sql server create --admin-user "admin" --admin-password="a)b"
b was unexpected at this time.
C:\>  "C:\Program Files (x86)\Microsoft SDKs\Azure\CLI2\wbin\\..\python.exe" -IBm azure.cli sql server create --admin-user admin --admin-password=a)b

Thank you for reporting this issue. It looks like this issue affects more than just SQL commands.
> az group create -n "a<b" -g "westus"
The system cannot find the file specified.

I'll include the CLI core team to help investigate deeper.

@jaredmoo  are you want to run az group create -n "a<b" -l "westus" not -g "westus"? If yes, az group create will tell you  Parameter 'resource_group_name' must conform to the following pattern: '^[-\\w\\._\\(\\)]+$'. az group have validation for parameters. So I think this may be just related to SQL not core.

In that case it might just be PowerShell interpreting as I/O redirection.

@hKaspy When I want to reproduce your issue, it looks "<" works but ")" cannot be parsed correctly in PS. Can you verify it?
I really agree with what @jaredmoo said, it is more related to PS and there is a little we can do. But I will add these specific letters scenario in CLI document here to make users know these cases and use cli more effectively.

@Juliehzl Tested again with following config, issue still completely valid. However it does not happen in cmd.exe.
Windows-10-10.0.17134-SP0
Python 3.6.6
Shell: powershell.exe
azure-cli 2.0.71 *

I disagree with you and @jaredmoo, as this hints at bad string handling inside your script, since this happens no mather what string quotation technique I use. Per powershell documentation (5.1 in my case):

When you enclose a string in single-quotation marks (a single-quoted string), the string is passed to the command exactly as you type it. No substitution is performed.

Moreover, mkdir "a)b" is completely valid and creates a folder named a)b and mkdir "a>b" fails with mkdir : Illegal characters in path..
This wouldn't be such a problem for me if it was not a password argument failing. It should accept any printable character. Invalidating <, ) and possibly other characters weakens password security.
The issue is also in that Web GUI version accepts those characters, so (as happened to me) someone could create the DB password in GUI and then I am unable to replicate this in automated CI/CD script.

Tested now with Azure Key Vault, so we can rule out the SQL:
az keyvault secret set --vault-name test-kv --name "test" --value "a)b"
b was unexpected at this time.

@hKaspy For me, ) still works now with azure-cli 2.0.74 as follows:

Can you try again? If you still have such problem, please let me know.

@Juliehzl Still an issue for me, < works and ) fails for both (keyvault, sql) commands.
PS C:\> az --version
azure-cli                         2.0.74

command-modules-nspkg              2.0.3
core                              2.0.74
nspkg                              3.0.4
telemetry                          1.0.3

...

Python (Windows) 3.6.6 (v3.6.6:4cf1f54eb7, Jun 27 2018, 02:47:15) [MSC v.1900 32 bit (Intel)]

@Juliehzl  please create a PS ticket and put it here, then we can close this issue.

Same issue for az postgres server create < and ) in pasword arg crashed prosess
powershell 5, az cli 2.0.76

Same issue for az postgres server create < and ) in pasword arg crashed prosess
powershell 5, az cli 2.0.76

Hi @ArgTang, it is a powershell issue. Could you use cmd to unblock yourself? Out of curiosity, ) doesn't work for you, right? Could you share more info about )  scenario with me? It works for me as follows again.

As @Juliehzl stated, this is a Windows PowerShell issue. We have updated CLI doc for explanation and workaround: https://github.com/Azure/azure-cli/blob/dev/doc/use_cli_effectively.md#argument-parsing-issue-in-powershell

@ArgTang please let us know if you need more help - otherwise we will proceed to close this issue.

@jeroenterheerdt no, i think we have a workaround. thanks

@jiasli please go ahead and close this.


Months not shortened correctly on exa when compiled using messense/rust-musl-cross

I think this issue where exa does not show the month August correctly may be because of it being compiled using messense/rust-musl-cross.
https://github.com/ogham/exa/issues/719

exa hardcoded it to August I think.
https://github.com/ogham/exa/blob/78ba0b8973cbfbb48b85b8beae6f7de412064d11/src/output/time.rs#L140

Ah okay, thanks. I thought it was the cross-compiler as it is only happening on the ARM build I am using. Seems fine on x86.


Fix Python 3.x compatibility

oauth2_client.py has some Python 2 syntax that is causing the module to fail when imported in Python 3.6 as referenced in issue #29 and #30. This is fixed by running 2to3 over oauth2_client.py and then correcting one things that 2to3 didn't catch — os.open expects a string for file mode rather than a unix mode octal.

I signed it!

Any idea when this may be merged/released?

+1 on merging/releasing

Any updates on the merge?

This module is now python 3 compatible, so this PR should be closed.

Just noticed we had a handful of PRs that never got triaged - apologies for letting this sit unactioned for so long :(
That being said, this module is indeed now PY3-compliant, so I'll go ahead and close this PR.


Try ripping out non-OBI axioms and merging in COB

OBI has a base file, but it inserts too many axioms for ontology ontologies. There are various historical reasons for these insertions that we could review one-by-one...
... or we could just rip the insertions out, merge in COB, RO core, and OMO, and see what we get. This should be relatively fast to do, so we should try it before setting out on a careful review.

This would also partially address #1718 . Any updates James? Any help needed?

We made some progress toward this in #1764


Make Algae.Maybe.new(nil) return a Nothing

Was this what you had in mind?
Can also write some more tests if you want me to ☺

Uh, a Maybe.new(...) returning anything but a valid non-Nothing value seems weird to me...  nil can be an entirely valid value to return, like the result of a computation that succeeded.

@icidasset because nil can represent an actual value in Elixir, Algae.Maybe.new(nil) should return Algae.Maybe.Just{just: nil}. However, if you wanted to add a function like Algae.Maybe.from_nillable/1 to distinguish nil -> Nothing for those that want it, that would work 👍

Thanks @expede ! I've implemented your idea.

Why not something more like this for new/2?
@spec new(err, [nothing: err]) :: Nothing.t(err)
@spec new(v, [nothing: err]) :: Just.t(v) when v != err

And adjust Just.t and Nothing.t as appropriate as well?  (I think that is the right syntax for named typing, might need to make new types though?)

@OvermindDL1 Yeah, the automagic type generation could use some work. At the time (way back in the .t days), I was unaware that you could embed types inside types.

Looks awesome @icidasset — thanks!


Update Composer dependencies (2021-02-12-00-11)

Visual regression test passed!
View the visual regression test report


chore: fix ci - permissions and semantic release

:tada: This PR is included in version 1.15.3-beta.1 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


Unbound cardinality of jira_request_duration_on_path_bucket

I'm seeing count(jira_request_duration_on_path_bucket) over 50000. It looks like each request is getting counted - even those for non-existend URLs. Some of the lowest-used buckets look like scanning for generic security issues: /ocportal, /%3F.jsp, /~root.
Would it be possible to only create buckets for URLs JIRA might actually use?

Yes. I will do it configurable.
пн, 14 Май 2018 г., 11:52 Tomasz Kontusz<EMAIL_ADDRESS>
I'm seeing count(jira_request_duration_on_path_bucket) over 50000. It
looks like each request is getting counted - even those for non-existend
URLs. Some of the lowest-used buckets look like scanning for generic
security issues: /ocportal, /%3F.jsp, /~root.
Would it be possible to only create buckets for URLs JIRA might actually
use?
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/AndreyVMarkelov/jira-prometheus-exporter/issues/27,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AB92cFQZwOIXHRHpEEkFJ98_IMlk4OEUks5tyVPagaJpZM4T9fAm
.

In progress now


Added MultipleReferences GenerateType

added new generate type for multiple references so a single object will not be serialized multiple times and deserialized into multiple objects

what is the diffrence with CircularReference?

It's for references that are not circular, but there are still multiple references. Very common in an  immutable data structure.

CircularReference works in that it allows objects to be tracked even if they are not Circular.
var list = new List<Item>();
var item = new Item(1, 10);

for (int i = 0; i < 100; i++)
{
    list.Add(item);
}

var bin = MemoryPackSerializer.Serialize(list);
var list2 = MemoryPackSerializer.Deserialize<List<Item>>(bin)!;

Console.WriteLine(list2.Distinct().Count()); // 1

[MemoryPackable(GenerateType.CircularReference)]
public partial class Item
{
    [MemoryPackOrder(0)]
    public int Id { get; private set; }
    [MemoryPackOrder(1)]
    public ulong Id2 { get; private set; }

    [MemoryPackConstructor]
    Item()
    {
    }

    public Item(int id, ulong id2)
    {
        Id = id;
        Id2 = id2;
    }
}

The "MultipleReference" option gives you the benefits of "Object" (no MemoryPackOrder) and "CircularReference" (reference handling) with reduced impact to existing code base.
"VersionTolerant" and "CircularReference" require the overhead of MemberPackOrder for any serialisable member property. "Object" does not. In a small project this cross-cutting concern is not a issue and would have a small change footprint. In a large immutable project we want the optional benefit of "Object", to automatically pick up public member properties for future development with low impact on the current code base, and also to handle multiple references of the same object within a serialisable memory state object so deserialising does not blow up the memory and decrease performance. "Object" generation type is only useful in small POCO single referenced model projects.

The other option would be not to enforce MemoryPackOrder attribute for the "CircularReference" generation type.

If you are concerned about forcing MemoryPackOrder, that is not a reason to add this feature.

So what if we remove the constraint of blank constructor?
Sorry, I actually don't remember why I put this constraint.
Perhaps there was some problem and I put the constraint in...

I think you needed the blank constructor for circular references because you would get a stack overflow in certain situations specifically related to circular references...
[MemoryPackable(GenerateType.CircularReference)]
public partial class Item
{
    [MemoryPackOrder(0)]
    public Item? Parent { get; }

    [MemoryPackOrder(1)]
    public IReadOnlyList<Item> Children { get; }

    [MemoryPackConstructor]
    public Item(Item? parent, IReadOnlyList<Item> children)
    {
        Parent = parent;
        Children = children;
    }
}

This would lead to an child item begin in the parent children list, so you could not construct parent and item without blank constructors and late build up. Probably not the best example as I have over simplified it. But something like this would require the restriction that circular reference rightly impose.

Thanks, that seems to be correct!
And I suppose this could happen with MultipleReferences as well?
(I would like to change the limitation of the CircularReference parameter to allow unamanged types.)

Yes, this could happen with MultipleReferences as well. Then you would have to use the OnSerializing/ed to inject something outside of the constructor, use the CircularReference type with the default/blank constructor or just be able to rebuild via the constructor and not pass the circular reference hierarchy object.

In other words, if add MultipleReferences, we need to add the same constraints as CircularReference, and then it makes little sense to add it.

If CircularReference does not require a blank constructor only, so it can support readonly properties set via a constructor, I would agree.


create codemeta file

We should create a codemeta.json file so that our citation metadata for Parsl is in one place and can be automatically used.
see https://codemeta.github.io/user-guide/

@cboettig pointed me to https://github.com/proycon/codemetapy which I will try to use

I've created https://github.com/Parsl/parsl/pull/449 with an initial codemeta.json file for this.
Either before or after it is merged, additional contributors should be added, matching those in contributors.md (see https://github.com/Parsl/parsl/issues/393)


Set Instance to synced iff it's in a permanent state

Issue #, if available: N/A. Instance would be set to Synced immediately after creation while it is still in 'pending' state. Because it's Synced, reconciliation ceases and the Instance state is never updated to 'running' (or any other permanent/terminal state).
Description of changes: Re-queue Instance if it is in a temporary state (pending, shutting-down, stopping) until a permanent state is achieved; update tests.
By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

/retest

Expecting e2e test failure

logs:

        # Ensure server-side state is propogated to the resource
        instance_cr = k8s.get_resource(ref)
>       assert instance_cr["status"]["state"]["name"] == "running"
E       AssertionError: assert 'pending' == 'running

the resource is getting to synced state, but its Status is not being updated properly

From local testing, I think the root cause may be with late initialization code. Discussing with @vijtrip2 offline to confirm


[Bug]: Videos Downloaded in Main Folder, Not in Playlist Subfolders (ytdlg GUI)

Contact Details
No response
What happened?
Hi,
What happened?
I downloaded a video playlist using the "ytdlg" GUI.
The downloaded videos were placed directly in the download location (Videolocation) that i specified, rather than being placed in a subfolder named after the playlist.
What I expected to happen
I expected that the downloaded videos will be placed within a subfolder named after the playlist title

i have the latest version of yt-dlp.
When i use this in Cmd it works fine :
Download YouTube playlist videos in separate directory indexed by video order in a playlist
$ yt-dlp -o "%(playlist)s/%(playlist_index)s - %(title)s.%(ext)s" "Youtube Playlist Url"
P.S. I don't have any experience with programming (Coding)
Version
<IP_ADDRESS> (Latest)
Relevant log output
No response
Code of Conduct

[X] I agree to follow this project's Code of Conduct

Send me the URl, i will try it out.

And install the latest yt-dlp (2024.03.10) before the next issue !
Because there are changed a lot.
So, how old is your problem, the world is turning.

https://github.com/unattended-ch/ytdlg/assets/140983966/aad3d8b0-cc5b-4e08-8aa8-b8f4c26f6503
i just started using the gui 2 days ago and creating a playlist subfolder never worked for me
i had the latest versions

Ok now i can see your problem.
In the selectbox you have the following text "(1 of 1) _Introduction_to..."
That means, you have 1 file of 1 existing file to download.
So this is not interpreted as a playlist, you need at least 2 files for a playlist.
For me it works as designed, i will close this issue.

https://www.youtube.com/playlist?list=PLTF9h-T1TcJgjGPoq4bYqiL1LLQGMh0tP
here is the playlist there clearly more than 1 video :)

Did you read my first answer ?

Send me the URl, i will try it out.

Ok now i have it, and you right there are 4 links.
With the information you gave me befor, i could only see 1 file.
I will fix it, as soon as pissible.
You will get an update message on startup for ytdlg if it's fixed.

I really appreciate you taking the time to help. Thanks !

I really appreciate you taking the time to help. Thank u !

I really appreciate you taking the time to help. Thank u !

Fixed with ytdlg v<IP_ADDRESS>


support multiple material for one link

this is rewrited version of #812 for indigo

I have rviz 1.11.19-0trusty-20180715-213359-080 and I still cannot use multiple materials per link if the first visual is a mesh (all subsequent primitive visuals are displayed in the same red collision elemets are displayed). Just reordering the mesh visual to be the last fixes that behavior.


Zombie producers shown as connected after a broker instance crashed

Describe the bug
A broker crash due to "out of memory" left zombie producers connected
Our setup:

k8s cluster
3 pulsar brokers
3 pulsar proxies
X Services publishing to the same topic using official CGo library

Steps to reproduce the behavior:
Force a OOM crash in a broker with connected producers, the producers connected to that broker are still listed as connected and have to be manually deleted
Note: this happened for multiple topics and different services
In our case producers tried to reconnect automatically to the cluster using the same producer name but received this error Failed to create producer: ProducerBusy.
Only a change in the producer name fixed the issue
As example for a single topic, the list of producers for it shows old instances with prefix 74966b7f75 yet only 5 instances producing messages are running in our k8s cluster
"publishers" : [ {
    "producerName" : "service-x-events-968974b58-7wwcm",
    "connectedSince" : "2020-06-02T07:09:08.453Z",
    "address" : "/<IP_ADDRESS>:57634"
  }, {
    "producerName" : "service-x-events-74966b7f75-x9cfq",
    "connectedSince" : "2020-06-01T20:32:21.863Z",
    "address" : "/<IP_ADDRESS>:49418"
  }, {
    "producerName" : "service-x-events-968974b58-8v679",
    "connectedSince" : "2020-06-02T04:56:23.638Z",
    "address" : "/<IP_ADDRESS>:59924"
  }, {
    "producerName" : "service-x-events-968974b58-99qpk",
    "connectedSince" : "2020-06-02T04:56:25.752Z",
    "address" : "/<IP_ADDRESS>:59920"
  }, {
    "producerName" : "service-x-events-74966b7f75-c6ljj",
    "connectedSince" : "2020-06-01T20:32:21.863Z",
    "address" : "/<IP_ADDRESS>:59820"
  }, {
    "producerName" : "service-x-events-74966b7f75-rvtjt",
    "connectedSince" : "2020-06-01T20:32:21.863Z",
    "address" : "/<IP_ADDRESS>:56450"
  }, {
    "producerName" : "service-x-events-968974b58-86p8p",
    "connectedSince" : "2020-06-02T04:00:07.853Z",
    "address" : "/<IP_ADDRESS>:52732"
  }, {
    "producerName" : "service-x-events-968974b58-9wp9m",
    "connectedSince" : "2020-06-02T07:05:30.878Z",
    "address" : "/<IP_ADDRESS>:57488"
  } ],

service-x-968974b58-99qpk	 Running	0	Jun 2, 2020, 3:57:07 AM
service-x-968974b58-86p8p	 Running	0	Jun 2, 2020, 3:57:07 AM
service-x-968974b58-8v679	 Running	0	Jun 2, 2020, 3:57:07 AM
service-x-968974b58-9wp9m	 Running	0	Jun 2, 2020, 7:00:26 AM
service-x-968974b58-7wwcm	 Running	0	Jun 2, 2020, 7:00:57 AM

Expected behavior
The old producers are removed after a broker crashes

@hmoragrega
A couple of questions:

which version of pulsar broker are you using?
how did you cause broker crash? one thing I don't understand in the description is if the broker was crashed, the JVM process should be gone. Are you using a different approach to force broker crash?

thanks for checking out:

We are running a docker image: apachepulsar/pulsar-all:2.5.1
The broker process was killed by k8s:

2020-06-01 20:31:26.000 UTC
Memory cgroup out of memory: Kill process 281696 (java) score 1862 or sacrifice child Killed process 281696 (java) total-vm:6202804kB, anon-rss:2484912kB, file-rss:24084kB, shmem-rss:0kB

2020-06-01 20:31:26.152 UTC
Killed process 281696 (java) total-vm:6202804kB, anon-rss:2484912kB, file-rss:24084kB, shmem-rss:0kB}] Conditions:[{Type:KernelDeadlock Status:False Transition:2020-05-10 23:28:18.17330381 +0000 UTC m=+5.104380376 Reason:KernelHasNoDeadlock Message:kernel has no deadlock} {Type:ReadonlyFilesystem Status:False Transition:2020-05-10 23:28:18.173304129 +0000 UTC m=+5.104380498 Reason:FilesystemIsNotReadOnly Message:Filesystem is not read-only}]}

I've checked the pulsar logs around the event but I haven't found any outstanding message, just the application being restarted
I 2020-06-01T20:31:19.772967095Z 20:31:19.772 [pulsar-client-io-42-1] INFO  org.apache.pulsar.client.impl.ConsumerImpl - [persistent://pulsar/pulsar/<IP_ADDRESS>:8080/healthcheck][reader-98d2f9bedb] Subscribed to topic on <IP_ADDRESS>/<IP_ADDRESS>:6650 -- consumer: 3380
I 2020-06-01T20:31:19.785581683Z 20:31:19.785 [pulsar-io-22-3] INFO  org.apache.pulsar.broker.service.ServerCnx - [PersistentTopic{topic=persistent://pulsar/pulsar/<IP_ADDRESS>:8080/healthcheck}][pulsar-20-3385] Closing producer on cnx /<IP_ADDRESS>:33968
I 2020-06-01T20:31:19.785694992Z 20:31:19.785 [pulsar-io-22-3] INFO  org.apache.pulsar.broker.service.ServerCnx - [PersistentTopic{topic=persistent://pulsar/pulsar/<IP_ADDRESS>:8080/healthcheck}][pulsar-20-3385] Closed producer on cnx /<IP_ADDRESS>:33968
I 2020-06-01T20:31:19.785802934Z 20:31:19.785 [pulsar-client-io-42-1] INFO  org.apache.pulsar.client.impl.ProducerImpl - [persistent://pulsar/pulsar/<IP_ADDRESS>:8080/healthcheck] [pulsar-20-3385] Closed Producer
I 2020-06-01T20:31:19.785898196Z 20:31:19.785 [pulsar-io-22-3] INFO  org.apache.pulsar.broker.service.ServerCnx - [/<IP_ADDRESS>:33968] Closing consumer: 3380
I 2020-06-01T20:31:19.786763101Z 20:31:19.786 [pulsar-io-22-3] INFO  org.apache.pulsar.broker.service.AbstractDispatcherSingleActiveConsumer - Removing consumer Consumer{subscription=PersistentSubscription{topic=persistent://pulsar/pulsar/<IP_ADDRESS>:8080/healthcheck, name=reader-98d2f9bedb}, consumerId=3380, consumerName=9574f, address=/<IP_ADDRESS>:33968}
I 2020-06-01T20:31:19.787468692Z 20:31:19.786 [pulsar-io-22-3] INFO  org.apache.pulsar.broker.service.persistent.PersistentSubscription - [persistent://pulsar/pulsar/<IP_ADDRESS>:8080/healthcheck][reader-98d2f9bedb] Successfully closed subscription [NonDurableCursorImpl{ledger=pulsar/pulsar/<IP_ADDRESS>:8080/persistent/healthcheck, ackPos=38739:397, readPos=38739:398}]
I 2020-06-01T20:31:19.787644898Z 20:31:19.787 [pulsar-io-22-3] INFO  org.apache.pulsar.broker.service.persistent.PersistentSubscription - [persistent://pulsar/pulsar/<IP_ADDRESS>:8080/healthcheck][reader-98d2f9bedb] Successfully closed dispatcher for reader
I 2020-06-01T20:31:19.787662374Z 20:31:19.787 [pulsar-external-listener-43-1] INFO  org.eclipse.jetty.server.RequestLog - <IP_ADDRESS> - - [01/Jun/2020:20:31:19 +0000] "GET /admin/v2/brokers/health HTTP/1.1" 200 2 "-" "curl/7.64.0" 26
I 2020-06-01T20:31:19.787773157Z 20:31:19.787 [pulsar-io-22-3] INFO  org.apache.pulsar.broker.service.ServerCnx - [/<IP_ADDRESS>:33968] Closed consumer Consumer{subscription=PersistentSubscription{topic=persistent://pulsar/pulsar/<IP_ADDRESS>:8080/healthcheck, name=reader-98d2f9bedb}, consumerId=3380, consumerName=9574f, address=/<IP_ADDRESS>:33968}
I 2020-06-01T20:31:19.787804660Z 20:31:19.787 [pulsar-client-io-42-1] INFO  org.apache.pulsar.client.impl.ConsumerImpl - [persistent://pulsar/pulsar/<IP_ADDRESS>:8080/healthcheck] [reader-98d2f9bedb] Closed consumer
I 2020-06-01T20:31:23.906091867Z 20:31:23.905 [pulsar-ordered-OrderedExecutor-3-0-EventThread] INFO  org.apache.pulsar.zookeeper.ZooKeeperDataCache - [State:CONNECTED Timeout:30000 sessionid:0x300369d33e0001b local:/<IP_ADDRESS>:33466 remoteserver:pulsar-zookeeper-2.pulsar-zookeeper/<IP_ADDRESS>:2181 lastZxid:25770466537 xid:107048 sent:107048 recv:124047 queuedpkts:0 pendingresp:0 queuedevents:0] Received ZooKeeper watch event: WatchedEvent state:SyncConnected type:NodeDataChanged path:/loadbalance/brokers/<IP_ADDRESS>:8080
I 2020-06-01T20:31:24.719776356Z 20:31:24.719 [pulsar-load-manager-3-1] INFO  org.apache.pulsar.broker.loadbalance.impl.ModularLoadManagerImpl - Writing local data to ZooKeeper because maximum change 11.40127182006836% exceeded threshold 10%; time since last report written is 5.0 seconds
I 2020-06-01T20:31:24.725426343Z 20:31:24.725 [pulsar-ordered-OrderedExecutor-3-0-EventThread] INFO  org.apache.pulsar.zookeeper.ZooKeeperDataCache - [State:CONNECTED Timeout:30000 sessionid:0x300369d33e0001b local:/<IP_ADDRESS>:33466 remoteserver:pulsar-zookeeper-2.pulsar-zookeeper/<IP_ADDRESS>:2181 lastZxid:25770466539 xid:107051 sent:107051 recv:124051 queuedpkts:0 pendingresp:0 queuedevents:0] Received ZooKeeper watch event: WatchedEvent state:SyncConnected type:NodeDataChanged path:/loadbalance/brokers/<IP_ADDRESS>:8080

// Restart

I 2020-06-01T20:31:27.095166566Z [conf/pulsar_env.sh] Applying config PULSAR_EXTRA_OPTS = -Dpulsar.log.root.level=info
I 2020-06-01T20:31:27.095312356Z [conf/pulsar_env.sh] Applying config PULSAR_GC = "-XX:+UseG1GC -XX:MaxGCPauseMillis=10"
I 2020-06-01T20:31:27.095324965Z [conf/pulsar_env.sh] Applying config PULSAR_MEM = "-Xms2g -Xmx2g -XX:MaxDirectMemorySize=2g -Dio.netty.leakDetectionLevel=disabled -Dio.netty.recycler.linkCapacity=1024 -XX:+ParallelRefProcEnabled -XX:+UnlockExperimentalVMOptions -XX:+AggressiveOpts -XX:+DoEscapeAnalysis -XX:ParallelGCThreads=32 -XX:ConcGCThreads=32 -XX:G1NewSizePercent=50 -XX:+DisableExplicitGC -XX:-ResizePLAB -XX:+ExitOnOutOfMemoryError -XX:+PerfDisableSharedMem"
I 2020-06-01T20:31:27.095333038Z [conf/broker.conf] Applying config advertisedAddress = <IP_ADDRESS>
...
I 2020-06-01T20:31:27.095428042Z [conf/broker.conf] Applying config zookeeperServers = pulsar-zookeeper-0.pulsar-zookeeper,pulsar-zookeeper-1.pulsar-zookeeper,pulsar-zookeeper-2.pulsar-zookeeper
I 2020-06-01T20:31:27.118097760Z [conf/pulsar_env.sh] Applying config PULSAR_EXTRA_OPTS = -Dpulsar.log.root.level=info
I 2020-06-01T20:31:27.118143135Z [conf/pulsar_env.sh] Applying config PULSAR_GC = "-XX:+UseG1GC -XX:MaxGCPauseMillis=10"
I 2020-06-01T20:31:27.118149618Z [conf/pulsar_env.sh] Applying config PULSAR_MEM = "-Xms2g -Xmx2g -XX:MaxDirectMemorySize=2g -Dio.netty.leakDetectionLevel=disabled -Dio.netty.recycler.linkCapacity=1024 -XX:+ParallelRefProcEnabled -XX:+UnlockExperimentalVMOptions -XX:+AggressiveOpts -XX:+DoEscapeAnalysis -XX:ParallelGCThreads=32 -XX:ConcGCThreads=32 -XX:G1NewSizePercent=50 -XX:+DisableExplicitGC -XX:-ResizePLAB -XX:+ExitOnOutOfMemoryError -XX:+PerfDisableSharedMem"
I 2020-06-01T20:31:27.118155877Z [conf/pulsar_env.sh] Applying config PULSAR_EXTRA_OPTS = -Dpulsar.log.root.level=info
I 2020-06-01T20:31:27.118160698Z [conf/pulsar_env.sh] Applying config PULSAR_GC = "-XX:+UseG1GC -XX:MaxGCPauseMillis=10"
I 2020-06-01T20:31:27.118165936Z [conf/pulsar_env.sh] Applying config PULSAR_MEM = "-Xms2g -Xmx2g -XX:MaxDirectMemorySize=2g -Dio.netty.leakDetectionLevel=disabled -Dio.netty.recycler.linkCapacity=1024 -XX:+ParallelRefProcEnabled -XX:+UnlockExperimentalVMOptions -XX:+AggressiveOpts -XX:+DoEscapeAnalysis -XX:ParallelGCThreads=32 -XX:ConcGCThreads=32 -XX:G1NewSizePercent=50 -XX:+DisableExplicitGC -XX:-ResizePLAB -XX:+ExitOnOutOfMemoryError -XX:+PerfDisableSharedMem"
I 2020-06-01T20:31:27.141939511Z [conf/pulsar_env.sh] Applying config PULSAR_EXTRA_OPTS = -Dpulsar.log.root.level=info
I 2020-06-01T20:31:27.141971873Z [conf/pulsar_env.sh] Applying config PULSAR_GC = "-XX:+UseG1GC -XX:MaxGCPauseMillis=10"
I 2020-06-01T20:31:27.142012430Z [conf/pulsar_env.sh] Applying config PULSAR_MEM = "-Xms2g -Xmx2g -XX:MaxDirectMemorySize=2g -Dio.netty.leakDetectionLevel=disabled -Dio.netty.recycler.linkCapacity=1024 -XX:+ParallelRefProcEnabled -XX:+UnlockExperimentalVMOptions -XX:+AggressiveOpts -XX:+DoEscapeAnalysis -XX:ParallelGCThreads=32 -XX:ConcGCThreads=32 -XX:G1NewSizePercent=50 -XX:+DisableExplicitGC -XX:-ResizePLAB -XX:+ExitOnOutOfMemoryError -XX:+PerfDisableSharedMem"
E 2020-06-01T20:31:27.934534415Z [AppClassLoader@18b4aac2] info AspectJ Weaver Version 1.9.2 built on Wednesday Oct 24, 2018 at 15:43:33 GMT
E 2020-06-01T20:31:27.934578455Z [AppClassLoader@18b4aac2] info register classloader sun.misc.Launcher$AppClassLoader@18b4aac2
E 2020-06-01T20:31:27.934621976Z [AppClassLoader@18b4aac2] info using configuration file:/pulsar/lib/org.apache.pulsar-pulsar-zookeeper-utils-2.5.1.jar!/META-INF/aop.xml
E 2020-06-01T20:31:27.934630474Z [AppClassLoader@18b4aac2] info using configuration file:/pulsar/lib/org.apache.pulsar-pulsar-zookeeper-2.5.1.jar!/META-INF/aop.xml
E 2020-06-01T20:31:27.940125061Z [AppClassLoader@18b4aac2] info register aspect org.apache.pulsar.broker.zookeeper.aspectj.ClientCnxnAspect
E 2020-06-01T20:31:28.218736757Z [AppClassLoader@18b4aac2] info register aspect org.apache.pulsar.zookeeper.FinalRequestProcessorAspect
E 2020-06-01T20:31:28.223107367Z [AppClassLoader@18b4aac2] info register aspect org.apache.pulsar.zookeeper.ZooKeeperServerAspect
I 2020-06-01T20:31:30.492087527Z 20:31:30.488 [main] INFO  org.apache.pulsar.broker.PulsarService - Starting Pulsar Broker service; version: '2.5.1'
I 2020-06-01T20:31:30.494428749Z 20:31:30.494 [main] INFO  org.apache.pulsar.broker.PulsarService - Git Revision c36170c3acc0bd432036baf7d9471a4c34320395
I 2020-06-01T20:31:30.494766089Z 20:31:30.494 [main] INFO  org.apache.pulsar.broker.PulsarService - Built by guangning<EMAIL_ADDRESS>on ubuntu-s-4vcpu-8gb-sfo1-01 at 2020-04-15T08:53:35+0000

Also happened to us after a broker restart: https://github.com/apache/pulsar/issues/7059#issuecomment-648041771. Producer could not reconnect.
Pulsar broker version: 2.5.2
Pulsar producer version: 2.5.2

Closed as stale. Please create a new issue if it's still relevant to the maintained versions.


Xbox achievements stop being able to be refreshed

The way Xbox achievements are pulled/refreshed is bugged I believe.
When a game is first added, the plugin works fine and the list of achievements is pulled. Then, for a while the achievements get refreshed when quitting a game or when I manually refresh achievements. However, with basically every game, this stops working at some point. Quitting a game then doesn't pull the newly unlocked achievements, nor does manually refreshing.
The only fix is to remove the game from Playnite and then add them again via the Xbox library update. This only happens with Xbox titles (GamePass in this case, if it is relevant).
However, doing this fix also means the data for the Game Activity plugin is removed, which is a bummer, and it's just inconvenient overall.
Attached you will find the extension log, with the final entry being of me refreshing the achievements without success.
extensions.log
Thanks in advance!

Can you try with the last release?


🚀 Release  1.7.3

:robot: I have created a release beep boop
1.7.3 (2022-05-19)
🚨 Bug Fixes

fonts not correctly applied to all elements (498bb6c)

This PR was generated with Release Please. See documentation.

:robot: Release is at https://github.com/carlosdevpereira/mr-components/releases/tag/v1.7.3 :sunflower:


Composable driver model

Make it so a gateway can run multiple drivers, and compose them through pipelining in a particular order.

Actually, don't worry about this.  As long as each gateway can load one driver, the driver implementer can implement some notion of pipelining multiple "sub-drivers" together.


Use Py-boost in LightAutoML

❓ Questions and Help
Before asking:

search the issues.
search the docs.

What is your question?
Per your introduction video 5.1 [New LightAutoML functionality[(5.1 New LightAutoML functionality from 7 months ago, LightAutoML is now supporting py-boost.  I'd like to give py-boost a try but I am unable to find any documentation on this feature.  So what is the status?  Is it support or not?  Where can I find more details?
Code

What have you tried?
Search of "py-boost", "pyboost", "sketch" return zero results from both Github and Read.
Additional context

Hello @numomcmc, thanks for your interest in py-boost library.  It is separated from LighAutoML, you can check it here

Hi Anton
Well, it was mentioned in the "New LightAutoML functionality" video!
😅   I guess the team decided not to incorporate it into LAMA.  Kind of a
shame, it would have been great to have CatBoost, LightGBM and Py-Boost all
supported in LAMA.  I guess Py-boost is not getting the traction...
Thank you for your reply!
S
On Mon, Mar 4, 2024 at 7:52 AM Anton Vakhrushev @.***>
wrote:

Hello @numomcmc https://github.com/numomcmc, thanks for your interest
in py-boost library. It is separated from LighAutoML, you can check it
here https://github.com/sb-ai-lab/Py-Boost
—
Reply to this email directly, view it on GitHub
https://github.com/sb-ai-lab/LightAutoML/issues/150#issuecomment-1976898741,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AX6JLHMYJWK576JTJGMINDLYWSKFFAVCNFSM6AAAAABEFINCD6VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTSNZWHA4TQNZUGE
.
You are receiving this because you were mentioned.Message ID:
@.***>


Errors with BS4

After upgrading to bootstap 4 I am working through a few new issues.  When I click on the x-editable link the popup appears, but with no content.  And, the following error appears in the console.  Have you experienced this, will there be a BS4 version of this gem?
TypeError: undefined is not an object (evaluating 'this.tip().addClass')
This error occurs when using editable/bootstrap-editable.  If I use 'jqueryui-editable' I get a different error:  TypeError: undefined is not an object (evaluating 'this.container()._off')
Environment: Rails 5.0.0, x-editable-rails version 1.5.5, jquery-ui-rails -v 5.0.5,  jquery-rails -v 4.1.1.  Bootstrap -v 4.0.0.alpha3.
thanks

X-editable is not under active development and bootstrap 4 is still in alpha stage. Currently it supports bootstrap v2 and v3 and honestly I don't expect it is gonna change. Sorry to say

Please refer to x-editable in regards to bootstrap 4

@atstockland this fix works for me https://github.com/vitalets/x-editable/issues/950.

Yeah, I did it ;)
I made some improvements and now it's working perfectly
(you'll might need to change your CSS)
https://gist.github.com/EdnaldoNeimeg/c7279ccade22d590ad89f4e0fe456742


Create CODE_OF_CONDUCT.md

Coverage remained the same at 100.0% when pulling fdce2d0f01816ab81754f12e778467f46e6729d9 on add-code-of-conduct-1 into 76fc25f33b1a492a2d21d544df7bed0fcaa58b8e on master.

Codecov Report

Merging #148 into master will not change coverage.
The diff coverage is n/a.


[UBS-user page. 'Замовлення' tab] 'Отримувач' is displayed in the order instead of 'Відправник'

Environment: all browsers
Reproducible: always
Build found: 17.11.2021
Preconditions

The user should have made order

Steps to reproduce

Go to https://ita-social-projects.github.io/GreenCityClient/#/
Open "Замовлення" tab in the personal UBS-user cabinet
Click on expanding icon of the order (order from precondition )
Verify 'Відправник' field

Actual result
Title is 'Отримувач'
Expected result
Title is 'Відправник'
User story and test case links
E.g.: "User story #3478

Verified - done


Request to multi-target EntityFramework6.csproj and include net6.0

We have a code base in net6.0 (migrated from net framework 4.8) but still use Entity Framework v6.
We were hoping to use the Specification nuget to update some sections of code, but noticed that Ardalis.Specification.EntityFramework6.csproj only targets framework 4.7.2
EF6 targets NetStandard2.1 so there shouldn't be a reason the Ardalis.Specification.EntityFramework6.csproj can't also target net6.0
The only issue would be AsAsyncEnumerable() would have to throw a NotImplementedException() or NotSupportedException() for the RepositoryBaseOfT EF6 implementation, eg
#if NET6_0_OR_GREATER
    /// <summary>
    /// Finds all entities of <typeparamref name="T" />, that matches the encapsulated query logic of the
    /// <paramref name="specification"/>, from the database.
    /// </summary>
    /// <param name="specification">The encapsulated query logic.</param>
    /// <returns>
    ///  Returns an IAsyncEnumerable<T> which can be enumerated asynchronously.
    /// </returns>
    public virtual IAsyncEnumerable<T> AsAsyncEnumerable(ISpecification<T> specification)
    {
      throw new NotImplementedException();
    }
#endif

However, it still allows others to override it and implement their own version of it if they so desire. eg something like https://github.com/dotnet/reactive/blob/main/Ix.NET/Source/System.Linq.Async/System/Linq/Operators/ToAsyncEnumerable.cs

Hi @mpickers,
We might do this. There is no need to throw an exception, that method won't exist at all in the EF6 package. It will reference the netstandard2.0 TFM of Ardalis.Specification, and we have excluded this method in the interface for this TFM.
#if NET6_0_OR_GREATER
  IAsyncEnumerable<T> AsAsyncEnumerable(ISpecification<T> specification);
#endif

Probably we can do this change for the next release. We just have to think once again whether we're breaking any consumer.

Hey @mpickers,
We can't target netstandard2.1. Consumers will face runtime issues. For instance, if you consume the libraries from .NET6, and you have the following code (which you must have actually), then you'll face a peculiar issue. Since the base package targets .NET6  the AsAsyncEnumerable method in the interface will be enabled. On the other hand, the EF6 package compiled in .netstandard2.1 won't see it and the repo implementation will compile without it. Hence on runtime, you'll get an exception.
public class Repository<T> : RepositoryBase<T> where T : class
{
    public Repository(TestDbContext dbContext) : base(dbContext)
    {
    }
}

Anyway, we can target NET6 for EF6 package. In that case, indeed we have to throw NotImplementedException.
Are you ok with this?

@fiseni Yes, that would be perfect, thanks. I suggested targeting net6. The netstandard2.1 comment was just stating that EF6 was "able" to be used by net6 projects.


Issue #1389 fixed in parser_compute_indicies by resolving local variable hiding.

Issue #1389 fixed in parser_compute_inicies by resolving local variable hiding.
JerryScript-DCO-1.0-Signed-off-by: István Kádár<EMAIL_ADDRESS>

LGTM

LGTM


[Enhancement] A major update to the FOSSCU-Blog

The current blog page of FOSSCU looks too simple. We can possibly change the whole UI to fit more with our theme [Green + White/Black].
I suggest that we redo the whole site using Wagtail.
Why Wagtail?
It is a Content Management System (CMS), made for something like a blog site. Moreover, it's based on django, so the ease in development.
Also it has better UI for admin interface.
Admin login page:

This kind of system will allow bloggers to easily login and manage their blogs.
Dashboard:

Page management:

User management:

If you see this as a sound suggestion then please assign me this issue.

have different plans


doc: fix some errors

I've been seeing these cause errors on the more recent versions of
Doxygen which come with Arch Linux for a while now. Fix these:
error: Illegal format for option TCL_SUBST, no equal sign ('=') specified for item 'YES'
$ZEPHYR_BASE/tests/kernel/mem_protect/futex/src/main.c:461: warning: end of file with unbalanced grouping commands
Just trying to get them out of my local output and as preparation for
whenever they start showing up for Ubuntu.

Do we need to follow gitlint here? It's complaining about lines that are a copy/paste of the errors.


Ten times slower than gzip?

I performed a few benchmarks to see how much faster lz4 would be compared to gzip when decompressing an incoming HTTP payload. I'm not sure if I'm doing something wrong, but it seems that this library is a lot slower than just using plain gzip.
I had 3 test JSON docs of different sizes, that I compressed with both LZ4 and gzip:

Uncompressed
LZ4
gzip

7,369 bytes
3,975 bytes
2,772 bytes

73,723 bytes
33,028 bytes
21,790 bytes

716,995 bytes
311,365 bytes
202,697 bytes

The LZ4 version was compressed using default options:
uncompressed.pipe(lz4.createEncoderStream()).pipe(compressed)

The gzip version was compressed from my macOS command line:
gzip uncompressed.json

I used autocannon to hammer a test HTTP server with the compressed document. The server would decompress the payload but otherwise discard it afterwards.
Here's an example of how autocannon was configured:
autocannon -i body.json.lz4 -H 'Content-Encoding: lz4' localhost:3000

And here's my test server running on localhost:

'use strict'

const http = require('http')
const zlib = require('zlib')
const lz4 = require('lz4')

const server = http.createServer(function (req, res) {
  const enc = req.headers['content-encoding'] || ''

  let decompressed
  if (/\bgzip\b/.test(enc)) {
    decompressed = req.pipe(zlib.createGunzip())
  } else if (/\blz4\b/.test(enc)) {
    decompressed = req.pipe(lz4.createDecoderStream())
  } else {
    decompressed = req
  }

  const buffers = []
  decompressed.on('data', buffers.push.bind(buffers))
  decompressed.on('end', function () {
    const data = Buffer.concat(buffers)
    res.end()
  })
})

server.listen(3000, function () {
  console.log('Server listening on http://localhost:3000')
})

Test 1 - Decompressing a 7,369 byte JSON document
LZ4 (3,975 bytes):
Stat         Avg     Stdev   Max
Latency (ms) 23.29   9.31    61.38
Req/Sec      419.7   13.36   434
Bytes/Sec    41.4 kB 1.31 kB 43 kB

4k requests in 10s, 416 kB read

Gzip (2,772 bytes):
Stat         Avg    Stdev   Max
Latency (ms) 1.07   0.67    13.48
Req/Sec      7064.4 704.93  7733
Bytes/Sec    699 kB 67.8 kB 766 kB

71k requests in 10s, 6.99 MB read

Test 2 - Decompressing a 73,723 byte JSON document
LZ4 (33,028 bytes):
Stat         Avg     Stdev  Max
Latency (ms) 23.28   8.94   55.9
Req/Sec      419.8   11.45  435
Bytes/Sec    41.8 kB 1.1 kB 43.1 kB

4k requests in 10s, 416 kB read

Gzip (21,790 bytes):
Stat         Avg    Stdev   Max
Latency (ms) 2.7    1.61    21.23
Req/Sec      3131   105.16  3342
Bytes/Sec    313 kB 13.1 kB 331 kB

31k requests in 10s, 3.1 MB read

Test 3 - Decompressing a 716,995 byte JSON document
On a large document like this the difference between gzip and lz4 is much smaller, but gzip still wins:
LZ4 (311,365 bytes):
Stat         Avg     Stdev Max
Latency (ms) 41.56   13.21 102
Req/Sec      237.6   6.95  250
Bytes/Sec    23.7 kB 819 B 24.8 kB

2k requests in 10s, 235 kB read

Gzip (202,697 bytes):
Stat         Avg     Stdev Max
Latency (ms) 26.11   6.51  137.09
Req/Sec      375.4   7.61  381
Bytes/Sec    37.5 kB 819 B 37.7 kB

4k requests in 10s, 372 kB read

I'm seeing a big difference between node and the browser for a 17mb text. 16s in browser vs 6.5 in NodeJs 10

The browser implementation uses pure JS to decode/encode, whereas the node one binds to the C implementation.


Terraform files should have 3 control servers by default

Consul and ZK need 3 to be able to have maintenance done and still maintain quorum.

fixed by #628


Star lists are rendered as italics

Describe the bug
Star lists (or whatever they're called; <ul>s defined with * instead of -) in quotes are previewed as italics. They still render as bullet lists, so the issue is with the editor.
To Reproduce
> * One (this point is italic)
> * Two
> * Three

This is italic, and because of a lack of termination (#21), everything after is italic

<!-- * but a comment terminates the italic -->

Regular text

Rendered output + demo
Expected behavior
No italics
Screenshots

Desktop (please complete the following information):

OS: Linux Mint 20.2
Browser: Firefox
Version: 95.0.1

Smartphone (please complete the following information):
(Not tested, this issue presumably stems from the same cause as #21)

@b-kelly I cant repro any longer on the linked meta issue. FixeD?

This issue is also covered under #21, so I'm closing this issue to keep everything tidy.


Make pytest auto-selector fail on unknown site, rather than trivially passing

The current behaviour is when site cannot be identified, to instead pick a configuration
that runs on the localhost, without being particularly clear that a site-specific
configuration is not being used.
This can lead to false test passes.
This change forces users to see that a site-specific configuration has not been
selected, rather than giving them a false test pass.
Type of change

New feature (non-breaking change that adds functionality)

this exposes behaviour where site_tests/test_site.py runs in --config local mode, which is probably not the right place to be running this test: either it should run as a specified config (which might happen to be the site selector, or might not) or it should run with a config that can run locally.


Reinstate Flexible/Term time/Job share working patterns

The service will allow again these working pattern options that were previously removed.
Trello card URL

https://trello.com/c/pxMTY1Gz

Changes in this PR:
It restores 3 working patterns that were previously removed from the service:

Flexible
Term time
Job share

Extra: We are deleting a one-off rake task built to upgrade legacy working patterns from existing subscriptions. Since we are restoring those working patterns, the task is not valid anymore.
Previous related work:

https://github.com/DFE-Digital/teaching-vacancies/pull/6200
https://github.com/DFE-Digital/teaching-vacancies/pull/6217
https://github.com/DFE-Digital/teaching-vacancies/pull/6218
https://github.com/DFE-Digital/teaching-vacancies/pull/6262

Screenshots of UI changes:

Job alert

Converting it back to draft as we need to extend the scope of the PR.


Clean the try ... finally ... blocks in the GpuFileFormatDataWriter

Signed-off-by: remzi<EMAIL_ADDRESS>Close #6615.
Changes in the PR

Replace
var v = null
try {
  v = some_value
  // do something with v
  v.close()
  v = null
} finally {
  if (v != null) {
    v.close()
  }
}

with
withResource(some_value) { v =>
  // do something with v
}

We find that the ParquetWriteSuite doesn't cover all the code branches. So to add more cases to test the impact MaxRecordsPerFile in that suite.

build

build

build

build

build

build

build

build

build

Hi, @jlowe, I prefer to drop this PR as it seems like the withReousrce can't make the code cleaner in this context. What's your opinion.

@HaoYang670 this should be moved to 23.02 as it doesn't make sense to put this into 22.12 at this point in its release cycle.

this should be moved to 23.02

My apologies, that's already occurred.


Failed to fetch error after adding new hub

The add on stops and screen shows this error.

Can you add the addon logs?

Can you add the addon logs?

2024-10-28T09:43:02.521Z ] [ INFO  ] [ matter.js / Node                         ]: 0a64012c45bd40a9b1e57dbabb680faa going online
[ 2024-10-28T09:43:02.555Z ] [ ERROR ] [ matter.js / Logger                       ]: Unhandled error detected: Cannot read properties of undefined (reading 'attributes')
at new BinarySensorDevice (file:///usr/local/lib/node_modules/home-assistant-matter-hub/dist/backend/cli.js:1889:49)
at binary_sensor (file:///usr/local/lib/node_modules/home-assistant-matter-hub/dist/backend/cli.js:2668:32)
at createDevice (file:///usr/local/lib/node_modules/home-assistant-matter-hub/dist/backend/cli.js:2644:10)
at Bridge.createDevices (file:///usr/local/lib/node_modules/home-assistant-matter-hub/dist/backend/cli.js:2737:26)
at Bridge.start (file:///usr/local/lib/node_modules/home-assistant-matter-hub/dist/backend/cli.js:2729:20)
at async BridgeService.create (file:///usr/local/lib/node_modules/home-assistant-matter-hub/dist/backend/cli.js:2826:9)
at async file:///usr/local/lib/node_modules/home-assistant-matter-hub/dist/backend/cli.js:698:24
file:///usr/local/lib/node_modules/home-assistant-matter-hub/dist/backend/cli.js:1889
const deviceClass = entity.initialState.attributes.device_class;
^
TypeError: Cannot read properties of undefined (reading 'attributes')
at new BinarySensorDevice (file:///usr/local/lib/node_modules/home-assistant-matter-hub/dist/backend/cli.js:1889:49)
at binary_sensor (file:///usr/local/lib/node_modules/home-assistant-matter-hub/dist/backend/cli.js:2668:32)
at createDevice (file:///usr/local/lib/node_modules/home-assistant-matter-hub/dist/backend/cli.js:2644:10)
at Bridge.createDevices (file:///usr/local/lib/node_modules/home-assistant-matter-hub/dist/backend/cli.js:2737:26)
at Bridge.start (file:///usr/local/lib/node_modules/home-assistant-matter-hub/dist/backend/cli.js:2729:20)
at async BridgeService.create (file:///usr/local/lib/node_modules/home-assistant-matter-hub/dist/backend/cli.js:2826:9)
at async file:///usr/local/lib/node_modules/home-assistant-matter-hub/dist/backend/cli.js:698:24
Node.js v18.20.4
s6-rc: info: service legacy-services: stopping
s6-rc: info: service legacy-services successfully stopped
s6-rc: info: service legacy-cont-init: stopping
s6-rc: info: service legacy-cont-init successfully stopped
s6-rc: info: service fix-attrs: stopping
s6-rc: info: service base-addon-log-level: stopping
s6-rc: info: service fix-attrs successfully stopped
s6-rc: info: service base-addon-log-level successfully stopped
s6-rc: info: service base-addon-banner: stopping
s6-rc: info: service base-addon-banner successfully stopped
s6-rc: info: service s6rc-oneshot-runner: stopping
s6-rc: info: service s6rc-oneshot-runner successfully stopped

Thank you! This is a duplicate of #11


Create a devcontainer feature to simplify install

devcontainers supports a feature specification, that simplifies adding something to a devcontainer base image (and removes the need for custom base images). More info on the background and philosophy can be found here.
Presently there is a devcontainer for SWA CLI, but it might be better to ship as a feature.
https://github.com/devcontainers/feature-starter contains a starter template for creating it (and its tests).

Sounds like a great addition to SWA_CLI @aaronpowell, we will add this to our backlog items.
cc: @Reshmi-Sriram

Presently there is a devcontainer for SWA CLI, but it might be better to ship as a feature.

Just to add a precision here, there are currently two container images including the SWA CLI:

A standalone container published on Docker Hub: https://hub.docker.com/r/swacli/static-web-apps-cli
=> This one allows to use the CLI without a local Node.js environment, using only Docker
The Static Web Apps devcontainer: https://github.com/microsoft/vscode-dev-containers/tree/main/containers/azure-static-web-apps
=> This one is a full self-contained dev environment for SWA (not just the CLI) with Node, Python and Dotnet installed, along Azure and SWA CLI.

Both these images have their use cases, and while I agree adding a devcontainer feature would be a nice addition, it won't replace any of these existing solutions but rather comes as an additional option for people using dev containers (and the SWA devcontainer should then be updated to make use of it).


Security concern

Hey there!
I belong to an open source security research community, and a member (@w-henderson) has found an issue, but doesn’t know the best way to disclose it.
If not a hassle, might you kindly add a SECURITY.md file with an email, or another contact method? GitHub recommends this best practice to ensure security issues are responsibly disclosed, and it would serve as a simple instruction for security researchers in the future.
Thank you for your consideration, and I look forward to hearing from you!
(cc @huntr-helper)

Hi
SECURITY.md created. You can send me email.
Thanks!

I have published new version to fixed it.

@chrislearn - thanks for your time and contributions! 👍


ReFT在Openai大放异彩，请问有计划支持ReFT吗？

Reminder

[X] I have read the README and searched the existing issues.

System Info
无
Reproduction
无
Expected behavior
No response
Others
No response

无


Reminder emails should have appropriate reply addresses

People keep replying to<EMAIL_ADDRESS>or whatever.
Review various emails sent by the system and come up with suitable reply-tos, and set any without any suitable ones to a NOREPLY address.
Originally created by Tom Smyth at 2019-02-12 17:10, migrated from redmine-#9389

Tracker changed from Bug to Feature

By Tom Smyth at 2019-04-24 12:37


adminbro.com UI

Hello;
The URL address of the Role Based Access Control box was incorrect and Slack link is no longer active.
Screenshots

This should be resolved soon, a new landing page is being developed


Raster.crop() does not work properly

Describe the bug
If I'm not mistaken, Raster.crop() does not crop the file in a way that is expected.
To Reproduce
Steps to reproduce the behavior:
In [1]: import geoutils as gu

In [2]: large_img = gu.Raster(gu.datasets.get_path("landsat_B4"))

In [4]: small_img = gu.Raster(gu.datasets.get_path("landsat_B4_crop"))

In [5]: large_img.shape, small_img.shape
Out[5]: ((655, 800), (174, 726))

In [6]: large_img.data.shape, small_img.data.shape
Out[6]: ((1, 655, 800), (1, 174, 726))

In [7]: large_img.crop(small_img)

In [8]: large_img.shape, small_img.shape
Out[8]: ((174, 598), (174, 726))

In [9]: large_img.data.shape, small_img.data.shape
Out[9]: ((1, 174, 598), (1, 174, 726))

Expected behavior
large_img and small_img should have the same shape after crop() is called.
System (please complete the following information):

OS: irrelevant
Environment conda

Uuugh! Turns out the cropped Landsat image's bounds are larger eastward than the uncropped version! That's why the shapes become different!!
Then there's a question of if crop() should pad the data to fit another raster in the same grid, or if the current implementation is what we want? What do you think, @adehecq and @atedstone?

Uuugh! Turns out the cropped Landsat image's bounds are larger eastward than the uncropped version! That's why the shapes become different!!

Damn! This should be a bug. I'll add it to the list.

Then there's a question of if crop() should pad the data to fit another raster in the same grid, or if the current implementation is what we want? What do you think, @adehecq and @atedstone?

I think an option to add padding could be useful in some cases yes.


clue/datagram is Deprecated

Hi,
I've done the modification to use the library with React/datagram instead of clue/datagram because it is deprecated and I can't download yesterday.
I will commit my modifications.

Feel free to open a Pull Request with your modifications, it's greatly appreciated!

Thanks !


Fix encodedfiles

Fixes the encoded files, signed with a wrong password.
Please @FPerezP could you review? Thanks

Looks good!


Merge input seq starters

Can I merge start_virtual_output_seq and start_output_seq?

Note: both start_virtual_output_seq and start_output_seq are not directly related to seq, instead calling its parts.
They both call:

snd_midi_event_new
snd_midi_event_init

Virtual mode calls snd_seq_create_simple_port
Normal mode: does a memory allocation by calling malloc for amidi_data->buffer


SALodLights.ini - StaticSunSize always enabled

Even if parameter "Enable" in "[DrawDistanceChanger]" is disabled.

Well, of course, because it's not directly related to it. Set StaticSunSize to 0.0 and it will be disabled.

Ok. Thanks!

No problem.


adding chron job

bundle exec whenever -i redmine_activity_report -f plugins/redmine_activity_report/config/schedule.rb
I'm getting this error below
/var/lib/gems/2.1.0/gems/bundler-1.10.6/lib/bundler/rubygems_integration.rb:292:in block in replace_gem': whenever is not part of the bundle. Add it to Gemfile. (Gem::LoadError)         from /usr/local/bin/whenever:22:in '

nevermind.  figured it out.
first whenever doesn't install automatically...must do it manually
then must add it to the gemfile manuall echo "gem 'whenever'" >> Gemfile
then run the command from the redmine directory
it works

Why whenever have not added to plugin's  Gemfile?

Because of the conflict with other plugins. If multiple plugins have the same gem in Gemfile it raises errors. You can add this gem to Gemfile.local at the root of Redmine and run 'bundle install' from the root of Redmine.


Bump k8s.io/client-go to v0.28.2

What this PR does / why we need it:
Bump k8s.io/client-go to v0.28.2

/ok-to-test

Pull Request Test Coverage Report for Build<PHONE_NUMBER>

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 61.992%

Totals

Change from base Build<PHONE_NUMBER>:
0.0%

Covered Lines:
946

Relevant Lines:
1526

💛  - Coveralls

LGTM in general. One question - do we want to bump everything to v0.28.3? I think it fixes the http2 CVE.

LGTM in general. One question - do we want to bump everything to v0.28.3? I think it fixes the http2 CVE.

 Weird, I thought make modules ran go mod tidy already.

/approve

/lgtm


Publish new version to bower

It would be great to have a new version published to bower as there are a few updates (specifically the refresh update from January) that I would like to use but I would rather not point at master and instead use a solidified version.

Updated to 0.1.7


text not visible

text not visible anymore

Hi.

Please, sort fixes in alphabetical order by URL.
"removebg": "*" will do exactly the same, "rules" should be used as a last resort.
If possible, try to remove background for exact elements, not the whole page. Your rule can remove background color and images where you do not expect.

The config file was simplified, now it is here https://github.com/alexanderby/darkreader/blob/master/src/config/inversion-fixes.config
You should use REMOVE BG rule in this case.

A year has passed, fronter.com looks OK.


Add missing import / export diagnostics

There are a few missing diagnostics for some things related to imports/exports

export in invalid location
exporting same name
Some others that have todo! in features/modules.rs

Would be good to get these wired up similar to other diagnostics

Some of these might be built into the parser at some point

Hi, @kaleidawave! I took a stab at this in #192, but could use some direction as I'm still learning the codebase.


[BUG] Requests sent over a re-used TCP connection fail to appear in distributed traces

Search before asking

[X] I had searched in the issues and found no similar feature requirement.

DeepFlow Component
Agent
What you expected to happen
Based on the conversation here: https://discord.com/channels/1069828209773907978/1069828210419838998/1238030162902384711 Deepflow should be able to trace requests through a re-used tcp connection.
Based on my experiments, I can't get it to do this.
There's a full write up on expected behaviour here: https://github.com/metoro-io/metoro-observability/tree/bd0f0bcbfc6ffe960efee9ad5c796fa0f47215b0/test/demos/python_microservices
(Copying it out)
Poller -> MicroServiceA -> MicroServiceB -> MicroServiceC
Deepflow is able to trace the calls when TCP reuse is disabled, but when it is enabled, the calls are not traced.
By default, the TCP reuse is enabled, to disable it, you can set the environment variable REUSE_SESSION to false when running the services.
To run the example with TCP reuse disabled (deepflow working), run the following:
kubectl apply -f manfest.yaml

Example correct trace:

To run the example with TCP reuse enabled between microservice-b and microservice-c (deepflow not working), run the following:
kubectl apply -f manifest_tcp_reuse_enabled_microservice_b_to_c.yaml

Example broken trace:

(connection between microservice b and c not connected)

How to reproduce
https://github.com/metoro-io/metoro-observability/tree/bd0f0bcbfc6ffe960efee9ad5c796fa0f47215b0/test/demos/python_microservices Contains a readme with a full example of expected behaviour, actual behaviour and how to reproduce
DeepFlow version
❯ kubectl exec -it -n deepflow deploy/deepflow-server -- deepflow-server -v
2024/05/09 18:05:08 ENV K8S_NODE_NAME_FOR_DEEPFLOW=ip-192-168-45-4.ec2.internal; K8S_NODE_IP_FOR_DEEPFLOW=<IP_ADDRESS>; K8S_POD_NAME_FOR_DEEPFLOW=deepflow-server-df8fc969b-cjs25; K8S_POD_IP_FOR_DEEPFLOW=<IP_ADDRESS>; K8S_NAMESPACE_FOR_DEEPFLOW=deepflow
Name: deepflow-server community edition
Branch: v6.4
CommitID: 0f9bbc168169c38383478e4fdba7046222e0bc6f
RevCount: 9835
Compiler: go version go1.20.14 linux/amd64
CompileTime: 2024-05-07 13:35:47

❯ kubectl exec -it -n deepflow ds/deepflow-agent -- deepflow-agent -v
Defaulted container "deepflow-agent" out of: deepflow-agent, configure-sysctl (init)
9841-dc64a85d47b1d2bad284dfff6cbd4855f8005b23
Name: deepflow-agent community edition
Branch: v6.4
CommitId: dc64a85d47b1d2bad284dfff6cbd4855f8005b23
RevCount: 9841
Compiler: rustc 1.75.0 (82e1608df 2023-12-21)
CompileTime: 2024-05-09 11:07:14

DeepFlow agent list
[root@ip-192-168-45-4 ec2-user]# deepflow-ctl agent list
ID   NAME                                TYPE     CTRL_IP          CTRL_MAC            STATE    GROUP     EXCEPTIONS   REVISION      UPGRADE_REVISION
1    ip-192-168-27-188.ec2.internal-V2   K8S_VM   <IP_ADDRESS>   0a:ff:c5:54:55:e9   NORMAL   default                v6.4.9 9588
2    ip-192-168-45-4.ec2.internal-V1     K8S_VM   <IP_ADDRESS>     0e:d9:f9:b9:52:13   NORMAL   default                v6.4.9 9588

Kubernetes CNI
Amazon VPC CNI (It's an EKS cluster)
Operation-System/Kernel version
sh-4.2$ awk -F '=' '/PRETTY_NAME/ { print $2 }' /etc/os-release
"Amazon Linux 2"

sh-4.2$ uname -r
5.10.209-198.858.amzn2.x86_64

Anything else
This happens every time for me, reproducibly.
Are you willing to submit a PR?

[X] Yes I am willing to submit a PR!

Code of Conduct

[X] I agree to follow this project's Code of Conduct

Let me know if you need any help reproducing by the way @taloric, I'm around to help

@Chrisbattarbee Hello, thanks for the issue. I've checked the manifest.yaml in the repo and it's simple for reproduced.
Infact, there are some issues during this distributed tracing but it's not caused by tcp conn re-used, we found that the ingress request and egress request in Microservice B is cross-thread which leads to link failed.
But we also found the response captured in egress and ingress are in the same thread. We'll open a pull request to fix that soon, then I'll link this issue to it.

Hey @taloric so I took a look at the threads making requests and I found the following
Poller Client Request Thread: 4075169
Poller Client Response Thread: 4075169
A server Request Thread: 4075133
A server Response Thread: 4075186
A client Request Thread: 4075186
A client Response Thread: 4075186
B server Request Thread: 1548971
B server Response Thread: 1548989
B client Request Thread: 1548989
B client Response Thread: 1548989
C server Request Thread: 4075100
C server Response Thread: 4075177
So that looks to me like the following as a diagram:

So it looks like the threading structure is the same across A and B, so I'm not sure why we end up with a broken trace?

@Chrisbattarbee In fact, in the not re-use scenario, request from MicroService B will send a DNS request before every request to Microservice C, so we link B with C through this DNS request.
But in re-use scenario, this link has been dropped due to it's a single HTTP request without DNS, it was for robustness, but it's maybe too strict for this scenario

@taloric Gotcha. So at my basic level of understanding, is the following true: "For all HTTP requests, if there is no dns query made before the request, the traces will not be linked?"
For what it's worth, I think I've seen this breaking a few other situations too: In the go checkout service in the otel demo, it creates long lived clients which seem to have the same behaviour so therefore the traces were broken there too. That's what made me investigate this. https://github.com/open-telemetry/opentelemetry-demo/blob/main/src/checkoutservice/main.go#L169-L198

@Chrisbattarbee The main reason why the trace is broken is because the ingress request-response and egress request-response are in two threads. However, the scenario in your demo is a bit special. We found that the thread structure in each process is as follows (please @taloric  confirm):

ingress request: thread A
egress request: thread B
egress response: thread C
ingress response: thread C
In this case, we can use thread C to associate the entire trace. However, there was a piece of logic in our code that could be deprecated and blocked this association. We have just deleted it in PR #6386 .

Of course, this scenario is just a coincidence. If there is no overlap between the ingress and egress threads, we cannot complete the tracing.
However, the Golang scenario you mentioned is a bit different. Since the Golang runtime uses goroutines, the threads seen by the kernel are actually meaningless. We have done some work to associate goroutines using eBPF uprobe (by tracking the creation relationship between goroutines, associate them, and construct a pseudo-thread). However, this association mechanism currently has defects for long-live goroutines (our default configuration parameter is 120s), so it cannot perfectly solve the TCP conn re-use scenario.

For all requests started from a different thread than the receiving thread, if there is no dns query made before the request, the traces will not be linked?

Yes, this is because our deprecated code (in #6386) only did special handling for HTTP 1, and DNS does not fall into the logic of this code, so the tracking is complete. However, I have not yet looked at whether the thread structure is different for short TCP conns and the TCP conn re-use scenario. If there is no difference, then it is the reason I mentioned.

Gotcha, on the thread structure:
We found the following assuming by ingress you mean server and by egress you mean client in the deep-flow spans.
ingress request: thread A
egress request: thread B
egress response: thread B
ingress response: thread B

ingress request: thread A
egress request: thread B
egress response: thread B
ingress response: thread B

ok, got it

New patch is working!


[Question] What is the minimum feasible solution with BlockRebalanceOnPoll to avoid duplicates?

Hi @twmb I'm migrating an existing message routing app to the kgo driver. The app is pretty simple and consumes from a source topic and routes messages to the right partitions of the target topic for the next-phase app to consume from partitions as logs.
I'd like to have minimum changes to the code, yet to use the BlockRebalanceOnPoll option to avoid duplicates if possible. I saw you have nice per-partition consuming examples, but I'd like to avoid rewriting as the target producer will mix the source messages and there is no clean independent per source partition consumption. And I assume I could leave the OnPartitions-(...) as default, if I AllowRebalance after I flush the producer side and have clean commits (althouhh this has a performance concern - but I don't see a better alternative).
The number of partitions do not change. The K8s PODs belonging to the consumer group may change but are relatively stable.
So the sketch of my code looks like the following (with questions in comments):
	opts := []kgo.Opt{
		kgo.SeedBrokers(brokers...),
		kgo.ConsumeTopics(c.Topic),
		kgo.ConsumerGroup(c.ConsumerGroup),
		kgo.ConsumeResetOffset(offset),
		kgo.BlockRebalanceOnPoll(),   // Q1: is it OK to leave OnPartitions-(...) callbacks as default?
		kgo.RebalanceTimeout(8 * time.Minute), // default 60s
		kgo.SessionTimeout(5 * time.Minute),
		kgo.DisableAutoCommit(),
		...
	},
	client, err = kgo.NewClient(opts...)
	rebalanceInterval := 5 * time.Second // Q2: not sure if this interval is too long, but too short would cause
                                             // performance concerns with flush before allowing rebalance?
	client.AllowRebalance()    // Q3: Is it necessary to allow rebalance before entering the fetch loop?
	nextAllowRebalanceTime := time.Now().Add(rebalanceInterval)
	for {
		fetches := client.PollFetches(c.ctx).   // Q4: do I need to have timeout so to AllowRebalance? Seems this could hang?
		if errs := fetches.Errors(); len(errs) > 0 {
			if c.ctx.Err() != nil { // canceled, exit loop
				break
			}
			continue  // Q5: Is there any data in fetches when it has errors for some partitions?
		}
		iter := fetches.RecordIter()
		for !iter.Done() {
			r := iter.Next()
			msgC <- r  // sent for routing processing
		}
		if time.Now().After(nextAllowRebalanceTime) { // only allow rebalance after an interval with clean flush and commit
			// flush producer of target here
			_ = client.CommitUncommittedOffsets(context.Background())

			client.AllowRebalance()
			nextAllowRebalanceTime = time.Now().Add(rebalanceInterval)
		}
	}
	client.CloseAllowingRebalance() // Q6: If a pod crashes without executing this, would that block rebalance for the consumer group?

Our Kafka brokers were old 2.4.0 (which is out of my control). Driver franz-go 1.13.6 (upgrading to 1.14.3). The current testing shows this seems not working as expected. Even after I removed the BlockRebalanceOnPoll option and used plain simple consuming, the code was stuck somehow (using the same consumer group).
Any insights and guidance are appreciated!

Add: It turned out that the initial rebalancing took ~5 minutes 30 seconds to finish, with 30 partitions and 8 pods, after we switched to RangeBalancer without BlockRebalanceOnPoll (and deleted the CG so it started clean). Is it normal and how we could improve it...?

In another environment, with same config, most pods in CrashLoopBackOff and restart before getting any data. Only one pod seemed to get data. The CG (one topic only) didn't get to a stable state.

Q1 in comment: yes it's ok to block rebalance on poll. OnPartitions<*> will be blocked after you poll, but will take priority before you try polling again: as soon as you allow rebalance, the OnPartitions callbacks can run.
Q2: I don't know what you're doing here / this rebalance interval context thing doesn't seem necessary, given the next two questions.
Q3: you do not need to allow rebalance before entering loop. Poll blocks rebalance, and rebalance blocks poll, and that's it. One or the other must occur before blocking occurs. For polling blocking rebalancing, specifically it is done here: https://github.com/twmb/franz-go/blob/95697530c665a05d5d62201289dd2c99884f3a2d/pkg/kgo/consumer.go#L429
Q4: Even more specifically, the fill closure doesn't block things the entire time. It's a lot of fancy locks/atomics, but in short: you do not need to have a timeout on your context. Rebalancing is only blocked the moment records are available and about to be returned to you.
Q5: There can be data in partitions. One broker may have returned an error, another may have returned records. Also (and importantly): even in the case of errors, you must allow rebalance before continuing.
Q6: no this does not block rebalancing for the group. However, since the client did not close cleanly, it did not leave the group. The partitions the client was consuming are not being consumed, and eventually (after the session timeout) the broker will notice the consumer has died and trigger a rebalance.

Second comment: did the consumer member leave the group beforehand? Rebalancing should not take this long, especially if you process records quickly. The slowest thing about rebalancing is how long you as a client user spend in OnPartitions callbacks or spend processing records.

If pods are crashing, this could cause rebalance to take a while, because of the rebalance timeout I mentioned.

Thanks @twmb . As I mentioned I simplified the code without using the BlockRebalanceOnPoll option. The code is almost like this (one of the simplest form):
	...
	client, err = kgo.NewClient(opts...)
        // check error here
	for {
		fetches := client.PollFetches(c.ctx)
		if errs := fetches.Errors(); len(errs) > 0 {
			if c.ctx.Err() != nil { // canceled, exit loop
				break
			}
			// continue  <= had this before but we didn't see error from log
		}
		iter := fetches.RecordIter()
		for !iter.Done() {
			r := iter.Next()
			msgC <- r  // sent for routing processing
		}
	}
	client.Close()

What could go wrong that could cause long initial rebalance and crashes (it had no data to process at all most time - but from time to time one pod got some data)? Thanks!

Do you use OnPartitionsRevoked or OnPartitionsLost? If yes, what's that look like?

Is sending what msgC blocked? The algorithm of rebalancing should not take that long -- especially with range.

Thank you Travis. The msgC channel itself has 5000 capacity, and from the log, it never got any data to process by the receiver. We were really puzzled. We will try to enable debug when we get a chance. For the time being, we switched back to the other driver under time pressure.

Thank you, please let me know. I'm very curious to see debug logs -- this should work (and is a reliable pattern I've seen and used). I hope you're able to switch back once we figure things out 😅

Closing for now as this is likely not a franz-go issue -- if you revisit this, we can reopen.


dmd fails to pass tests at build on NixOS 20.09

Describe the bug
dmd package fails to build at test phase, this is a dependency from tilix making it impossible to install.
Error message:
Test runnable/test18076.sh failed. The logged output:
impure path `/tmp/dmd_runFwTyCx' used in link
collect2: error: ld returned 1 exit status
Error: linker exited with status 1
==============================
Test runnable/test18076.sh failed. The xtrace output:
+ source runnable/test18076.sh
++ output_file=test_results/runnable/test18076.log
++ /build/dmd/generated/linux/release/64/dmd -m64 -run -
++ echo 'import std.stdio; void main() { writeln("Success"); }'
+ finish 1
+ set +x
make[1]: *** [Makefile:156: test_results/runnable/test18076.sh.out] Error 1
make[1]: *** Waiting for unfinished jobs....
 ... runnable/variadic.d            -fPIC (-inline -release -g -O)
 ... runnable/uniformctor.d         -fPIC (-inline -release -g -O)
 ... runnable/testconst.d           -fPIC (-inline -release -g -O)
 ... runnable/ufcs.d                -fPIC (-inline -release -g -O)
 ... runnable/traits_getPointerBitmap.d -fPIC (-inline -release -g -O)
 ... runnable/xtest46_gc.d          -lowmem -Jrunnable -preview=rvaluerefparam -fPIC (-inline -release -g -O)
make: *** [Makefile:188: start_runnable_tests] Error 2
make: Leaving directory '/build/dmd/test'
builder for '/nix/store/appczid7m57m2id3xn54zjh21hzx19i0-dmd-2.091.1.drv' failed with exit code 2
cannot build derivation '/nix/store/ip7qd00n9r95d4f9zvq5wjy193qrjyxj-tilix-unstable-2019-10-02.drv': 1 dependencies couldn't be built
cannot build derivation '/nix/store/jd9xdcp90ma1axjc7bmlfp24szl58glp-system-path.drv': 1 dependencies couldn't be built
cannot build derivation '/nix/store/bxn5wr7ps7sha922blljf1vgl1jw0p25-nixos-system-link-gl63-8rc-20.09pre242769.61525137fd1.drv': 1 dependencies couldn't be built
error: build of '/nix/store/bxn5wr7ps7sha922blljf1vgl1jw0p25-nixos-system-link-gl63-8rc-20.09pre242769.61525137fd1.drv' failed

To Reproduce
Steps to reproduce the behavior:
1.Run nixos-rebuild switch --upgrade
Expected behavior
Package builds successfully.
Metadata
Please run nix-shell -p nix-info --run "nix-info -m" and paste the result.

system: "x86_64-linux"
host os: Linux 5.8.6, NixOS, 20.09pre242769.61525137fd1 (Nightingale)
multi-user?: yes
sandbox: yes
version: nix-env (Nix) 2.3.7
channels(root): "nixos-20.09pre242769.61525137fd1"
nixpkgs: /nix/var/nix/profiles/per-user/root/channels/nixos

fixed in b55a44dd6687937fb0ad6b516426515d9eb0294f


[FEATURE] Website for documentation

Create basic build process for static website as part of CI/CD pipeline. Use mkdocs or sometihng like that to create a static site using GitHub Pages, most likely.

Add how to visualize molecules. what packages need to be installed. http://docs.qcarchive.molssi.org/en/latest/basic_examples/QCElemental.html


Reference to type 'EntityOptionsBuilder' claims it is defined in 'EntityFramework.Core', but it could not be found

UseSqlServer seems to be missing when I use
optionsBuilder.UseSqlServer(configuration.Get("Data:DefaultConnection:ConnectionString"));
on my overriden OnConfiguring
revelant c#
public class CRMDbContext : IdentityDbContext<ApplicationUser, ApplicationRole, int>
    {
        public CRMDbContext()
        {

        }

        protected override void OnConfiguring(DbContextOptionsBuilder optionsBuilder)
        {

            var configuration = new Configuration()
                .AddJsonFile("config.json")
                .AddEnvironmentVariables();

            // Visual Studio 2015 | Use the LocalDb 12 instance created by Visual Studio
            optionsBuilder.UseSqlServer(configuration.Get("Data:DefaultConnection:ConnectionString"));

        }

}

heres my project.json
"dependencies": {
    "Microsoft.AspNet.Mvc": "6.0.0-*",
    "Microsoft.AspNet.Server.IIS": "1.0.0-*",
    "Microsoft.AspNet.Server.WebListener": "1.0.0-*",
    "Microsoft.AspNet.Diagnostics": "1.0.0-*",
    "Microsoft.AspNet.Diagnostics.Entity": "7.0.0-*",
    "Microsoft.AspNet.StaticFiles": "1.0.0-*",
    "Microsoft.Framework.Configuration.Json": "1.0.0-*",
    "Microsoft.AspNet.Authentication": "1.0.0-*",
    "Microsoft.AspNet.Authentication.OAuthBearer": "1.0.0-*",
    "Microsoft.Framework.ConfigurationModel.Json": "1.0.0-*",
    "Microsoft.AspNet.Identity.EntityFramework": "3.0.0-*",
    "EntityFramework.SqlServer": "7.0.0-*",
    "EntityFramework.Commands": "7.0.0-*"
  },

What build is installed? dnu list will show you which what is installed. Look for "EntityFramework.SqlServer 7.0.0-beta#-#####"

EntityFramework.SqlServer 7.0.0-beta5
thats what the list shows

In beta5, it is EntityOptionsBuilder. In beta4 and the nightly builds, it is DbContextOptionsBuilder.
Try changing to protected override void OnConfiguring(EntityOptionsBuilder optionsBuilder) as a temporary workaround until beta6 rolls.

I changed it to Beta 5 and Beta 6 both cases made that error go away but now on the dependency injection
An exception of type 'System.MissingMethodException' occurred in WebApplication1 but was not handled in user code
on the line where I set up the EF service
services.AddEntityFramework()
                .AddSqlServer()
                .AddDbContext<CRMDbContext>();

Additional information: Method not found: 'Boolean Microsoft.Framework.DependencyInjection.ServiceCollectionExtensions.TryAdd(Microsoft.Framework.DependencyInjection.IServiceCollection, System.Collections.Generic.IEnumerable`1<Microsoft.Framework.DependencyInjection.ServiceDescriptor>)'.


Probability sampler only respects parent if it sampled

https://github.com/open-telemetry/opentelemetry-ruby/blob/master/sdk/lib/opentelemetry/sdk/trace/samplers/probability_sampler.rb#L55
It looks like the probability sampler tries to use the parent's behavior if a parent span context exists, but it has a bug where if the parent sampled is false it will decide again.

This does look like a problem. Thanks for reporting!

The specification and OTEP are inconsistent here, and the OTEP is more explicit, so I'm inclined to trust the OTEP.
The spec says:

The default behavior should be to trust the parent SampledFlag. However there should be configuration to change this.
The default behavior is to apply the sampling probability only for Spans that are root spans (no parent) and Spans with remote parent. However there should be configuration to change this to "root spans only", or "all spans".

This is self-contradictory, since the first point says we should "trust" the parent SampledFlag, while the second says we should apply the sampling probability for Spans with remote parent.
The OTEP says:

Allows users to configure to ignore the parent SampledFlag.
Allows users to configure if probability applies only for "root spans", "root spans and remote parent", or "all spans".

Default is to apply only for "root spans and remote parent".
Remote parent property should be added to the SpanContext see specs PR/216

Sample with 1/N probability

Root Span Decision:

Sampler
RecordEvents
SampledFlag

Probability
Same as SampledFlag
Probability

Child Span Decision:

Sampler
RecordEvents
SampledFlag

Probability
Same as SampledFlag
ParentSampledFlag OR Probability

The last decision table says we should apply the sampling probability if the ParentSampledFlag is false.
The Go implementation applies the same logic, although it does not permit the degree of configurability suggested by either the spec or the OTEP.

The spec has changed to have the probability sampler (trace id ratio based sampler) ignore the parent’s sampled flag and to have a parent based sampler act as a wrapper to respect the parent’s sampled flag. We implemented this in #322 and #330.


November 01 2022 - Regulation Innovation SIG Meeting Minutes

Regulation Innovation SIG
Date
November 01 2022 - 12pm EST / 4pm GMT
Untracked attendees

Fullname, Affiliation, (optional) GitHub username
...

Meeting notices

FINOS Project leads are responsible for observing the FINOS guidelines for running project meetings. Project maintainers can find additional resources in the FINOS Maintainers Cheatsheet.

All participants in FINOS project meetings are subject to the LF Antitrust Policy, the FINOS Community Code of Conduct and all other FINOS policies.

FINOS meetings involve participation by industry competitors, and it is the intention of FINOS and the Linux Foundation to conduct all of its activities in accordance with applicable antitrust and competition laws. It is therefore extremely important that attendees adhere to meeting agendas, and be aware of, and not participate in, any activities that are prohibited under applicable US state, federal or foreign antitrust and competition laws. Please contact<EMAIL_ADDRESS>with any questions.

FINOS project meetings may be recorded for use solely by the FINOS team for administration purposes. In very limited instances, and with explicit approval, recordings may be made more widely available.

Agenda

[ ] Convene & roll call (5mins)
[ ] Display FINOS Antitrust Policy summary slide
[ ] Review Meeting Notices (see above)
[ ] Approve past meeting minutes
[ ] FINOS Contribution Updates and Next Steps :

https://github.com/finos/community/issues/177
https://github.com/finos/community/issues/179
https://github.com/finos/community/issues/195

Update on product / business owners joining FINOS project teams. Compliance Horizon Scanning to assess.

https://github.com/finos/community/issues/197

[ ] Alex Khachaturian, FINRA Director, Office of Financial Innovation - FINRA Launches Machine-Readable Rulebook Initiative (10 mins)

SIG update on the October 21 public announcement of FINRA’s Machine-Readable Initiative, featuring the:

development of a regulatory taxonomy and rule tags,
launch of the FINRA Rulebook Search Tool™ (FIRST™), and
integration of rulebook content via API

Please see the Special Notice, which lists out a series of questions about the future development of the project, including what role open source collaboration can play.  FINRA is requesting formal comment, by December 20th, 2022 -- link for submitting a formal comment to FINRA.

[ ] AOB, Q&A & Adjourn (5mins)

RegTech Showcase in NYC on on Thursday, November 17th 4-7pm. All are invited to attend, please register ahead of the event. Details and agenda found here.

WebEx info

Meeting link: https://finos.webex.com/finos/j.php?MTID=m6be3cd5cdc56622e15e74fbd30e7253c
Meeting number:<PHONE_NUMBER>
Password: d9kKJPdX5C9
More ways to join:

Join by video system: Dial<EMAIL_ADDRESS>You can also dial <IP_ADDRESS> and enter your meeting number.
Join by phone: +1-415-655-0003 US Toll | +44-20319-88141 UK Toll | Access code:<PHONE_NUMBER>

@mcleo-d Please can you add the following event announcement to the agenda:
RegTech Showcase in NYC on Thursday, November 17th 4-7pm. All are invited to attend, please register ahead of the event. Details and agenda found here.

@mcleo-d Please can you add the following event announcement to the agenda:
RegTech Showcase in NYC on Thursday, November 17th 4-7pm. All are invited to attend, please register ahead of the event. Details and agenda found here.

Thanks so much @jgavronsky - I've added under AOB 👍🏻

hello Sandeep/ Synechron

Jane @ FINOS here

here Nigel @ REGnosys

Stephen Goldbaum from Morgan Stanley


Logo for the project

I definetly need help for this one. this is what I came up with:

plz help! ^^

fudgie suggested a controller made out of voxels


make icebreaker_prog failed

Hi, the make icebreaker_prog cmd failed, it seems that the LCs is exceed 5280.

Info: Creating initial analytic placement for 4660 cells, random placement wirelen = 130669.
Info:     at initial placer iter 0, wirelen = 2202
Info:     at initial placer iter 1, wirelen = 2095
Info:     at initial placer iter 2, wirelen = 2275
Info:     at initial placer iter 3, wirelen = 2044
Info: Running main analytical placer.
ERROR: Failed to expand region (0, 0) |_> (25, 31) of 5305 ICESTORM_LCs
3 warnings, 1 error
Makefile:103: recipe for target 'icebreaker.asc' failed
make: *** [icebreaker.asc] Error 255
and here is the detail log
1.log

Hi, there’s big differences in LC usage between Yosys commits. Here’s what I’m using:
 Yosys 0.9+3537 (git sha1 c75d8c74, clang 11.0.3 -fPIC -Os)
make icebreaker result:
Info: Device utilisation:
Info: 	         ICESTORM_LC:  4790/ 5280    90%

Trying it with Yosys built from c75d8c74 should fix this. I’ll add a README section with confirmed working commits of tools to help anyone building from source.

after update to the latest yosys (Yosys 0.9+3624 (git sha1 4c925a32, clang 6.0.0-1ubuntu2 -fPIC -Os)
), now bitstream build ok, thank you dan!


Update install instructions and dev guide

In GitLab by @wtbarnes on Apr 2, 2020, 11:32
Now that #47 has been addressed, the install instructions and dev guide need to be updated to reflect this. This mostly involves removing any mention of python setup.py <thing> and some instructions about how to test with tox/pytest and how to build the docs. We can probably refer to the sunpy dev guide for a lot of this.

In GitLab by @wtbarnes on Jul 16, 2020, 13:06
mentioned in commit ef98596690ed032488fc6903090f50317e4df249

In GitLab by @wtbarnes on Apr 30, 2020, 07:59
The instructions in the docs also should point to pypi rather than gitlab for installing!


Login to Proxmox Host failed.

I'm 100% sure all the details are correct but i keep getting Login to Proxmox Host failed.

What version of PVE are you running?

Proxmox Virtual Environment 5.1-41?

Ok, I'll investigate that. This library was written around PVE 3, so some things may have changed a bit since then, and we may need to adjust the code accordingly.

Okay thanks. When I was in the data center was it worked though. Since I'm at home anymore, I have not changed the code.
Via Postman, I tried to create a ticket by a postal mail. This does work. Lets make I the login function after.
Sorry for my bad English.

Kippenbeer

Virtual Environment 5.4-13
The connection does not occur.

https://github.com/CpuID/pve2-api-php-client/pull/36

Hi, i'm debugging with Proxmox VE 7.2
after an analysis, i've found the problem is simply that
setrawcookie("PVEAuthCookie", $this->login_ticket['ticket'], 0, "/");
is setting cookie for the actual domain, not for the public url of the PVE
You can try with somthing similar :
setrawcookie("PVEAuthCookie", $this->login_ticket['ticket'], 0, "/", $this->hostname,true,false);
but the problem is that the browsers doesn't allow to set cookie for other domains.
I've solved this and i'm writing a patched version but this is "almost" the solution but i dont like that the cookie allow also to login to 8006 interface. I think is better to connect a Vnc client to the PVE vncproxy

Closing off this 5-6 y.o. discussion now. Improved error logging is in the works in Pull #42 - feel free to contribute.
re: @lucapiccio comments about anti-CSRF protections etc, yes, and in PVE v8.0 onwards this is mandatory now.

Set strict SameSite attribute on the Authorization cookie (ref)


19-color legend

A suggestion for color legend in options.html based on discussion in #19 . Verified styling in in chromium and firefox.

This is great, thank you.
But can you import the colors from links.css instead of redefining them at the options file? I believe you can just include links.css and reference the colors with var(--ball-colour-default) and so on.

Is it ready to merge?

Broke out a root.css to not include unnecessary css in options.html. If you prefer just the first commit, i can revert this refactoring. Tested in chrome and ff. As for whether it is ready for merge, that depends on what requirements for a merge this repo has? I think it should be ok, but would change it if there is anything you would like to have changed.


Async transport thread consumes 100% of one CPU core

Seen with current master (692df12) with X11 and Mac client

ok ... the code in the transport_client_thread is just sooooo wrong.

Should be fixed via #2611 and #2621


Fix: build on macos, closes #580

What kind of change does this PR introduce?

[x] Bugfix
[ ] Feature
[ ] Docs
[ ] New Binding issue #___
[ ] Code style update
[ ] Refactor
[x] Build-related changes
[ ] Other, please describe:

Does this PR introduce a breaking change?

[ ] Yes, and the changes were approved in issue #___
[x] No

Checklist

[x] When resolving issues, they are referenced in the PR's title (e.g fix: remove a typo, closes #___, #___)
[ ] A change file is added if any packages will require a version bump due to this PR per the instructions in the readme.
[ ] I have added a convincing reason for adding this feature, if necessary

Other information
The problem was initially described in #580.

Could you add a change file in .changes dir? Thanks for the report and the fix, I will merge and publish ASAP.

I added the markdown file in the .changes directory. Hopefully it is correct. I found the explanation in the readme a bit cumbersome. Maybe it would be helpful for future contributors to point out, that in this repo there is only one package (namely wry)?

Thanks, I will merge once CI passes


test: Optimaze E2E by removing redundat steps

Thanks for submitting a PR! Please check the boxes below:

[x] I have run pre-commit to check linting
[x] I have filled in the "Changes" section below?
[x] I have filled in the "How did you test this code" section below?
[x] I have used a Conventional Commit title for this Pull Request

Changes

How did you test this code?

npm run test

Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:

Comparison is base (00c6444) 95.58% compared to head (a9e50ee) 95.58%.
Report is 4 commits behind head on main.

Additional details and impacted files
@@           Coverage Diff           @@
##             main    #2996   +/-   ##
=======================================
  Coverage   95.58%   95.58%
=======================================
  Files        1016     1016
  Lines       29526    29538   +12
=======================================
+ Hits        28222    28234   +12
  Misses       1304     1304

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


refactor: add a new calculator class

Add a new calculator class, which includes all the relevant stuff, so that the calculator has more independence from the ui

lgtm


double encoding of query get param

https://github.com/2amigos/yii2-selectize-widget/blob/master/src/InputWidget.php#L47
function $.getJSON is automatically encoding all query params, so there is no need for encodeURIComponent

Thanks

Fixed on https://github.com/2amigos/yii2-selectize-widget/commit/b5fbf3d2574e017880dce6a9f813dee81ba3ebaa


Configuration repo not responsive

This doc refers to a NuGet package / Git Repo. Since it is listened in the official docs I assume it is actively maintained. But there are numerous PR's waiting for review and I really do not how to get things in motion. Pinging the authors on GitHub does not work. Either remove it from the docs if it is not actual anymore or at least have someone review the PRs.

3.0 preview1 is out. Addresses most of the issues that have been reported.


s4: change 1

Stack:

#21
#20 ⮜

⚠ Part of a stack created by spr. Do not merge manually using the UI - doing so may have unexpected results.

✓ Commit merged in pull request #21


no channel in Kodi

Hi
Thank you for the addon. I am trying to install it instead of going thru my Box from Orange.
I have a raspberry and I installed the librelec beta version of Kodi.
I then installed IPTV manager without any issues.
However, when I choose TV in Kodi, no channels are displayed.
Is there something I need to check/set up ?
Thanks

Hello Flo,
Have you activated the IPTV Manager integration into the addon settings? Once done, you can open the IPTV Manager settings and refresh channels and guide. Then, you can force Kodi the reload the new data from TV > General > Erase data (same for the TV guide).

Hello
Yes, I confirm that I have gone to the IPTV manager extension> Configuration
That I started the automatic configuration then refreshed the channels
Unfortunately no channels appear in kodi> TV
I also like you asked to erase Kodu data, but nothing helps

Go to the Orange TV settings, not the IPTV Manager settings ;)

Indeed it was only that, as much for me I thought I had already done it
I can see the channel list. On the other hand more out of curiosity: kodi downloads the DRM as expected. On the other hand, even if the installation seems to go well, when he wants to launch a protected channel, a message tells me that the files cannot be read. Did you have this problem?

I'm glad to read you manage to get the channels.
First, are you able to watch a free channel like TF1 or France 2? About paid channels, as said in the readme file, I don't have any, so this part has not been tested.

thank you for your work :)
I only did tests with free channels ...(TF1, M6...channel TNT only)
I don't have subscriptions for pay channels
I think that it is more the recovery of the DRM which poses problem and their reading
thanks

Let's keep things clean. Can you open an other issue about this new problem? Are you also able to share some logs? The DRM topic is handled by an other addon, InputStream Helper, but we'll see what's going on :)

ok
I open a other issue
thanks


Added missing import in StreamFactoryFactory

It is used in line 31/32.

Thanks, @xtreamwayz!

@weierophinney

Thanks, @xtreamwayz!

Oh... and nobody say thanks to me 😢

Thanx @weierophinney.... and @webimpress :)


MVP-518 Application delay

Design of page changed in response to EMB and User feedback.

Checkboxes with conditionally reveal fields used
Police advise and court advice options merged into one "advised to wait"
heading changed to make it less similar to the other delay question

Screenshot below

I don't think we need to say "briefly" as there is only one line for people to fill out. Each of the text inputs should be the same width as the second option.

Also, I think we need to find a different way to say 'delay' to a user they will have done this as soon as they could and in their eyes, it won't be a delay.

I don't think we should use 'choose'. For all other options pages we use 'select' so we should be consistent. Also, if we stick with 'reasons' it reduces the need for further words like 'option' and 'explain'.

I don't think we should use 'choose'. For all other options pages we use 'select' so we should be consistent. Also, if we stick with 'reasons' it reduces the need for further words like 'option' and 'explain'.

Agree we could change Choose to select if we are going to separate the two "Delay" questions. otherwise there is a danger they will still look similar.  As for the fields using verbs helps the user complete the fields appropriately so I would rather stick with them.