Issues with Service Bus Sdk

I am trying to do a PoC to test the latest feature by the Azure Service Bus Premium that can handle messages of size 100 MB. I tried to do it in two modes.
Send 3495253 count of messages in a batch with the cumulative message sizeInBytes 104857595. THis is definitely less than the 100 MB limit. When I do this, I get the following error, System.InvalidOperationException: 'The link 'G5S2:196:amqps://sbpocbatching1.servicebus.windows.net/-c53a3e1c;0:5:6' is force detached by the broker because publisher(link82) received a batch message with no data in it. Detach origin: Publisher.'
If I try to send one message of size 100MB in that batch, it times out after 1 minute.
Azure.Messaging.ServiceBus.ServiceBusException: 'The operation did not complete within the allocated time 00:01:00 for object message. (ServiceTimeout)'
Is this a problem on my side or the Azure? I have a very good internet connection that shows 350 Mbps download and 300 Mbps upload.
Can anyone throw some light on what am I missing here?
using System;
using System.Text;
using System.Threading.Tasks;
using Azure.Messaging.ServiceBus;

// connection string to your Service Bus namespace
string connectionString = "";

// name of your Service Bus topic
string topicName = "mytopic";

// the client that owns the connection and can be used to create senders and receivers
ServiceBusClient client;

// the sender used to publish messages to the topic
ServiceBusSender sender;

// number of messages to be sent to the topic
int numOfMessages = 0;

//byte[] data = new byte[100 * 1024 * 1024];
//Random rng = new Random();
//rng.NextBytes(data);
string strdata = GenerateString();
{
    // The Service Bus client types are safe to cache and use as a singleton for the lifetime
    // of the application, which is best practice when messages are being published or read
    // regularly.
    //
    // Create the clients that we'll use for sending and processing messages.
    client = new ServiceBusClient(connectionString);
    sender = client.CreateSender(topicName);

    // create a batch
    using ServiceBusMessageBatch messageBatch = await sender.CreateMessageBatchAsync();
    //messageBatch.TryAddMessage(new ServiceBusMessage(strdata));
    for (numOfMessages = 0; numOfMessages <= 104857600; numOfMessages++)
    {
        //if (messageBatch.SizeInBytes >= messageBatch.MaxSizeInBytes / 4)
        //    break;
        // try adding a message to the batch
        if (!messageBatch.TryAddMessage(new ServiceBusMessage(strdata)))
        {
            // if it is too large for the batch
            //throw new Exception($"The message {i} is too large to fit in the batch.");
            break;
        }
    }

    try
    {
        // Use the producer client to send the batch of messages to the Service Bus topic
        await sender.SendMessagesAsync(messageBatch);
        Console.WriteLine($"A batch of {numOfMessages} messages has been published to the topic.");
    }
    finally
    {
        // Calling DisposeAsync on client types is required to ensure that network
        // resources and other unmanaged objects are properly cleaned up.
        await sender.DisposeAsync();
        await client.DisposeAsync();
    }

    Console.WriteLine("Press any key to end the application");
    Console.ReadKey();

    GenerateString();

}

String GenerateString()
{
    int length = 1;
    StringBuilder sb = new StringBuilder();

    for (int i = 0; i < length; i++)
    {
        sb.Append("A");
    }

    return sb.ToString();

}

Hi @arunprakash1986.   Thank you for reaching out and we regret that you're experiencing difficulties.    with respect to:
System.InvalidOperationException: 'The link 'G5S2:196:amqps://sbpocbatching1.servicebus.windows.net/-c53a3e1c;0:5:6' is force detached by the broker because publisher(link82) received a batch message with no data in it. Detach origin: Publisher.'
This would seem to imply that the batch that you're attempting to send is empty.   In your code, you're breaking when TryAdd does not accept the message:
if (!messageBatch.TryAddMessage(new ServiceBusMessage(strdata)))
{
    // if it is too large for the batch
    //throw new Exception($"The message {i} is too large to fit in the batch.");
    break;
}

and then you're attempting to publish that batch:
await sender.SendMessagesAsync(messageBatch);

However, there's no guarantee that your batch contains any messages.   Would you be so kind as to try performing a check of  batch.Count before calling SendMessagesAsync and let us know if the error is occurring for a batch that has messages?

@jsquire Thank you for your response. I was breaking the loop to make sure I dont exceed the max limits of a batch. I have added this statement before SendMessageAsync -         int batchCount = messageBatch.Count;
batchCount= 3495253 . It still throws this exception after a while. Could you please tell me why a single message with 100 MB always timesout, which i have tried as a second option?
.

In addition to the 100 MB limit, there is also a limit of 4500 messages that the service enforces. We have not yet added this into the client validation.
See https://github.com/Azure/azure-sdk-for-net/issues/21451

Same exception

Can you include the full repro code?

using System;
using System.Text;
using System.Threading.Tasks;
using Azure.Messaging.ServiceBus;

// connection string to your Service Bus namespace
string connectionString = "Endpoint=sb://sb-poc-premium.servicebus.windows.net/;SharedAccessKeyName=RootManageSharedAccessKey;SharedAccessKey=LcHVjOfer7KWwMXQvLxR8PAOBChuDVtmxuTmarrtnrw=";

// name of your Service Bus topic
string topicName = "mytopic";

// the client that owns the connection and can be used to create senders and receivers
ServiceBusClient client;

// the sender used to publish messages to the topic
ServiceBusSender sender;

// number of messages to be sent to the topic
int numOfMessages = 0;

//byte[] data = new byte[100 * 1024 * 1024];
//Random rng = new Random();
//rng.NextBytes(data);
string strdata = GenerateString();
{
    // The Service Bus client types are safe to cache and use as a singleton for the lifetime
    // of the application, which is best practice when messages are being published or read
    // regularly.
    //
    // Create the clients that we'll use for sending and processing messages.
    client = new ServiceBusClient(connectionString);
    //, new ServiceBusClientOptions()
    //{
    //    RetryOptions = new ServiceBusRetryOptions()
    //    {
    //        Mode = ServiceBusRetryMode.Fixed,
    //        Delay = TimeSpan.FromSeconds(10),
    //        MaxDelay = TimeSpan.FromMinutes(3),
    //        MaxRetries = 30
    //    }
    //});

    sender = client.CreateSender(topicName);

    // create a batch
    using ServiceBusMessageBatch messageBatch = await sender.CreateMessageBatchAsync();
    //messageBatch.TryAddMessage(new ServiceBusMessage(strdata));
    for (numOfMessages = 0; numOfMessages <= 4498; numOfMessages++)
    {
        //if (messageBatch.SizeInBytes >= messageBatch.MaxSizeInBytes / 4)
        //    break;
        // try adding a message to the batch
        if (!messageBatch.TryAddMessage(new ServiceBusMessage(strdata)))
        {
            // if it is too large for the batch
            //throw new Exception($"The message {i} is too large to fit in the batch.");
            break;
        }
    }

    try
    {
        // Use the producer client to send the batch of messages to the Service Bus topic
        int batchCount = messageBatch.Count;
        var sendSizeInMB = (messageBatch.SizeInBytes / 1024) / 1024;
        await sender.SendMessagesAsync(messageBatch);
        Console.WriteLine($"A batch of {numOfMessages} messages has been published to the topic.");
    }
    finally
    {
        // Calling DisposeAsync on client types is required to ensure that network
        // resources and other unmanaged objects are properly cleaned up.
        await sender.DisposeAsync();
        await client.DisposeAsync();
    }

    Console.WriteLine("Press any key to end the application");
    Console.ReadKey();

    GenerateString();

}

String GenerateString()
{
    int length = 1*10240;
    StringBuilder sb = new StringBuilder();

    for (int i = 0; i < length; i++)
    {
        sb.Append('A');
    }

    return sb.ToString();

}

Thank you @arunprakash1986 - I'm seeing the same thing on my end. We will need to follow up with the service team.

@JoshLove-msft Thank you for your acknowledgment. I also have another observation. I just tried with 5001 messages and it went through without any issues. The only difference is that this time I had a very small per-message size instead of a large one. I am finding it very difficult to adopt the SDK and use it in projects. Also, would you be kind enough to tell what is the way to realize the 100 MB message ? SDK cannot do it. Please provide a definite working sample.

using System.Text;
using System.Threading.Tasks;
using Azure.Messaging.ServiceBus;

// connection string to your Service Bus namespace
string connectionString = "Endpoint=sb://sb-poc-premium.servicebus.windows.net/;SharedAccessKeyName=RootManageSharedAccessKey;SharedAccessKey=LcHVjOfer7KWwMXQvLxR8PAOBChuDVtmxuTmarrtnrw=";

// name of your Service Bus topic
string topicName = "mytopic";

// the client that owns the connection and can be used to create senders and receivers
ServiceBusClient client;

// the sender used to publish messages to the topic
ServiceBusSender sender;

// number of messages to be sent to the topic
int numOfMessages = 0;

//byte[] data = new byte[100 * 1024 * 1024];
//Random rng = new Random();
//rng.NextBytes(data);
string strdata = GenerateString();
{
    // The Service Bus client types are safe to cache and use as a singleton for the lifetime
    // of the application, which is best practice when messages are being published or read
    // regularly.
    //
    // Create the clients that we'll use for sending and processing messages.
    client = new ServiceBusClient(connectionString);
    //, new ServiceBusClientOptions()
    //{
    //    RetryOptions = new ServiceBusRetryOptions()
    //    {
    //        Mode = ServiceBusRetryMode.Fixed,
    //        Delay = TimeSpan.FromSeconds(10),
    //        MaxDelay = TimeSpan.FromMinutes(3),
    //        MaxRetries = 30
    //    }
    //});

    sender = client.CreateSender(topicName);

    // create a batch
    using ServiceBusMessageBatch messageBatch = await sender.CreateMessageBatchAsync();
    //messageBatch.TryAddMessage(new ServiceBusMessage(strdata));
    for (numOfMessages = 0; numOfMessages <= 5000; numOfMessages++)
    {
        //if (messageBatch.SizeInBytes >= messageBatch.MaxSizeInBytes / 4)
        //    break;
        // try adding a message to the batch
        if (!messageBatch.TryAddMessage(new ServiceBusMessage(strdata)))
        {
            // if it is too large for the batch
            //throw new Exception($"The message {i} is too large to fit in the batch.");
            break;
        }
    }

    try
    {
        // Use the producer client to send the batch of messages to the Service Bus topic
        int batchCount = messageBatch.Count;
        double sendSizeInMB = (messageBatch.SizeInBytes / 1024) / 1024;
        await sender.SendMessagesAsync(messageBatch);
        Console.WriteLine($"A batch of {numOfMessages} messages has been published to the topic.");
    }
    finally
    {
        // Calling DisposeAsync on client types is required to ensure that network
        // resources and other unmanaged objects are properly cleaned up.
        await sender.DisposeAsync();
        await client.DisposeAsync();
    }

    Console.WriteLine("Press any key to end the application");
    Console.ReadKey();

    GenerateString();

}

String GenerateString()
{
    int length = 1;
    StringBuilder sb = new StringBuilder();

    for (int i = 0; i < length; i++)
    {
        sb.Append('A');
    }

    return sb.ToString();

}

My understanding was that what you are doing is correct and should have worked, so the sample would be similar to what you have.
I just tested by sending a single 100MB message and it worked, so it is possible this has been implemented to only work for individual messages. Will need to get back to you on this after we discuss with the service team.

I edited your comment as it was leaking your conn string. You should probably regenerate your key for safety.

@JoshLove-msft - I tried with a single message using SendMessageSync instead of the batch version, I still cannot get the 100MB message through. Would you please share the code that you used to test the single message of 100 MB? I am getting the following exception,
Azure.Messaging.ServiceBus.ServiceBusException: 'The operation did not complete within the allocated time 00:01:00 for object message. (ServiceTimeout)'
My internet speed is pretty fast.
Code that I used.
using System;
using System.Text;
using System.Threading.Tasks;
using Azure.Messaging.ServiceBus;

// connection string to your Service Bus namespace
string connectionString = "Endpoint=sb://sb-singlemessage.servicebus.windows.net/;SharedAccessKeyName=RootManageSharedAccessKey;SharedAccessKey=11gmQiWv5xePxnDowcGyGrBJghu351oX6hIuxMS4FSw=";

// name of your Service Bus topic
string topicName = "mytopic";

// the client that owns the connection and can be used to create senders and receivers
ServiceBusClient client;

// the sender used to publish messages to the topic
ServiceBusSender sender;

// number of messages to be sent to the topic
int numOfMessages = 0;

//byte[] data = new byte[100 * 1024 * 1024];
//Random rng = new Random();
//rng.NextBytes(data);
string strdata = GenerateString();
{
    // The Service Bus client types are safe to cache and use as a singleton for the lifetime
    // of the application, which is best practice when messages are being published or read
    // regularly.
    //
    // Create the clients that we'll use for sending and processing messages.
    client = new ServiceBusClient(connectionString);
    //, new ServiceBusClientOptions()
    //{
    //    RetryOptions = new ServiceBusRetryOptions()
    //    {
    //        Mode = ServiceBusRetryMode.Fixed,
    //        Delay = TimeSpan.FromSeconds(10),
    //        MaxDelay = TimeSpan.FromMinutes(3),
    //        MaxRetries = 30
    //    }
    //});

    sender = client.CreateSender(topicName);

    // create a batch
    using ServiceBusMessageBatch messageBatch = await sender.CreateMessageBatchAsync();
    //messageBatch.TryAddMessage(new ServiceBusMessage(strdata));
    for (numOfMessages = 0; numOfMessages <= 5000; numOfMessages++)
    {
        //if (messageBatch.SizeInBytes >= messageBatch.MaxSizeInBytes / 4)
        //    break;
        // try adding a message to the batch
        if (!messageBatch.TryAddMessage(new ServiceBusMessage(strdata)))
        {
            // if it is too large for the batch
            //throw new Exception($"The message {i} is too large to fit in the batch.");
            break;
        }
    }

    try
    {
        // Use the producer client to send the batch of messages to the Service Bus topic
        int batchCount = messageBatch.Count;
        double sendSizeInMB = (messageBatch.SizeInBytes / 1024) / 1024;
        //await sender.SendMessagesAsync(messageBatch);
        ServiceBusMessage msg = new ServiceBusMessage(strdata);
        await sender.SendMessageAsync(msg);
        Console.WriteLine($"A batch of {numOfMessages} messages has been published to the topic.");
    }
    finally
    {
        // Calling DisposeAsync on client types is required to ensure that network
        // resources and other unmanaged objects are properly cleaned up.
        await sender.DisposeAsync();
        await client.DisposeAsync();
    }

    Console.WriteLine("Press any key to end the application");
    Console.ReadKey();

    GenerateString();

}

String GenerateString()
{
    int length = 99 * 1024 * 1024;
    StringBuilder sb = new StringBuilder();

    for (int i = 0; i < length; i++)
    {
        sb.Append('A');
    }

    return sb.ToString();

}

You will need to increase the TryTimeout:
    client = new ServiceBusClient(connectionString, new ServiceBusClientOptions
    {
        RetryOptions = new ServiceBusRetryOptions() { TryTimeout = TimeSpan.FromMinutes(5)}
    });

@JoshLove-msft Thank you. The single message went through after the timeout was increased. Please continue checking with the service team on why the batch sending is not successful or what are the SDK limits that prohibit the operations.

Any updates on this?

@JoshLove-msft:  Do we have any feedback from the service team to share?

@arunprakashn - the service team has acknowledged the issue, but they have not yet shared a timeline for a fix. We should get more information next week.

Is there already any progress on the issue? We are suffering the sames issues.

#1 Batching is not supported when payload is larger than 1 MB.
#2 Payloads larger than 1 MB requires higher operation timeouts configured at the client.
Please refer to the following documentation for limitations on the large messages:
https://docs.microsoft.com/en-us/azure/service-bus-messaging/service-bus-premium-messaging#large-messages-support

#1 Batching is not supported when payload is larger than 1 MB. #2 Payloads larger than 1 MB require higher operation timeout (more than 1 min ) configured at the client. Please refer to the following documentation for limitations on the large messages: https://docs.microsoft.com/en-us/azure/service-bus-messaging/service-bus-premium-messaging#large-messages-support

The linked documentation only states 'Batching is not supported'. Which is a lacking a bit of additional information I guess, one could easily (and incorrectly) assume that you could create a batch with all individual messages <1mb, but totalling more than 1 mb (but less than the large size message limit of course).
But, as some others have figured out themselves, it is impossible to batch anything if it exceeds the 1mb limit, even if the individual messages in the batch never exceed 1mb.
This issue pops up unexpectedly because if you use the sdk without specifying the MaxSizeInBytes when creating the batch, it will default to the max message size of the transport in use and if you configured your queue with large message support, it will set it to eg 100mb.
@JoshLove-msft I'd say that the MaxSizeInBytes for batch messages should be limited to 1mb, since that seems to be the actual limit.
For anyone still facing this issue, manually setting the maximum message size to 1mb is a workaround:
await sender.CreateMessageBatchAsync(new CreateMessageBatchOptions { MaxSizeInBytes = 1048576 });

@arunprakashn Could you please let us know if you had a chance to implement the above provided suggestions ? Awaiting you reply.

@navba-MSFT Please see the comment from @JoshLove-msft . He has mentioned that the issue is reproducible from his end.
"Thank you @arunprakash1986 - I'm seeing the same thing on my end. We will need to follow up with the service team.".
The resolution that you are talking about is for another problem that is also discussed in this thread. Please check with @JoshLove-msft  to confirm if this has been resolved.

@arunprakashn Thanks for getting back. I am adding the Service team to look into this and update this thread.

@navba-MSFT its been more than 3 moths from your last comment. Any update on this issue?

@vishaldupati6 As mentioned earlier, this is currently waiting for the response from Service team. I am tagging them again in this thread.
@shankarsama, @DorothySun216, @EldertGrootenboer, @Saglodha Could you please look into this once you get a chance ? Thanks in advance.

This could be addressed via the feature request here - https://github.com/Azure/azure-sdk-for-net/issues/21451

We have opened an investigation task for this in our backlog, and will update this issue when we have more information.

The feature for providing a max number of messages link setting would be useful, but I don't think it will completely solve this issue. What we really need is a link setting MaxBatchSize, that is set by the service for premium namespaces that have large messages enabled. It could also be set for other namespace types, though we already have the MaxMessageSize setting there.
e.g. for premium:
max-message-size ->100 MB
max-batch-size -> 1 MB
For standard:
max-message-size ->1 MB
max-batch-size -> 1MB

We are aware of this issue, and have an investigation task on the service backlog to look into this.
As things are looking now, we hope to pick this up in the next 6 months, once we have more information we will update this thread.

We have assigned an engineer to look further into this issue. We will update this issue when we have more information.

Any updates on this?
It's a weird limitation not being able to use batching for bigger payloads.

@arunprakashn Service Bus doesn't support batches of messages larger than 1 MB. Any message that is larger than 1 MB is assumed to be single message blob and service doesn't even look into that blob. That's why your attempts to send a batch larger than 1 MB fails with the error 'batch is empty' since we don't treat that message as a batch. We will add this note to our documentation. cc @EldertGrootenboer .
Sending a single message larger than 1 MB, up to 100 MB is fine. Just give larger timeout for all the data to be uploaded.
There is no explicit limit on the number of messages in a client can send in batch, not even 4500.

There is no explicit limit on the number of messages in a client can send in batch, not even 4500.

@yvgopal:  I don't believe this is accurate.  Please see: #21451.

Any update on the fix?


Add AfterAll function to remove resources

Introduce AfterAll function to remove CRs after tests running.

lgtm

/test redhat-appstudio-e2e


fix!: set default value of concatenateModules to true in production mode

Summary
Set optimization.concatenateModules to true in production mode by default

Checklist

[ ] Tests updated (or not required).
[ ] Documentation updated (or not required).

!bench

!eco-ci

!bench

!bench

the performance regression seems huge

!bench


Feature/3528 usermenu examples

Fixes # BLUI-3528

Changes proposed in this Pull Request:

Added examples page for User Menu

Screenshots:

To Test:

yarn start:reactdev

Most of my comments are around what is highlighted.
For "User Menu with non-text Avatars", there's too many lines highlighted.  Instead, highlight lines "3, 16-20" instead (just the avatar).
For "User Menu with a Menu Header", highlight the menuTitle and menuSubtitle prop.
For "User Menu with a Custom Header", highlight the custom header.
For "User Menu with Placement Options", highlight the MenuProps.  Also is there a link that can be provided here for more context?  What are MenuProps? Are they from us, from MUI?
For "Responsive User Menu", highlight the useBottomSheetAt prop.

Just these lines for the UserMenu Header since it's talking about the header portion.

Other than my previous comment everything else looks good to me!


Some remote SVG url not load in library

Bug
SVG URL : - "https://storage.googleapis.com/sioinvest/Company Logos/Openai-1.svg"
Unexpected behavior
 <SvgUri
          width={100}
          height={100}
          uri="https://storage.googleapis.com/sioinvest/Company%20Logos/Openai-1.svg"
 />

React native info output:
   "react": "17.0.2",
   "react-native": "0.68.2",

Library version: x.x.x
"react-native-svg": "^12.3.0",
"react-native-svg-transformer": "^1.0.0",

Hi there are you able to find any solution for this.  I am trying to figure out the other alternatives but nothing seems working
    "react-native": "0.71.8"
    "react-native-svg": "^13.9.0"

this is my versions.
thanks in advance.

Hello @satyabhagavan  @atologistdipak,
Unfortunately react-native-svg doesn't support style property in SVG.
Here is an example of how we can fix that:
It is the SVG XML:
<?xml version="1.0" encoding="UTF-8"?><svg fill="black" id="logosandtypes_com" xmlns="http://www.w3.org/2000/svg" viewBox="0 0 150 150"><g id="Layer_3"><path id="Layer_3-2" d="M0,0H150V150H0V0Z"/></g><path  d="..."/></svg>

We have to remove that part:
<path id="Layer_3-2" d="M0,0H150V150H0V0Z"/>

I have no idea why that SVG has some square over that image.
If you still have that problem after you've removed that part, feel free to reopen the issue.


ssh hangs on centos7 version 1.1.4

Tried to start a new DrupalVM box up using geerlingguy/centos7 1.1.4 and kept getting hung at the point where ssh logins occur. No error messages would show either, it would just sort of hang for a while and then exit out saying it couldn't get ssh access. I am assuming this is a problem with the 1.1.4 release because when I made a Vagrantfile.local and added the following line, destroyed and ran up again, it was able to execute ssh.
config.vm.box_version = "1.1.3"
Maybe just me?

I have the same issue

Grr, I thought I had it working. I definitely ran tests on the base box before pushing it up, and they passed with no Ansible configuration, maybe some SSH setting is messed up.
Could you post an issue here? https://github.com/geerlingguy/packer-centos-7/issues

It's funny, I almost did post the issue there, just wasn't sure which queue was right, lol. Thanks.

@cdmo / @paulsheldrake - Can you check what version of Vagrant and VirtualBox you're running? The networking issue was fixed in 5.1.6, but I built the latest box for 5.1.8 and 1.8.6 of Vagrant.

vagrant 1.8.5
virtualbox 5.0.28
note, I can't upgrade to Vagrant 1.8.6 due to #912

vagrant 1.8.6
virtualbox 5.1.8
i did the upgrades to fix it but it still fails

@paulsheldrake - After doing so, you'll also need to downgrade the box, then after that and a provision, upgrade the box again, due to Vagrant/VirtualBox caching and cloning behavior.

Closing out this issue, as the main problem is an older version of VirtualBox, and that + getting its caches cleared (by uninstalling and reinstalling the box or downgrading and upgrading) should solve this particular issue.
#912 is a separate issue, and will unblock the ability for some people to upgrade, but this particular issue can be closed independently, since it's fixed with the latest versions.

I can say it isn't working for me still
vagrant 1.8.7
VirtualBox 5.1.6 (can't use 5.1.8 due to geerlingguy/drupal-vm#943
Ran the following to remove the newest version:
vagrant box remove geerlingguy/centos7 --box-version=1.1.4
Ran vagrant box update to reinstall the new version and got the following:
==> drupalvm: Checking for updates to 'geerlingguy/centos7'
    drupalvm: Latest installed version: 1.1.3
    drupalvm: Version constraints:
    drupalvm: Provider: virtualbox
There was an error while downloading the metadata for this box.
The error message is shown below:

Except there is no error message shown below...
Did I do something wrong in my uninstall/reinstall process?

@cdmo - Please use Vagrant 1.8.6 instead (or use the linked issue's workaround). 1.8.7 has a major bug: https://github.com/mitchellh/vagrant/issues/7969

Did fix! Thanks @geerlingguy ✅


Why does stringtie --merge remove potential novel transcript isoforms if they are substrings of longer isoforms?

Hi, I posted my question at
https://www.biostars.org/p/208171/ , but think I have better chance of an answer here.
I am trying the hisat2 -> stringtie -> ballgown workflow. I have 46 samples from 2 tissues. I run stringtie 3 times as described in http://www.nature.com/nprot/journal/v11/n9/full/nprot.2016.095.html, approximately like this:
stringtie sample1.bam -G genes_ensembl_GRCh37_20150717.gtf -o sample1_run1.gtf #for each sample
stringtie --merge -G genes_ensembl_GRCh37_20150717.gtf -o merged.gtf listofrun1gtfs.txt
stringtie sample1.bam -G merged.gtf -e -B ballgowndirsample1 -o sample1_run3.gtf
However when I, for one gene of particular interest; INPP4B, compared the isoform expressions after the stringtie run to the aligned reads from the bam file in IGV I saw a problem: A commonly called isoform consisting of 27 exons did not have any expression for the last 6 exons, while the first 21 exons had a coverage between 100 and 500. This pattern was clear for all samples of that tissue and different from the pattern of the other tissue.
After some troubleshooting I saw that the shorter potentially novel 21-exon isoform was called in the first run of stringtie, however the merge step removed it. And I think the reason was because it was a substring of the larger 27 exon isoform. Figure 2 in the paper indicate that this might be the intended behavior of the merging. I also tested merging only one gtf file and indeed the shorter isoform disapeared while the 27 exons isoform was still in.
So, have I misunderstood some parameter settings in stringtie? Or is it biologically impossible for one isoform to be a substring of another longer isoform? Or is this a limitation with stringtie?
Vegard

I also have a similar experience with stringtie --merge. With the same set of GTF files from assemblers (cufflinks or stringtie), stringtie -merge got much less de novo transcript than cuffmerge. Also, I checked the results in IGV with bam files, the stringtie --merge results lost some novel transcripts (some of them were verified by PCR). Is there any opinions to lower the criteria to control false negatives in stringtie --merge?

Thank you for these very useful observations.
Indeed at the moment stringtie --merge makes larger isoforms "swallow" (and thus discard) the smaller, fully contained, intron-compatible isoforms. But as you noticed (and we have learned too), it is actually biologically possible (and significant!) that a smaller, "contained" and apparently "redundant" isoform be expressed on its own, due to the alternative TSS (or even TSE?) for the same exon/intron chain.
We plan to address this in a future release by implementing an expression level threshold that would prevent StringTie from collapsing such "contained" isoforms into their theoretical container when their expression level in any sample is above that threshold. There are currently some merge parameters (-c,-F,-T,-f) which are used to filter out transcripts from the merge procedure, but we cannot use these to also keep in such apparently contained/redundant transfrags, as the values should be much higher in order to declare such transfrags as immutable, standalone isoforms.
This should likely be generalized beyond "contained" isoforms -- we might have to consider applying such "do not merge/assemble"  threshold to any highly expressed transfrags that would otherwise get assembled into larger, more complex "merged" transcripts, as it is possible that various TSS/TES combinations can actually produce such distinct isoforms.

Thanks for your answers.
I noticed that there was an opinion (-C) in your another software
gffcompare (was cuffcompare before) to deal with these "contained"
isoforms. I think right now gffcompare can combine gtf files with
keeping these "contained" isoform. Is this a workable alternative for
stringtie --merge?
On 9/20/2016 1:45 PM, Geo Pertea wrote:

Thank you for these very useful observations.
Indeed at the moment |stringtie --merge| makes larger isoforms
"swallow" (and thus discard) the smaller, fully contained,
intron-compatible isoforms. But as you noticed (and we have learned
too), it is actually biologically possible (and significant!) that a
smaller, "contained" and apparently "redundant" isoform be expressed
on its own, due to the alternative TSS (or even TSE?) for the same
exon/intron chain.
We plan to address this in a future release by implementing an
expression level threshold that would prevent StringTie from
collapsing such "contained" isoforms into their theoretical container
when their expression level in any sample is above that threshold.
There are currently some merge parameters (-c,-F,-T,-f) which are used
to /filter out/ transcripts from the merge procedure, but we cannot
use these to also /keep in/ such apparently contained/redundant
transfrags, as the values should be much higher in order to declare
such transfrags as immutable, standalone isoforms.
This should likely be generalized beyond "contained" isoforms -- we
might have to consider applying such "do not merge/assemble" threshold
to any highly expressed transfrags that would otherwise get assembled
into larger, more complex "merged" transcripts, as it is possible that
various TSS/TES combinations can actually produce such distinct isoforms.
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/gpertea/stringtie/issues/66#issuecomment-248376958,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AUG7KjFKAppv8tUDtlVNqTAYsrdOPfGAks5qsBvIgaJpZM4Jq6Qm.

--
Weixuan Fu
Bioinformatician
Bioinformatics Core, Institute for Biomedical Informatics, University of Pennsylvania
B101 Richards Building, 3700 Hamilton Walk, Philadelphia, PA 19104-6113
Email<EMAIL_ADDRESS>

It's not such a good alternative, as it only merges fully matching transfrags across samples (and optionally the contained ones, but now the default is to not discard these anymore). The important distinction is that it does not attempt to assemble overlapping partial transfrags that might be coming from a single isoform. Because of this, and because gffcompare does not filter by coverage/FPKM (though this filter could be easily implemented), all of the poorly expressed transcripts from various samples that were only partially assembled by StringTie will end up in the *.combined.gtf file produced by gffcompare -- so the output might be much larger than desired and will certainly not represent a non-redundant set of isoforms expressed across all the samples. The many redundant/overlapping fragments left in some loci (alongside fully assembled transcripts from other samples, possibly) might also confuse the next step in the pipeline (abundance estimation for each sample), which can be quite problematic.
In contrast, stringtie --merge would have attempted to assemble those overlapping partial isoforms together across samples.. Of course an argument can be made that such partial isoforms wouldn't end up as "partial"  unless the coverage (expression level) of the complete transcript was quite low to begin with.. so they might/should even get discarded by the default (or user adjusted) merge filters..

was this issue addressed and fixed?
Thanks

Not quite.. because it's not quite obvious what the "fix" should be (i.e. the "correct" set of non-redundant isoforms). StringTie might still be considered too aggressive when merging "contained" isoforms, but on the other hand we have to somehow limit the output which can easily grow out of control when the results for many samples are merged.
Meanwhile gffcompare has been slightly improved to allow for various forms of containment and matching transfrag reduction, though merging of non-contained but compatible, extension-overlapping isoforms is still not implemented in that program. However, until we overhaul the stringtie --merge I think we could cautiously recommend using the last version of gffcompare (using -C/-A/-X and optionally -K options) as a conservative alternative to it (though the output can get quite large for many samples).

OK, will consider this recommendation.
Thank you for the prompt response!

was this issue addressed and fixed in version-2.1.4?
Thanks


Maths_Operations

Addition , Subtraction and Multiplication

SourceCode/2023/Nov2023/Srikanth/Maths_Operations/project.json
Score:

Code Completion: 2/2
Execution: 1.5/2
Annotations and Comments: 0/1

Main.xaml file:

You used "Assign" activity name 4 times. Try to use different names for each activity, it makes your code easier to understand.
Variables "Addition_Result", "Subraction_Result", and "Multiplication_Result" are not following the set pattern. You should name your variables properly for clarity.
You used default names for many activities such as "Input Dialog", "Assign", and "Log Message". Consider giving descriptive names to each activity, this will make the code easier to read and understand.

Generic:

Don't forget to define the Automation Hub URL in your Project Settings as required by organization.
You have included some packages which you don't use in the project such as UiPath.Excel.Activities, UiPath.Mail.Activities, UiPath.Testing.Activities, and UiPath.UIAutomation.Activities. Consider removing these unused packages, it will improve the execution time of your project.


Remove -l in nc revshell

Hi 👋
As stated in man page, "-l' Used to specify that nc should listen for an incoming connection rather than initiate a connection to a remote host. It is an error to use this option in conjunction with the -p, -s, or -z options. Additionally, any timeouts specified with the -w option are ignored."
I suggest to remove -p in the command for listener
Cheers

https://linux.die.net/man/1/nc

Without the "-p" nc will generate a random port and not the one that you provide. Thank you :)


add changelog

Can we add a changelog to SAX?
We are now getting some strange issues
https://github.com/gdsfactory/gplugins/actions/runs/6230788778/job/16911327047
https://github.com/gdsfactory/gplugins/issues/108

done :)
I'll look at the issues today.


Fix some test failures.

FYI:
@sschoenholz I fixed some pytype failures in callback.py
@jakevdp I added a precision argument to the new convolution operations so the tests pass on TPU.


Add artisan vendor:publish command to create ray.php config file in root

As per tweet with Freek, this will create the vendor:publish command to create the default ray.php file in the root of the app.

I think it would be better to publish the file in the base path of the project (as this configuration is developer specific (and not project specific). The stub should be in a stub directory in this package (otherwise it would be confused with a real config file).
Could you also update the docs at https://github.com/spatie/ray/docs to explain how people can publish this?
Thanks!

I think it would be better to publish the file in the base path of the project (as this configuration is developer specific (and not project specific). The stub should be in a stub directory in this package (otherwise it would be confused with a real config file).
Could you also update the docs at https://github.com/spatie/ray/docs to explain how people can publish this?
Thanks!

Hi @freekmurze
It does publish to the base_path
DIR.'/../config/ray.php' => base_path('ray.php')
Will change to a stub directory, would you prefer a command over the vendor:publish?

Hi @freekmurze
It does publish to the base_path
DIR.'/../config/ray.php' => base_path('ray.php')
Will change to a stub directory, would you prefer a command over the vendor:publish?

It does publish to the base_path

Ah, didn't catch that, thanks!

Will change to a stub directory,

👍

Would you prefer a command over the vendor:publish?

Yes, that would be better! 👍

It does publish to the base_path

Ah, didn't catch that, thanks!

Will change to a stub directory,

👍

Would you prefer a command over the vendor:publish?

Yes, that would be better! 👍

@freekmurze
I have changed to a command and added a couple of helper options
So if you ray:publish-config --homestead or ray:publish-config --docker it will change the host
If you are happy with everything then I will update the docs.

@freekmurze
I have changed to a command and added a couple of helper options
So if you ray:publish-config --homestead or ray:publish-config --docker it will change the host
If you are happy with everything then I will update the docs.

Awesome work! Thank you so much. Please send a PR to the docs 👍

Awesome work! Thank you so much. Please send a PR to the docs 👍

@Freek
PR sent to docs also

@Freek
PR sent to docs also

Thank you!

Thank you!


#29 Implicit conversions for scene tree branches

Done!
GodotSharp.SourceGenerators.2.1.0-230620-1701.Release.nupkg.zip

Thank you for all he advice on getting this running locally. It works great! I'll open the next PR myself now that I have a local environment that doesn't just throw errors at me.


Assigning secondary user store users to internal role fails

Describe the issue:
Assigning secondary user store users to internal role fails
How to reproduce:

Create a user in a secondary user store
Create workflow for update the user list of role
Try to assign a secondary user store user to an internal role
User doesn't exist error will be thrown.

Expected behavior:
Successfully triggered the workflow.
Environment information (Please complete the following information; remove  any unnecessary fields) :

Product Version: IS-5.11.0
OS: [e.g., Windows, Linux, Mac]
Database: [e.g., MySQL, H2]
Userstore: [e.g., LDAP, JDBC]

Fixed with https://github.com/wso2-extensions/identity-user-workflow/pull/37


SqlSetup: SQLSvcAccount failing on domain account

Are there any known issues around installing with a domain account? I did it this same exact way with this same account on xSqlServer and now it fails with this new package.
The account is valid and I can RDP to the server with that account and creds.
Error:

2018-02-02 11:26:30 Slp: Validation for setting 'SQLSVCACCOUNT' failed. Error message: The SQL Server service account login or password is not valid. Use SQL Server Configuration Manager to update the service account.

Log File:
SQLSVCACCOUNT:                 Dev2x.Azure.aon.net\svc-sqlserverxx
SQLSVCPASSWORD:                *****

I tried changing to this format. No difference.
SQLSVCACCOUNT:                 Dev2x\svc-sqlserverxx
SQLSVCPASSWORD:                *****

No that should work. I just did an install a couple of hours ago using a domain account, and the integration tests installs using a local account (to mimic installing as a domain account).

ya this one is throwing me. I can run in xSqlServer and it works perfect. When I use the newest SqlServerDsc it fails.

That sound strange.
Can ypu post your configuration?
What version of SQL Server are you installing?
Are you using SQLPS or SqlServer?

SQL Server 2014 right now.
I had to put xxx for some entries, but nothing important for the install. If I did not give enough let me know!
SqlSetup SqlServerSetup {
BrowserSvcStartupType = 'Automatic'
Features = $environmentNode.sqlInstallFeatures
InstallSharedDir = $roleNode.installSharedDir
InstallSharedWOWDir = $roleNode.installSharedWowDir
InstallSQLDataDir = $roleNode.installSqlDataDir
InstanceName = $environmentNode.sqlInstanceName
InstanceDir = $roleNode.sqlInstanceDir
SAPWd = $sqlSaAccountCreds
SecurityMode =  $roleNode.securityMode
PsDscRunAsCredential = $adminCreds
SourcePath = $roleNode.sourcePath
# SourceFolder = $roleNode.sqlSourceFolder
SQLBackupDir = $roleNode.sqlBackupDir
SQLCollation = $roleNode.sqlCollation
SQLSvcAccount = $SQLServiceCreds
SQLSysAdminAccounts = $environmentNode.sqlSysAdminAccounts
SQLTempDBDir = $roleNode.sqlTempDbDir
SQLTempDBLogDir = $roleNode.sqlTempDbLogDir
SQLUserDBDir = $roleNode.sqlUserDbDir
SQLUserDBLogDir = $roleNode.sqlUserDbLogDir
UpdateSource = $roleNode.updateSource
UpdateEnabled = $roleNode.updateEnabled
SuppressReboot = $False
ForceReboot = $False
#TODO: Need to come up with non hard coded solution
DependsOn = '[WaitForVolume]WaitForISO','[Disk]CreateDrivesSQLTemp','[Disk]CreateDrivesSQLLog','[Disk]CreateDrivesSQLSystem','[Disk]CreateDrivesSQLData'
}
PSD1:
@{
environment = 'infra'
diskDrives = @(
@{
diskFriendlyName = 'SQLData'
driveLetter = 'F'
driveSize = 2100GB
},
@{
diskFriendlyName = 'SQLLog'
driveLetter = 'L'
driveSize = 1500GB
},
@{
diskFriendlyName = 'SQLSystem'
driveLetter = 'E'
driveSize = 25GB
},
@{
diskFriendlyName = 'SQLTemp'
driveLetter = 'T'
driveSize = 1500GB
}
)
domainName = 'Dev2x.Azure.xxx.net'
octopusEnvironment = 'Infrastructure'
ouPath = 'OU=SQL,OU=USA,OU=Servers,OU=NA,OU=Regions,DC=dev2x,DC=azure,DC=xxx,DC=net'
remoteUsers = @('NAAG-xxx-Deploy', 'NAAG-xxx-dba')
sqlCred1 = 'dbmaintlrs'
sqlIdentity1 = 'xxxdbmaintlrs'
sqlCred2 = 'dbmaintragrs'
sqlIdentity2 = 'xxxdbmaintstdrgrs'
sqlCred3 = 'dbmaintzrs'
sqlIdentity3 = 'xxxbackupsstdzrs'
sqlInstallFeatures = 'SQLENGINE,SSMS,ADV_SSMS,IS,FULLTEXT,BC,CONN'
sqlInstanceName = 'INFRA01'
sqlIso = 'en_sql_server_2014_developer_edition_with_service_pack_1_x64_dvd_6668542.iso'
sqlSysAdminAccounts = @('NAAG-xxx-Admin','NAAG-xxx-Deploy','NAAG-xxx-DBA','NT AUTHORITY\SYSTEM','NT SERVICE\Winmgmt','Svc-SQLServerFA1','svc-WinServerFA1')
sqlServerDomainAccounts = @('Dev2i\NAAG-xxx-Deploy', 'Dev2i\svc-xxxIIS')
tcpPort = 'xxx'
VaultName = "xxx-weu-infra"
virtualDiskLayoutType = 'Simple'
},

Role = @(
@{
Role = 'SqlServer'
installSharedDir = 'C:\Program Files\Microsoft SQL Server'
installSharedWOWDir = 'C:\Program Files (x86)\Microsoft SQL Server'
installSqlDataDir = 'E:\TRPMSINFRA01'
octopusListenPort = '10933'
octopusRole = 'New-DB'
octopusServerUrl = 'https://deploy.xxx.com'
RequiredDirectories = @('T:\BatchFiles','T:\MSSQLJobLogs','T:\SSISPackages')
saUserName = 'sa'
securityMode = 'SQL'
sqlSourceFolder = ""
sourcePath = "G:"
sqlAuthUsers = @(
@{
userName = 'xxx'
keyVaultKey = 'SQL-xxx'
roleName = 'sysadmin'
},
@{
userName = 'Hangfire'
keyVaultKey = 'SQL-Hangfire'
roleName = 'sysadmin'
},
@{
userName = 'OctopusDeploy'
keyVaultKey = 'SQL-OctopusDeploy'
roleName = 'sysadmin'
},
@{
userName = 'TDE-Local-Principal'
keyVaultKey = 'SQL-TDE-Local-Principal'
roleName = 'sysadmin'
},
@{
userName = 'TDE-Prod-Principal'
keyVaultKey = 'SQL-TDE-Prod-Principal'
roleName = 'sysadmin'
}
)
sqlBackupDir = 'T:\Backups'
sqlCollation = 'SQL_Latin1_General_CP1_CI_AS'
sqlInstanceDir ='E:\Microsoft SQL Server'
sqlIsoDriveAssignment = 'G'
sqlServiceUserName = 'svc-sqlserverxx'
sqlTempDbDir = 'd:\TRPMSINFRA01'
sqlTempDbLogDir = 'd:\TRPMSINFRA01'
sqlUserDbDir = 'F:\TRPMSINFRA01'
sqlUserDbLogDir = 'L:\TRPMSINFRA01'
storageSpaceName = 'MS-SQL-Drives'
SoftwareList = (
@{
Type = 'SelfInstall'
Key = 'vcredist_x64'
Name = "Microsoft Visual C++ 2013 Redistributable (x64) - 12.0.30501"
Archive = 'vcredist_x64.zip'
},
@{
Type = 'SelfInstall'
Key = 'DLMAutomation'
Name = "RedGate DLM Automation Suite"
Archive = 'DLMAutomation.zip'
},
@{
Type = 'SelfInstall'
Key = 'curl'
Name = "curl"
Archive = 'curl.zip'
},
@{
Type = 'MsiPackage'
Key = 'AzureKeyVaultConnector'
Name = "SQL Server Connector for Microsoft Azure Key Vault"
Archive = 'SQLServerConnectorforMicrosoftAzureKeyVault.msi'
File = 'SQLServerConnectorforMicrosoftAzureKeyVault.msi'
Args = '/passive'
ProductId = "2F17A369-AE10-4D0A-B897-D432C257A0CA"
}
)
updateEnabled = 'False'
updateSource = 'MU'
virtualDiskProvisioningType = 'Thin'
}
);

Still trying to figure this one out....
I generate my SVC creds with this:
$sqlServicePw = (Get-AzureKeyVaultSecret -VaultName $vaultName -Name $nonNodeData.sqlServiceSecretName).SecretValue
$sqlServiceCreds = New-Object System.Management.Automation.PSCredential("$($environmentNode.DomainName)$($roleNode.sqlServiceUserName)", $sqlServicePw)
Which I than pass into:
SqlSetup SqlServerSetup {
SQLSvcAccount = $SQLServiceCreds
}
Which gives this Error:
2018-02-02 11:26:30 Slp: Validation for setting 'SQLSVCACCOUNT' failed. Error message: The SQL Server service account login or password is not valid. Use SQL Server Configuration Manager to update the service account.
Log File:
SQLSVCACCOUNT: Dev2x.Azure.xxx.net\svc-sqlserverxx
SQLSVCPASSWORD: *****
Everything seems correct when I run the commands in powershell and verify the results. This is the same process I used in xSqlServer which zero changes, which worked. I am kind of at a loss right now.

it seems my PsDscRunAsCredential was causing this. Not sure why it worked before, but I changed this to a network account and it is working. Having the RunAs as a local account and the installer as a network account was not working :)


Application focus

Description of the new feature / enhancement
Allow setting a window or monitor as focused. When selected, this would dim (preferably by a configurable amount and hue) the rest of the screen. This is a feature which was present in the DisplayFusion app under the name of Monitor Fading.
Scenario when this would be used?
This would be useful when you want to focus on just one application but don't want to have it maximized, or when presenting/recording/screencasting to draw attention just to relevant applications.
Supporting information
No response

/dup https://github.com/microsoft/PowerToys/issues/13035


Full UI rewrite.

The current UI of the website is not stylish and appealing, so I re-designed the website.
Here is my UI mockup -

Here is the design file - https://www.figma.com/file/lRb1m7qWrf7q2OmH9nEHoK/cardui?node-id=0%3A1
We should do a full UI rewrite with modern tech like tailwindcss.
I can also contribute to the rewrite.

The current UI of the website is not stylish and appealing, so I re-designed the website. Here is my UI mockup -
Here is the design file - https://www.figma.com/file/lRb1m7qWrf7q2OmH9nEHoK/cardui?node-id=0%3A1 We should do a full UI rewrite with modern tech like tailwindcss. I can also contribute to the rewrite.

yeah totally appreciate your work  but this is a beginner friendly open source project , tech stacks will remain the same (the basic one's) , if you want to rewrite  the website ui you need to code in html ,css and js , if your are ok with that , you will be assigned ...

yes, I can do it with vanilla  CSS. And it will also take time.

@Anurag30112003  do it then

@Anurag30112003  any updates ??

working on it.

made homepage -

You can also refer
https://cardui1-212.netlify.app/
https://github.com/Anurag30112003/cardui

made homepage -  You can also refer https://cardui1-212.netlify.app/ https://github.com/Anurag30112003/cardui

nice one


add ignore_blank_lines when do visual send

fixed https://github.com/hkupty/iron.nvim/issues/301

Hi, Sorry for the delay... Thanks for the PR!


TextExtra in KryptonForm when using KryptonRibbon

Hello everybody,
I'm working on program that uses the KryptonToolkit and the KryptonRibbon.
I've got an issue with the TextExtra in the KryptonForm when using KryptonRibbon on it.
This issue is not present without the KryptonRibbon.
This issue is also present in the repository ComponentFactory/Krypton.git

OS: Win 10 1809 (17763.292)
Have you any solutions for this issue?
Best regards

Hi @richterAl
Is this from one of the example applications? I've never seen this issue before.

Hello @Wagnerp,
yes, it is the project [Krypton Ribbon Examples][Ribbon + Navigator + Workspace]
To reproduce this issue you only need to set a value to the TextExtra property (no other changes required).

Hi @richterAl
I can confirm that it is an issue with this particular example, however it you create your own app, it will not happen.

I will check this, because I have the same issue in my application.

Hello @Wagnerp,
i have tested it in a new project. Just a Kryptonform and a Ribbon on it. Same issue.
Can you post please your testproject from the last post, so I can find out the difference?
This was my test:
TestKryptonTextExtra.zip

Hi @richterAl,
Your test code works as it should on my machine. How odd.

Hello @Wagnerp,
same issue for 5.470.
But I've tried it on a different machine (Win10: 1803 (17134.523)). There it works in both version 5.470 and 5.472.
So it seems that MS has changed something. 👎
Which OS version do you use?

Hi @richterAl
I use 17763.253 (1809), (soon to be 1903). That might be why.

That's ok, I'm in the middle of fixing the drop shadow issue. Will publish a new build in about 15 mins on NuGet.

Hello,
I have new experiences when this issue occurs.
This error occurs only

in multi monitor environment and
at least one monitor must be virtual placed on the left or top side of the primary monitor

Can you have a look at this issue again, please?


docs: Clean up RequestAnimationFrameLoop docs

80 charachter limit
minor typos (_private -> @private)
correctly tag private methods

landed as 4c7431a


Docs.MS CI Updates for Azure.Security.Attestation

CI Update for release of Azure.Security.Attestation

Docs Build status updates of commit f9ea421:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

bundlepackages/azure-dotnet-preview.csv
:white_check_mark:Succeeded

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching in the Docs contributor and Admin GuideSee the frequently asked questionsPost your question in the Docs support channel


feat: implement raw filed for web

closes #25
@robingenz is docs auto-generating?

closes #25
@robingenz is docs auto-generating?

No, please run npm run docgen and npm run fmt.

@robingenz so, we change interface name, do we need changes for backward compatibility or use new version as major?

@robingenz so, we change interface name, do we need changes for backward compatibility or use new version as major?

Next version will be 0.4.0 which means that the version contains breaking changes, as we are still in major version zero (0.y.z).

Hi @reslear,
I've reconsidered and decided that I don't want to release the next breaking changes until the update to Capacitor 4.
This plugin has received a lot of breaking changes and I would like to reduce that a bit.
For this reason I have created a new PR without breaking changes (see #37).
You can give it a try if you want:
npm i<EMAIL_ADDRESS>
However, thank you for this PR! I hope that is fine for you.


Variadic function.

Codecov Report

Merging #38 (8f5679e) into main (df31b2c) will increase coverage by 0.48%.
The diff coverage is 60.52%.

@@            Coverage Diff             @@
##             main      #38      +/-   ##
==========================================
+ Coverage   54.32%   54.80%   +0.48%
==========================================
  Files          10       10
  Lines        1018     1082      +64
  Branches      490      512      +22
==========================================
+ Hits          553      593      +40
- Misses         79       87       +8
- Partials      386      402      +16

Impacted Files
Coverage Δ

src/compiler.cpp
43.50% <9.09%> (-2.71%)
:arrow_down:

src/vm.cpp
52.10% <58.69%> (+2.43%)
:arrow_up:

include/lisp/vm.h
96.07% <94.73%> (+1.79%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update df31b2c...8f5679e. Read the comment docs.


Cloudflared: Investigate reintegration

Fix for commit bd957c91162d53d8e4c6bfbe59d5279587a01746

Cloudflared & Traefik are both proxies and don't work well together, due to Traefik having options for local (offline) use, Cloudflared will not be reintegrated. See #18


docs(guides): change bundle filename

Replace main.js by bundle.js to make sense with the text used in the second paragraph of section Modules.

PR is not longer valid, all references now use main.js


[FIX] Patch boldbuffer for ME

As reported in #1131, recent refactors (post v. 1.0.9) of the bold workflow are yielding duplicate results across echos. This PR should increase the legibility of early portions of the BOLD workflow and patch the multi-echo workflow (specifically the boldbuffer connections) so that correct results are achieved for each echo.

I just compared the circle outputs for echo1 and echo2 in ds210 using np.allclose and they're now giving different results, so I think this is patched !
I'd like to add this to the overall testing suite (seeing if the results are consistent across refactors, maybe using the cache), but this is a bigger idea that I think we can discuss in a separate issue, at least if we'd like to implement it across data sets.

Should there be multiple functional entries in the report?

Sorry, to confirm, do you want me to add anything to this PR ? I accidentally opened this on my master, so if I should edit the reports I'll go ahead and close this and open a new PR with this code and whatever additions are requested !

I think this PR is pretty well focused. I've opened #1135 with @effigies suggestion.


Daily answers possibly reverted?

I think much like the +w command breaking recently, dailies may be messed up as well. I’ve noticed that dailies don’t accept “newly” added answers that were accepted, but are listed in the trivia docs as possible answers.

Should be fixed now.


Describe how to set up webpack

Please review the changes made in the PR for the same.

Please review the final changes.

Review pending


[BUG] Job Details page does not show queued time

Describe the bug
Job details page does not show when a job was queued.
Expected behavior
The queued job should have a field in the table that shows me when the job was queued for me to better identify queued jobs.
Screenshots

Additional context
Currently, the datetime field is called "Launched", showing when the job was started. Either we need to rename the field or we need to create a new field showing the user when the job was queued.

Is there a way to change the timezone of the job-"launched" information?

@SebastianGergen  There is currently no way to change timezone at runtime, although that ability could be added. To get it to work right now, you can build your own image with the TZ variable set to your timezone, and use that instead of the default.


"All Account" statistics not available

Describe the bug
Hi @devmount, first, thanks you very much for implementing the all-accounts stats feature! :+1:
It should be available in v1.2.0, right? I just updated to v1.2.0 but sadly, it doesn't work for me:
To Reproduce
A) Steps to reproduce the behavior:

Go to Thunderbirds Stats by selecting an individual account
The "Account"-dropdown is missing the "All Acounts" option.

B) Steps to reproduce the behavior:

If I click "Open all stats" on the button-modal instead going through an individual account
The loading spinner keeps running, but doesn't get to an end.
No stats are shown

Screenshots

System (please complete the following information):

OS: Ubuntu 20.10
Thunderbird Version 78.5.0 (64-bit)

Additional context
I don't know if it matters, but one of my accounts is an IMAP-Account, while the other one is a Local Account. The stats for the individual accounts are working fast and flawless.

Hi @dynobo,
thank you for reporting this.
A) The "All Accounts (Sum)" option only appears, if Cache is enabled (due to performance reasons) - please check the add-on options for this.
B) This is indeed a bug, if Cache is disabled (I missed that case at this point). I'll fix this asap!

Hi @dynobo,
thank you for reporting this.
A) The "All Accounts (Sum)" option only appears, if Cache is enabled (due to performance reasons) - please check the add-on options for this.
B) This is indeed a bug, if Cache is disabled (I missed that case at this point). I'll fix this asap!

(Sorry, closed this by mistake)

(Sorry, closed this by mistake)

Thanks, while it wasn't the cache option, it actually lead me into the right direction:
Cache was already activated, but one of the accounts wasn't "ticked" as active:

I didn't notice that, because like in the screenshots submitted earlier, I was perfectly able to select and view statistics for both accounts, despite one of them being disabled in the settings. This seem like inconsistent behavior here... However, after enabling both accounts, the "All accounts" option appeared and is working well.
So, while there still seem to be an issue/inconsistency with the "Active Accounts" preferences, my original issue is know solved :-)
Feel free to close this issue, or keep it open to track the inconsistency. Thanks again!

Thanks, while it wasn't the cache option, it actually lead me into the right direction:
Cache was already activated, but one of the accounts wasn't "ticked" as active:

I didn't notice that, because like in the screenshots submitted earlier, I was perfectly able to select and view statistics for both accounts, despite one of them being disabled in the settings. This seem like inconsistent behavior here... However, after enabling both accounts, the "All accounts" option appeared and is working well.
So, while there still seem to be an issue/inconsistency with the "Active Accounts" preferences, my original issue is know solved :-)
Feel free to close this issue, or keep it open to track the inconsistency. Thanks again!

I see, that's indeed another bug you discovered here 😅 Normally, all non-local accounts are disabled by default in the add-on options. I'll take a look into this and close this issue when fixed. Thanks again 👍🏻

I see, that's indeed another bug you discovered here 😅 Normally, all non-local accounts are disabled by default in the add-on options. I'll take a look into this and close this issue when fixed. Thanks again 👍🏻

I fixed it now with #210. The issue you encountered affected all users, who have two accounts where one account is local. Account lists should be properly initiated now.

I fixed it now with #210. The issue you encountered affected all users, who have two accounts where one account is local. Account lists should be properly initiated now.


[EOEPCA/IAM] Update installation guide

The manual steps need to be added to the installation guide, i.e.

Create realm
Configure GitHub as an IdP
Create OPA client
Details like realm name and client names should also be added.

The standard installation process should be based on the new overall Helm chart instead of the single component Helm charts. However, the latter should still be covered for completeness.
Furthermore, the content of the installation guide is currently repeated multiple times, which needs to be fixed.

Note that these aspects in the Deployment Guide (2.0-beta branch) may be relevant...

Realm - https://eoepca.readthedocs.io/projects/deploy/en/2.0-beta/building-blocks/iam/#5-keycloak-post-deployment-configuration
GitHub IdP - https://eoepca.readthedocs.io/projects/deploy/en/2.0-beta/building-blocks/iam/#b-add-github-as-a-keycloak-identity-provider
OPA Client - https://eoepca.readthedocs.io/projects/deploy/en/2.0-beta/building-blocks/iam/#a-create-keycloak-client-for-opa


Added another link - Coding Girls to index.md

Added another link - Coding Girls https://www.coding-girls.com/

[x] I have read freeCodeCamp's contribution guidelines.
[x] My pull request has a descriptive title (not a vague title like Update index.md)
[x] My pull request targets the master branch of freeCodeCamp.
[x] None of my changes are plagiarized from another source without proper attribution.
[x] My article does not contain shortened URLs or affiliate links.

If your pull request closes a GitHub issue, replace the XXXXX below with the issue number.
Closes #XXXXX

I just added another link - Coding Girls https://www.coding-girls.com/


Add azb support

Adds azb support in the following format: azb://<container>/<path>?<query>

@eneskuluk, can you please add the following copyright line in the license header to all the changed files? Thanks.
* @copyright Copyright (c) 2023 dātma, inc™


require('memoizee/profile') but not access will affects performance?

Yes, it will, it immediately attaches the logger, and from now on data usage is being collected

it will be nice to provide profile.start(), so we can open/close this feature by a config online.

@atian25 It sounds reasonable, I'll take that into consideration for next version

any news for this?

@atian25 at this point I don't have time to handle that. It's likely to happen may-june.

ok, I'm trying to use lazy require to workaround this.

Let's keep it open, I'd like to address that


replaced %str for the new shiny f-strings, and removed some trailing…

… whitespace
Signed-off-by: Bendik Egenes Dyrli<EMAIL_ADDRESS>

Hi,
Thank you for your contribution! We included standard string formatting in #42 for the v1.0.0 release.


Replace the use of **2.0 with ^2

The two are semantically equivalent, however the former is much more costly than the later.

Merged after approval of pull request #54


Adding COUNT DISTINCT with tests

CLA is valid!

Coverage increased (+0.2%) to 99.121% when pulling 3dc86b22845fb4ad2542093680a0a5d3b28d64cd on count-distinct-aggregation into 574f2d89c1aef997f05746f89c3ce163a52168a4 on master.

Coverage increased (+0.2%) to 99.026% when pulling 7b83f50ba4c3471b343360bf5d46880abc7ad0bb on count-distinct-aggregation into 574f2d89c1aef997f05746f89c3ce163a52168a4 on master.

Coverage increased (+0.2%) to 99.026% when pulling 53e1f1c5b755715b8813d2c3aa7df3fbd08dff7b on count-distinct-aggregation into 574f2d89c1aef997f05746f89c3ce163a52168a4 on master.

Coverage increased (+0.2%) to 99.026% when pulling 9c020717e49c247652beef9ae58b69be36f92fdf on count-distinct-aggregation into 574f2d89c1aef997f05746f89c3ce163a52168a4 on master.


SP Calls to remote DB returning SQLSTATE 466 on fetchAll()

We're trying to call Stored Procedures when connecting to a remote system (DRDA) instead of *LOCAL. We're using prepare(), bind(), execute(), fetchAll(). The execute() works and am getting the expected return parameter (it's correctly being changed). But the call to the fetchAll() is returning SQLSTATE 466 and no result set is available.
This same call works fine when connecting to the *LOCAL DB.

Hello @krisbaehr ,
SQLSTATE 466 should be a successful indicator.
Would you enable the debug mode and collect the output? Then I can identify in which API the 466 code is returned. And if you can show me the Stored Procedure, that would be more helpful.

SQLSTATE Value
Meaning
SQLCODE Values

0100C
One or more ad hoc result sets were returned from the procedure.
+466

@dmabupt Here is some additional info. I can't provide the code for the SP, but any SP call that returns a result set is problematic when connecting to a remote db.
SP call
`const {
dbconn, dbstmt, INOUT, IN, OUT, CHAR, CLOB,
} = require('idb-connector');
const sql = 'CALL LIB.MYSP(?,?)';
const connection = new dbconn();
connection.conn('remotedb', 'user', 'pass');
const statement = new dbstmt(connection);
connection.debug(true);
const gAct = 'RD';
const srLocn = 'RRT';
statement.prepare(sql, () => {
statement.bindParam([
[gAct, INOUT, CHAR],
[srLocn, IN, CHAR],
], () => {
statement.execute((out, err) => {
if (err) {
console.error(err);
} else {
for (let i = 0; i < out.length; i += 1) {
console.log(out[i]);
}
statement.fetchAll((result, err) => {
if (result) {
console.log(Result is : ${JSON.stringify(result)});
} else {
console.log(Error is : ${JSON.stringify(err)});
}
statement.close();
connection.disconn();
connection.close();
});
}
});
});
});
`
PuTTY Output
OK
Error is : {}
SQLDisconnect: conn obj [18034c4f0] handler [2]
SQLFreeConnect: conn obj [18034c4f0] handler [2]
SQLFreeConnect[0]
baehk@development [/home/BAEHK/node/projects/conntest]

Unfortunately I still can not recreate the issue by now. If you have XMLSERVICE installed, you could try this script --
const {
  dbconn, dbstmt, IN, OUT, CHAR, CLOB,
} = require('idb-connector');

const sql = 'CALL QXMLSERV.iPLUGR512K(?,?,?)';
const connection = new dbconn();
connection.conn('SS1BLD1', 'XUMENG', 'PASSWORD');
const statement = new dbstmt(connection);

const ipc = '*NA';
const ctl = '*here';
const xmlIn = `<xmlservice><sh>system 'wrksbs'</sh></xmlservice>`;

statement.prepare(sql, () => {
  statement.bindParam([
    [ipc, IN, CHAR],
    [ctl, IN, CHAR],
    [xmlIn, IN, CLOB]
  ], () => {
    statement.execute(() => {
      statement.fetchAll((result) => {
        console.log(result);
        statement.close();
        connection.disconn();
        connection.close();
      });
    });
  });
});

The result set should be retrieved correctly from the remote database.
And would you show me more debugging log please? The number in the braces indicates the first failed API call. For example, SQLConnect(0), SQLPrepare(-1) ... Like below --
SQLConnect(0): conn obj [180444350] handler [2]
Prepare().
SQLPrepare(-1): CALL QXMLSERV.iPLUGR512K(?,?,?,?)

 **** ERROR *****
SQLSTATE: 42884
Native Error Code: -440
Routine IPLUGR512K in QXMLSERV not found with specified parameters.

BindParamAsync().
SQLDescribeParam(-1)
Execute().
SQLExecuteAsync(-1):
FetchAllAsync()

Hey, @dmabupt.  IBM is working on a fix for this that was (I believe) recently introduced. If fixed, I'll let you know.

@dmabupt We were able to apply IBM's fix for this today and it works. Thanks!

@krisbaehr

@abmusse I'm not entirely sure what IBM's fix was. I think it had something to do with a cursor getting closed too early, but couldn't say for sure.


[Forge 1.20.1] Game not loading

Disabling the mod fixes it.
Log:
latest.log
(Also, it'd be nice if this tracker was linked on the CF page's navbar).

From what I can see in the log file, this crash is caused by a problem with the Thermal Foundation integration.
As a temporary fix, you can try disabling it manually in the jerintegration-client.toml config file.

After testing with Thermal Series I can't reproduce the problems, do you have a CurseForge modpack archive?

I tested things further and I found that Galosphere adds a biome that can't be got from JER, I can't do anything about it.

After testing with Thermal Series I can't reproduce the problems, do you have a CurseForge modpack archive?

I'm still working on the modpack, but I can send it if you want.

I tested things further and I found that Galosphere adds a biome that can't be got from JER, I can't do anything about it.

Alright, I can tell them about it.

Are there any news on this?


Write content for the provide filing details step

Task
Write introduction text for the provide filing details step.
Context
In this step a filer is asked to provide information that is specific to the filing. This currently includes voluntary reporter status and filing point of contact information.
The information provided on this page meets the following criteria:

Is always user supplied
Is requested for every filing
Does not live in the financial institution profile

Parent story (for reference)

As a filer, I want a clear and concise introduction on the provide filing details page, so that I can understand what filing details includes, why I need to provide it, and ensure that I can enter the information correctly to avoid filing issues.

@natalia-fitzgerald Do you want to track the content adjustments in Figma only?

@angelcardoz @dan-padgett
We have one more piece of content work in order to complete this work. This will have to be updated to point to provide filing details.

@natalia-fitzgerald Is it better to say "your institution's voluntary reporter status" instead of just "your voluntary reporter status"? I also like keeping the clarification about who might contact the institution, as in the original. Putting that together, we could have: "Next, indicate your institution's voluntary reporter status and provide contact information for a person whom the CFPB or other regulators may contact about your filing."
We could simplify further: "Next, indicate your institution's voluntary reporter status and contact information for a person whom the CFPB or other regulators may contact about your filing." (Or replace "indicate" with "provide" if that reads better.)

@dan-padgett
Yep, I agree with that suggestion. I reworked this to accommodate that text and to keep it to 2 lines (to align with the other cards).
Here's where we've landed:

This work is completed.


Add a filter/validation fn that can async confirm an id before it's returned

Maybe reserve a space e.g. "id_000000*" or allow an external service to be called to confirm uniqueness

on second thought, this is farrr outside scope of this lib.


FreeDNS Afraid.org

What provider would you like to see added to NPM?
freeDNS (afraid.org)
Have you checked if a certbot plugin exists?
Appears to be one here: https://gist.github.com/AnthonyWharton/a0e8faae7195a5c1dea210466eda1c92

The link you cited shows a script, not a certbot plugin.
Guess you need to create a certbot plugin for FreeDNS prior to inclusion into npm.

Will Python certbot plugins be acceptable? There is one that is publicly available through pip installation that works for my custom stealth domain on FreeDNS using the examples and command lines listed in the Project README.
FreeDNS Python certbot plugin project link:
https://github.com/schleuss/certbot_dns_freedns
If not, is there anyway to import an existing Let's Encrypt cert that has already been requested and setup for certbot renewal? The block on importing Let's Encrypt certs stop people from using ones they have gotten though means other than requesting through the frontend. I did a hacky workaround of adding another test cert and then replacing the pem files with symlinks to the ones in /etc/letsencrypt/live directory. I would really like to not have to result to these kind of workarounds just because this project doesn't support a plugin for my DNS providers AND blocks manual install of the Let's Encrypt certs I get though other means.

@bricas I just submitted a PR that would fix the current version that doesn't work for all people that are not paid subscriber. see #3750 if you can take a look please :)


Include a comment at the top of generated modules

Hello!
I was looking at my project on GitHub and I realised it's not clear that these files are generated, and someone might accidentally edit them.
A comment could help here. In Go it's common to see comments like this:
// Code generated by stringer -type Pill pill.go; DO NOT EDIT.

Good point! Easily done. I'll have a look.

Done in 0.10.0. Currently looks like:
// DO NOT EDIT: Code generated by templates from for_as_loop.gleamx

I realise the project name does not help in the parsing of the sentence but hopefully we'll have a better one at some point.

Thank you 💜


bazel: 0.28.0 -> 0.28.1

Motivation for this change
https://github.com/bazelbuild/bazel/compare/0.28.0...0.28.1
Things done

[ ] Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS)
Built on platform(s)

[x] NixOS
[ ] macOS
[ ] other Linux distributions

[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[ ] Tested compilation of all pkgs that depend on this change using nix-shell -p nix-review --run "nix-review wip"
[ ] Tested execution of all binary files (usually in ./result/bin/)
[ ] Determined the impact on package closure size (by running nix path-info -S before and after)
[ ] Ensured that relevant documentation is up to date
[x] Fits CONTRIBUTING.md.

Notify maintainers
cc @Profpatsch @guibou

@GrahamcOfBorg build bazel bazel.tests

Tested locally on Linux & Darwin. Works great!

Yet, the tests fail. I’m tempted to revert.

Tested locally on Linux & Darwin. Works great!

Ah, you mean you ran the tests on a local Darwin setup? I remember we had problems with the Darwin bazel build on the nixpkgs CI before, is this the same?

@Profpatsch yes precisely. Darwin is still unstable so I built bazel and bazel.tests on both Linux & Darwin and it worked well. I also checked the changes upstream, was just a logical change in the java code with no changes to the dependencies.


String: Group Anagrams in Python

https://leetcode.com/problems/group-anagrams/

I'll take this up


Add script that evaluates mesh model on our grants

Codecov Report

Merging #29 into master will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master      #29   +/-   ##
=======================================
  Coverage   34.07%   34.07%
=======================================
  Files          20       20
  Lines        1033     1033
=======================================
  Hits          352      352
  Misses        681      681

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 844ab41...dc7121e. Read the comment docs.

 Evaluate disease mesh tagger on a sample of our grants tagged from annotators by mapping ICD codes to Mesh codes

Looks good. What is the result? Maybe update the documentation with the current results?

Good point, let me see where best to add it. The result was 69% micro f1 which is impressive since the model performed 56% on the test set but it is partly explained by the non blind process i.e. Kirstin was looking at the model predictions and sometimes agreeing


Updating baseline JDK version to JDK-21

Description
Updating baseline JDK version to JDK-21
Related Issues
Resolves #[Issue number to be closed when this PR is merged]

Check List

[ ] New functionality includes testing.
[ ] New functionality has been documented.
[ ] API changes companion pull request created.
[ ] Commits are signed per the DCO using --signoff.
[ ] Public documentation issue/PR created.

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

merge to unblock others, create a issue to fix CI failures on security test flow.


Release new version to NPM?

Hey!
The last version of this plugin released on NPM is 2.7.1,  but the latest version in this repo is 3.0.13.
Can we get a new version on NPM?

Ping @tim-kos and @kvz, as the listed package publishers on NPM.

Sorry for the delay and thanks for the headsup @louim @tim-kos has this on his radar!
In the meantime I'd also like to invite you to check out Uppy, most of Transloadit's love and care is going there these days, and it could improve speed, reliability, and ux for your users.

Hi @kvz, we have been eyeing Uppy, but it required a bit more internal refactoring that we had the bandwith to do right now. We will definitely look more into it in the future.

The trouble is that a different person published a fork under that npm name: https://github.com/k41n/jquery-sdk
We need to ask them to pull from upstream and update publish a new version.

@tim-kos You could rename the package.json to match the name of the package you have control of (this one: https://www.npmjs.com/package/transloadit-jquery)  instead of pushing it to https://www.npmjs.com/package/transloadit-jquery-sdk. Or you could publish in under an org name, for example @transloadit/jquery-sdk.


Hovering on setting should show its id

Testing #52859
Expected to see the setting id when I hover on a setting

It does on the title, where are you hovering?

Yes, I see it. Sorry.


HFSM dynamic timer period does not behave as expected

currenlty the timer is reset when the new period is set. Possible invoke setPeriod with reset=false.
http://docs.ros.org/jade/api/roscpp/html/classros_1_1Timer.html#afbb274e16e76be4dcfb301ad598f7d00

This issue was moved to rosmod/webgme-rosmod#263


librealsense2-dkms v1.3.22 does not install on kernel v5.15.0-24-lowlatency

| Camera Model                       | D400 |
| Firmware Version                   | (Open RealSense Viewer --> Click info) |
| Operating System & Version |   Ubuntu 22.04 |
| Kernel Version (Linux Only)    | 5.15.0-24-lowlatency  |
| Platform                                 | PC |
Issue Description
We're installing librealsense2-dkms in a chroot environment set up for 5.15.0-24-lowlatency.
librealsense2-dkms v1.3.19 installs, while librealsense2-dkms v1.3.22 does not.
Is this a bug, or is support for kernel version 5.15 being deprecated? We've had no issues with the drivers on lowlatency prior.
Building for 5.15.0-24-lowlatency
/bin/bash: warning: setlocale: LC_ALL: cannot change locale (en_US.UTF-8)
Building initial module for 5.15.0-24-lowlatency
/bin/bash: warning: setlocale: LC_ALL: cannot change locale (en_US.UTF-8)
ERROR: Cannot create report: [Errno 17] File exists: '/var/crash/librealsense2-dkms.0.crash'
Error! Application of patch 92-realsense-hid-5.15.patch failed.
Check /var/lib/dkms/librealsense2-dkms/1.3.22/build/ for more information.
dpkg: error processing package librealsense2-dkms (--configure):
 installed librealsense2-dkms package post-installation script subprocess returned error exit status 6
Processing triggers for man-db (2.10.2-1) ...
Errors were encountered while processing:
 librealsense2-dkms
E: Sub-process /usr/bin/dpkg returned an error code (1)

It is a bit different environment, but anyway I got the same error Error! Application of patch 92-realsense-hid-5.15.patch failed.. My environment is as follow:

Host machine: Ubuntu 22.04 (kernel version 5.19.0-50-generic)
Docker container: ubuntu:jammy

After several debuggings, I found that linux header in the docker container was actually linux-headers-5.15.0-78, which is different from the kernel version.
So I ran apt-get install linux-headers-$(uname -r) and installed linux-headers-5.19.0-50-generic. Then librealsense2-dkms can be installed without errors.

By the way I had the same error when I was using ubuntu 22.04 server (linux kernel 5.15.0), and in this case I couldn't install librealsense2-dkms even in the host machine. I had to use librealsense2-dkms v1.3.19 as you described above.

Thanks so much @ynyBonfennil for kindly offering advice to @twahrburg-google   :)
Hi @twahrburg-google   Does the above advice from @ynyBonfennil solve your problem, please?  Thanks!

@MartyG-RealSense Unfortunately, it does not. Thank you for insight though, @ynyBonfennil . I appreciate the testing. It provided useful information.
We could look at upgrading from Kernel v5.15 to v5.19 if necessary. We'd prefer not deviating too far from our current kernel version to not potentially break other drivers, and libraries. We'll upgrade if v5.15 will no longer be supported for Realsense going forward. We'd appreciate advice on what kernel version to target if we should upgrade our kernel.

5.15 will continue to be supported.  It is the most recent officially supported kernel at the time of writing this, and support for newer kernels is added in future RealSense SDK releases.  If you are currently using 5.15 then I recommend continuing to do so.

Yes. v1.3.22 of librealsense2-dkms v1.3.22 doesn't install on v5.15.0-24-lowlatency. Should I expect this is something that will be resolved in v1.3.23+?

I will attempt to build from source.

I'm able to build the SDK from source using the  -DFORCE_RSUSB_BACKEND=TRUE flag. Will I be able to build the DKMS module from source?

DKMS are packages rather than source code, so they cannot be built from source as they are already built.

It appears that 92-realsense-hid-5.15.patch is failing to be applied as the files it's attempting to patch has already been patched in v1.3.22
I unpacked the deb files for both librealsense2-dkms_1.3.19-0ubuntu1_all and librealsense2-dkms_1.3.22-0ubuntu1_all
`
diff  --suppress-common-lines -c  librealsense2-dkms_1.3.19-0ubuntu1_all/data/usr/src/librealsense2-dkms/5.15.0/drivers/iio/accel/hid-sensor-accel-3d.c librealsense2-dkms_1.3.22-0ubuntu1_all/data/usr/src/librealsense2-dkms/5.15.0/drivers/iio/accel/hid-sensor-accel-3d.c
*** librealsense2-dkms_1.3.19-0ubuntu1_all/data/usr/src/librealsense2-dkms/5.15.0/drivers/iio/accel/hid-sensor-accel-3d.c	2021-10-31 13:53:10.000000000 -0700
--- librealsense2-dkms_1.3.22-0ubuntu1_all/data/usr/src/librealsense2-dkms/5.15.0/drivers/iio/accel/hid-sensor-accel-3d.c	2023-05-28 05:04:07.000000000 -0700

*** 280,285 ****
--- 280,286 ----
hid_sensor_convert_timestamp(
&accel_state->common_attributes,
*(int64_t *)raw_data);

  ret = 0;

break;
default:
break;

diff  --suppress-common-lines -c  librealsense2-dkms_1.3.19-0ubuntu1_all/data/usr/src/librealsense2-dkms/5.15.0/drivers/iio/gyro/hid-sensor-gyro-3d.c librealsense2-dkms_1.3.22-0ubuntu1_all/data/usr/src/librealsense2-dkms/5.15.0/drivers/iio/gyro/hid-sensor-gyro-3d.c
*** librealsense2-dkms_1.3.19-0ubuntu1_all/data/usr/src/librealsense2-dkms/5.15.0/drivers/iio/gyro/hid-sensor-gyro-3d.c	2021-10-31 13:53:10.000000000 -0700
--- librealsense2-dkms_1.3.22-0ubuntu1_all/data/usr/src/librealsense2-dkms/5.15.0/drivers/iio/gyro/hid-sensor-gyro-3d.c	2023-05-28 05:04:07.000000000 -0700

*** 231,236 ****
--- 231,237 ----
gyro_state->timestamp =
hid_sensor_convert_timestamp(&gyro_state->common_attributes,
*(s64 *)raw_data);

  ret = 0;

break;
default:
break;
`

`
cat 92-realsense-hid-5.15.patch
From b8e6c4a6bf5cfd1064a0d0acdb61e40b7bdf10c9 Mon Sep 17 00:00:00 2001
From: Dmitry Perchanov<EMAIL_ADDRESS>Date: Thu, 27 Oct 2022 18:52:51 +0300
Subject: [PATCH] fix the retval in [accel|gyro]_3d_capture_sample Module
version realsense2-dkms to track changes Authored by: Yu MENG
<EMAIL_ADDRESS>Signed-off-by: Dmitry Perchanov<EMAIL_ADDRESS>5.15.0/drivers/iio/accel/hid-sensor-accel-3d.c | 2 ++
5.15.0/drivers/iio/gyro/hid-sensor-gyro-3d.c   | 2 ++
2 files changed, 4 insertions(+)
diff --git a/5.15.0/drivers/iio/accel/hid-sensor-accel-3d.c b/5.15.0/drivers/iio/accel/hid-sensor-accel-3d.c
index a2def6f..5df6c69 100644
--- a/5.15.0/drivers/iio/accel/hid-sensor-accel-3d.c
+++ b/5.15.0/drivers/iio/accel/hid-sensor-accel-3d.c
@@ -280,6 +280,7 @@ static int accel_3d_capture_sample(struct hid_sensor_hub_device *hsdev,
hid_sensor_convert_timestamp(
&accel_state->common_attributes,
*(int64_t *)raw_data);

  ret = 0;

break;
default:
break;
@@ -461,3 +462,4 @@ MODULE_DESCRIPTION("HID Sensor Accel 3D");
MODULE_AUTHOR("Srinivas Pandruvada srinivas.pandruvada@intel.com");
MODULE_LICENSE("GPL");
MODULE_IMPORT_NS(IIO_HID);
+MODULE_VERSION("realsense2-dkms");
diff --git a/5.15.0/drivers/iio/gyro/hid-sensor-gyro-3d.c b/5.15.0/drivers/iio/gyro/hid-sensor-gyro-3d.c
index 8f0ad02..ba5a536 100644
--- a/5.15.0/drivers/iio/gyro/hid-sensor-gyro-3d.c
+++ b/5.15.0/drivers/iio/gyro/hid-sensor-gyro-3d.c
@@ -231,6 +231,7 @@ static int gyro_3d_capture_sample(struct hid_sensor_hub_device *hsdev,
gyro_state->timestamp =
hid_sensor_convert_timestamp(&gyro_state->common_attributes,
*(s64 *)raw_data);

  ret = 0;

break;
default:
break;
@@ -395,3 +396,4 @@ MODULE_DESCRIPTION("HID Sensor Gyroscope 3D");
MODULE_AUTHOR("Srinivas Pandruvada srinivas.pandruvada@intel.com");
MODULE_LICENSE("GPL");
MODULE_IMPORT_NS(IIO_HID);
+MODULE_VERSION("realsense2-dkms");
--
2.37.1

`

I will highlight your issue in the coming week to my Intel RealSense colleagues.  In the meantime, the best available option may be to continue with the RSUSB source code version of librealsense or try a different 5.15 kernel version if your project allows it to see whether there is a conflict with your lowlatency kernel version specifically (as 5.15 kernels usually work fine).

@MartyG-RealSense Any updates?

I was able to get v1.3.22 of the dkms module to install by unpacking the deb package, modifying ./usr/src/librealsense2-dkms-1.3.22/dkms.conf  line 40:
From:
PATCH[2]="92-realsense-hid-5.15.patch"
To:
PATCH[2]=""
I then repackaged, and was able to install with dpkg.
root@wahrburg:/# mkdir librealsense2-dkms_1.3.22-0ubuntu1_all
root@wahrburg:/# dpkg-deb -x librealsense2-dkms_1.3.22-0ubuntu1_all.deb librealsense2-dkms_1.3.22-0ubuntu1_all
root@wahrburg:/# dpkg-deb --control librealsense2-dkms_1.3.22-0ubuntu1_all.deb librealsense2-dkms_1.3.22-0ubuntu1_all/DEBIAN
root@wahrburg:/# vim librealsense2-dkms_1.3.22-0ubuntu1_all/usr/src/librealsense2-dkms-1.3.22/dkms.conf
root@wahrburg:/# dpkg -b librealsense2-dkms_1.3.22-0ubuntu1_all librealsense2-dkms_1.3.22-0ubuntu1_all_mod.deb
dpkg-deb: building package 'librealsense2-dkms' in 'librealsense2-dkms_1.3.22-0ubuntu1_all_mod.deb'.

I had highlighted your issue to my Intel RealSense colleagues.  It's great to hear that you found a solution and I will let my colleagues know.  Thanks very much for the update!

Hi @twahrburg-google
Next time you can tag me so I will be notified.
We submitted HID bugfix to kernel tree and it was applied to all kernels with this bug.
All later minor releases had this bugfix and our dkms failed.
There is no much difference in 1.3.19 and 1.3.22, we updated for newer SKU's and new formats.
We updated this issue and it will be available on version 1.3.24
Regards,
Dmitry Perchanov.

@dmipx @MartyG-RealSense Glad to hear. We currently have our workstations pinned to v1.3.19, and will update via APT when 1.3.24 becomes available. I mainly wanted to create this issue to ensure we'd be able to update in the future, and it looks like we will. We didn't noticed much difference with the 1.3.22 hack, so we'll simply wait for the next official release. Thanks so much! :)

@twahrburg-google  You are very welcome!

Thanks so much @adamconkey for sharing the solution that worked for you in your situation!

Hi @twahrburg-google  Do you require further assistance with this case at this time, please?  Thanks!

Case closed due to no further comments received.


Latest chrome canary causes throws error

could not find matching B phase for E phase event coming from https://github.com/TracerBench/tracerbench/blob/de8e62347b85c2ae0ba8fb3298c008b989cc87c0/packages/tracerbench/src/trace/trace.ts#L257
is thrown when using the runner with chrome canary but not stable:
canary: Version 80.0.3964.0 (Official Build) canary (64-bit)
stable: Version 78.0.3904.97 (Official Build) (64-bit)

At the very least as a feature-add lets have the compare command include the version of chrome leveraged within the results

https://github.com/TracerBench/tracerbench/pull/94


Is there a way to not skip Enum(Struct) or Enum(Enum)?

Currently paperclip skips the
Enum{
Something ( something_else )
}
fields.
Is there a way to make the inner structure shows as a parameter?
example
 #[derive(Debug, Clone, Serialize, Deserialize, Apiv2Schema)]
pub enum DeviceManagerGetOptionsV1 {
    AutoCreate,
    List,
    Search,
    Request(some structure)
}

 #[api_v2_operation(tags("Device Manager"))]
#[get("device_manager/{selection}")]
async fn device_manager_get(
    manager_handler: web::Data<ManagerActorHandler>,
    selection: web::Path<DeviceManagerGetOptionsV1>,
) -> Result<Json<crate::device::manager::Answer>, Error> {
.....
}

Then, APIspec only shows the simple enums.
Is there a way to how the 'Request', and if it's selected, shows the strcuture field?

s there a way to how the 'Request', and if it's selected, shows the strcuture field?

What do you mean by "show the structure field" ?

s there a way to how the 'Request', and if it's selected, shows the strcuture field?

What do you mean by "show the structure field" ?

to not skip it,
make the enum route avaiable alongside with simple enums and make inner field avaiable as a parameter when we load the api spec on swager

On your enum, is "some structure" data you'd expect as input? Or more slashes in the path?
Can you share an example including the expected generated openapi code?


WMS ID 11250 - final version

WMS ID 11250
General requirements
done
Checklist - Refer to the QA document for the complete list
done
Oracle NoSQL powers Video On-Demand applications
This PR includes

Improving some instructions for a better user experience
Smoke test to determine that the workshop works
Adding Clean Up section
QA for screenshots and functionality
full testing of workshop end-2-end for OCW - instruction adapted to OCW timings

@klazarz   changes are completed and validated.


Pp 3450 epdq 3ds auth request

Create and handle an EPDQ 3ds authorise request. The request needs a extra fields on it to tell EPDQ the request is a 3ds authorise request. This includes some callback url that EPDQ will send the user to once 3ds has been completed. For now these are not confirmed and may need to change when we do the frontend logic for this. EPDQ will then return a response with a status of 46 and a new element containing some html. The html needs to be save. Then later on frontend will make a new request for the charge data and this needs to include the html.

Mapped the correct status code.
created a separated request builder for authorise 3ds (putting non-existent frontend URLs for now).
Map the response from EPDQ and add the new html to the entities above.
Add html to the response from connector.

I'll address the remaining in the next PR


Spray.io

Hi,
How can I deploy my web app using spray.io? it's using Scala and Sbt.
Thanks

Thanks for your question!  I'll try to find someone who can answer your question.

@omidb Hi Omid, thanks for filing this issue. We’re happy to respond to issues that are directly related to documentation feedback in this repo. I think this question goes beyond that scope, so I'm going to close the issue. StackOverflow might be a good place to ask this question.


fix google oauth feature key

based on https://docs.flagsmith.com/deployment/overview it should be oauth_google instead of oauth-google

Thanks!


only set session cookie if sendEmailVerificationOnSignUp is falsy

Allowing unverified email addresses to login can lead to various vulnerability issues/risks. This implements mandatory email verification before they can sign in when sendEmailVerificationOnSignUp is true.

I don't think making email verification a strict default is the expected experience. It's often better to allow users to access a session even if their email isn't verified, leaving it up to the app to enforce restrictions on certain features until verification is complete. And If you block session creation during signup, you'd also have to handle preventing sessions at login for unverified emails, which adds unnecessary complexity.


SID/Symbol/Asset management

Now that zipline has Asset objects, there needs to be some way of managing it and also defining when a numeric sid is acceptable vs object. Take for instance BarData, for parity with quantopian it should be keyed by some Asset object, but data sources will most definitely come in keyed to some numeric. There has to be a translation layer or something that converts these into objects when necessary/available.
@jfkirk @ehebert

Seems like we probably need to port some version of SecurityFinder to Zipline?  Possibly associating it with TradingEnvironment?

@dalejung Within Zipline, it will be important within the perf tracker that the sids are Asset objects, so the logic can be pivoted on the asset_type. Alternatively, the perf tracker could treat all non-Asset sids as asset_type 1 (Equity).
@ssanderson That sounds right to me, but I'm not familiar with the SecurityFinder. Would there be any major dependencies?

Yeah it just needs to be defined and also exposed to zipline. For me, I have an instance where I want to pre-warm the BarData object with SIDData objects, but on the zipline side there's no concept of a sid => SID translation. I suppose one could say that the switch occurs on the datasource level, so if the datasource doesn't know about Asset objects, then the entire system should not. That's yuck though.
It doesn't even have to be the Security finder per se, just an api that Security finder hooks into.

What would the input/output of that API be? Something like the following?
def get_asset(sid):
   asset = ...# Get Security, Future, etc.
   return asset

To be used as the following?
assets = [get_asset(sid) for sid in universe]
bar_data.index = assets

at a base level with some caching. the instrument management is a much bigger thing once you add point in time and matching on multiple identifiers. but that's all out of scope for zipline.
btw. too late to rename asset to instrument ?
—
Sent from mobile
On Thu, Mar 19, 2015 at 1:18 PM, Eddie Hebert<EMAIL_ADDRESS>wrote:

What would the input/output of that API be? Something like the following?
def get_asset(sid):
   asset = ...# Get Security, Future, etc.
   return asset

To be used as the following?
assets = [get_asset(sid) for sid in universe]
bar_data.index = assets

Reply to this email directly or view it on GitHub:
https://github.com/quantopian/zipline/issues/537#issuecomment-83676429

We have ported the asset finder to zipline and zipline now uses Asset objects where possible. We are trying to finish cleaning up the last of the int/asset issues.

Hi, I have the following problem. Is it possible to convert a string like 'Equity(42 [AMD])' to Asset object?