CapturePanic not sending packets

I've hit a weird issue where if I use raven.CapturePanic, no data is sent to the sentry server if log.Panic is called. I am not sure why this happens, but it seems like a bug.
Environment:

OS: Max OS X
Go Version: 1.4.2
raven-go version/commit: e39495f
SENTRY_DSN env var is configured

Example Code:
import (
    "log"
    "github.com/getsentry/raven-go"
)

func main() {
    raven.CapturePanic(func() {
        log.Panic("My Panic")
    }, nil)
}

When running this code, no exception occurs in my Sentry server. Digging into the raven codebase on my local machine, I added some print statements in client.go:Capture:
func (client *Client) Capture(packet *Packet, captureTags map[string]string) (eventID string, ch chan error) {
    if client == nil {
        log.Print("NIL CLIENT")
        return
    }

    // Keep track of all running Captures so that we can wait for them all to finish
    // *Must* call client.wg.Done() on any path that indicates that an event was
    // finished being acted upon, whether success or failure
    client.wg.Add(1)

    ch = make(chan error, 1)

    // Merge capture tags and client tags
    packet.AddTags(captureTags)
    packet.AddTags(client.Tags)
    packet.AddTags(client.context.tags)

    // Initialize any required packet fields
    client.mu.RLock()
    projectID := client.projectID
    release := client.release
    client.mu.RUnlock()

    err := packet.Init(projectID)
    if err != nil {
        ch <- err
        client.wg.Done()
        return
    }
    packet.Release = release

    outgoingPacket := &outgoingPacket{packet, ch}

    select {
    case client.queue <- outgoingPacket:
    default:
        log.Print("PACKET DROP")
        // Send would block, drop the packet
        if client.DropHandler != nil {
            client.DropHandler(packet)
        }
        ch <- ErrPacketDropped
        client.wg.Done()
    }

    log.Print("DUN CAPTURE")
    return packet.EventID, ch
}

I also added a print statement in `client.go:worker()':
func (client *Client) worker() {
    for outgoingPacket := range client.queue {

        log.Print("outgoing packet")
        client.mu.RLock()
        url, authHeader := client.url, client.authHeader
        client.mu.RUnlock()

        outgoingPacket.ch <- client.Transport.Send(url, authHeader, outgoingPacket.packet)
        client.wg.Done()
    }
}

Running the code with this setup, I get the following output:
2016/06/07 10:32:58 My Panic
2016/06/07 10:32:58 DUN CAPTURE

As you notice, there is no print statement for outgoing packet. This seems to indicate that the error message packet is not being added to the channel/client.queue and preventing the packet from being sent to the server before the program exits.

Is this related to #85 by any chance?

No, this is a separate issue.

John Ryding

On Jun 7, 2016, at 1:28 PM, Matt Robenolt<EMAIL_ADDRESS>wrote:
Is this related to #85 by any chance?
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub, or mute the thread.

Alright, I'll investigate this today and see what's going on.

Any updates on this? After more than 1 year this still happens. Is this project dead?

It's not dead, we just have nobody in house to work on it. If someone would like to submit a PR, I'd be happy to review.

My only guess here is CapturePanic should be happening async and not waiting for your program to exit. There are other API methods which do block. Try using CapturePanicAndWait instead.

Nice to get response. Thanks!
I debugged into the code, and found the reason of my case was SSL certificate problem. I used self-signed certificate and trusted it in OS level, but this library is using github.com/certifi/gocertifi which is not using OS certificates.
I forked this and removed github.com/certifi/gocertifi to solve my issue. If you are OK with it I can send PR.
https://github.com/liuyang1204/raven-go/commit/29da4ac72a0aa52ff6540eef5e38ad0d4be6000d
The essential problem is that the HTTP error is not informed anywhere so that I can only debug into the code. It should be logged at least to STDERR.

Ah, so that makes sense.
I'd accept a PR that made supplying certificates or some options around here a configurable option. The reason certifi was added in was because users were deploying their applications into containers without any system certificates, so figured it was pretty easy to just bundle them in with it.

I would like to submit a PR that outputs something when a packet cannot be delivered (it seems like I'm having exactly the same problems as @linusthe3rd), and just for future reference, a link to the actual commit with the responsible line - the problem is in the client's Capture method.
Gonna investigate further...


Issues to be closed following next release

The goal of this issue is to reference the issues that could be closed after the upcoming release:

[x] #137 Publish new version of pytest-verbose-parametrize to PyPI plz
[x] #110 Plugins incompatible with pytest 4, leads to ContextualVersionConflict
[x] #100 Pytest RemovedInPytest4Warning Warning
[x] #125 Please include wheels for modern Pythons
[x] #134 pytest-server-fixture: Update RethinkDB fixtures to support rethinkdb >= 2.4.0

Closing. 1.7.0 released :tada:
See https://github.com/manahl/pytest-plugins/releases/tag/v1.7.0


Component Registry

I've been working with Duct for about two months now – with two microservices in production – and I believe it's the best way I've seen yet for building webapps in Clojure. I've also made a few of my own duct components (for example: https://github.com/banzai-inc/ring-sentry-component), and noticed you've created a small suite already.
I wonder if a component registry (a section of the README or a Github wiki?) might help the cause? I'd happily contribute mine, or help keep a list...

Thanks for the vote of confidence! Your idea for a list of compatible components is a good one. The wiki seems the best place for it, as it can be edited independent of the repository, but I'll add a link to the README as well.
Would "Compatible Libraries" be a good title in your estimation?

Perfect!

Added a wiki page. Feel free to add in your own libraries.

Final question: Is a component like this appropriate for the list: https://github.com/banzai-inc/fixtures-component? It's not duct-oriented, per se, but it feeds into the purpose of duct – it's primary application is a web-app.
For example, I'm frequently including the ring-jetty-component in my duct applications. Is that not also relevant to a budding new duct user?

Yeah, any component would be good to add, as long as it isn't tied somehow to another framework.


Testing examples, road_following

Hello,
currently im trying out the given examples, until now everything worked out fine,
now when i try to go through the road following example i get the following error message:

OSError                                   Traceback (most recent call last)
<ipython-input-2-85080642f8f2> in <module>
----> 1 import torch
      2 import torchvision
      3
      4 CATEGORIES = ['apex']
      5

/usr/local/lib/python3.6/dist-packages/torch/__init__.py in <module>
    186     # See Note [Global dependencies]
    187     if USE_GLOBAL_DEPS:
--> 188         _load_global_deps()
    189     from torch._C import *
    190

/usr/local/lib/python3.6/dist-packages/torch/__init__.py in _load_global_deps()
    139     lib_path = os.path.join(os.path.dirname(here), 'lib', lib_name)
    140
--> 141     ctypes.CDLL(lib_path, mode=ctypes.RTLD_GLOBAL)
    142
    143

/usr/lib/python3.6/ctypes/__init__.py in __init__(self, name, mode, handle, use_errno, use_last_error)
    346
    347         if handle is None:
--> 348             self._handle = _dlopen(self._name, mode)
    349         else:
    350             self._handle = handle

OSError: /usr/lib/aarch64-linux-gnu/libgomp.so.1: cannot allocate memory in static TLS block

when trying to run following code:
import torch
import torchvision

CATEGORIES = ['apex']

device = torch.device('cuda')
model = torchvision.models.resnet18(pretrained=False)
model.fc = torch.nn.Linear(512, 2 * len(CATEGORIES))
model = model.cuda().eval().half()

i already tried restarting, resaving the model i trained and this command
export LD_PRELOAD=/usr/lib/aarch64-linux-gnu/libgomp.so.1
how can i solve this error message?

 I am having the same issue.

same issue here....

same issue here....

Try importing cv2 before import torch and torchvision as it helped me.
import cv2
import torch
import torchvision
CATEGORIES = ['apex']
device = torch.device('cuda')
model = torchvision.models.resnet18(pretrained=False)
model.fc = torch.nn.Linear(512, 2 * len(CATEGORIES))
model = model.cuda().eval().half()

i have this error after adding cv2
AttributeError: module 'torch' has no attribute '_six'


Update scala-library to 2.12.17

Updates org.scala-lang:scala-library from 2.12.15 to 2.12.17.
GitHub Release Notes - Version Diff
I'll automatically update this PR to resolve conflicts as long as you don't change it yourself.
If you'd like to skip this version, you can just close this PR. If you have any feedback, just mention me in the comments below.
Configure Scala Steward for your repository with a .scala-steward.conf file.
Have a fantastic day writing Scala!

Adjust future updates
Add this to your .scala-steward.conf file to ignore future updates of this dependency:
updates.ignore = [ { groupId = "org.scala-lang", artifactId = "scala-library" } ]

Or, add this to slow down future updates of this dependency:
dependencyOverrides = [{
  pullRequests = { frequency = "@monthly" },
  dependency = { groupId = "org.scala-lang", artifactId = "scala-library" }
}]

labels: library-update, early-semver-patch, semver-spec-patch, commit-count:1

Codecov Report
Base: 95.38% // Head: 95.38% // No change to project coverage :thumbsup:

Coverage data is based on head (8bca303) compared to base (4399542).
Patch has no changes to coverable lines.

:mega: This organization is not using Codecov’s GitHub App Integration. We recommend you install it so Codecov can continue to function properly for your repositories. Learn more
Additional details and impacted files
@@           Coverage Diff           @@
##           master     #339   +/-   ##
=======================================
  Coverage   95.38%   95.38%
=======================================
  Files           6        6
  Lines          65       65
  Branches        3        3
=======================================
  Hits           62       62
  Misses          3        3

Flag
Coverage Δ

2.12.15
?

2.12.17
95.31% <ø> (?)

2.13.8
95.31% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.
Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

:umbrella: View full report at Codecov.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.


why use express-jwt  and use jsonwebtoken?

"express-jwt": "~0.2.1",
"jsonwebtoken": "~0.4.0",

Good question... I think I tried both and ended up keeping them. My bad.
But to be honest, a lot of things are done wrong in that project. It was quite a long time ago and probably my first nodejs project :)


Add new methods for header parsing / Add HttpContext

Helps solving: #243
Fixes part of: #253
Warning: depends on new IO branch

Needs a rebase. Closing for now.


PFObject doesn't allow NSNull values

Contrary to documentation and the provided error message, PFObject (and PFUser) doesn't allow explicit NSNull values when set from an NSDictionary.
example code:
-(void)codeToTest {
    PFObject *testObject = [PFObject objectWithClassName:@"Foo"];
    [testObject setValuesForKeysWithDictionary:@{@"a": @"b",
                                               @"foo": [NSNull null]}];
    [testObject save];
}

Exception:
*** Terminating app due to uncaught exception 'NSInvalidArgumentException', reason: 'Can't use nil for keys or values on PFObject. Use NSNull for values.'

This is quite interesting - it should indeed work, but what I think happens is that Foundation implementation converts the dictionary to a bunch of invocations to setValue:forKey: and uses 'nil' value.
Thanks for reporting this! Indeed looks like a valid bug, which means that fix is coming soon.

And huh - I was right, according to the documentation.

The default implementation invokes setValue:forKey: for each key-value pair, substituting nil for NSNull values in keyedValues.

Sending a fix in a bit so this is fixed.

Great, thank you! This is a big help for me safely setting objects based on variable remote data without having to write a million if statements. I appreciate it.

In the meantime, until the new version is released, there are few ways you can achieve this:

-removeObjectForKey: instead of using NSNull
+objectWithClassName:dictionary: which should work great
Iterate over the array and simply invoke setObject:forKey: or use literal syntax to set the objects for keys.


How to disable tracking and validation?

How do I do this in EF 7?
context.Configuration.AutoDetectChangesEnabled = false;
context.Configuration.ValidateOnSaveEnabled = false;

Validation does not exist in EF Core (formerly EF7), so no need to change that one.
context.ChangeTracker.AutoDetectChangesEnabled is the one you are after, though we do this a lot less often in EF Core... so you shouldn't need to switch it off in most cases.

@rowanmiller Thank you for the information.

The case is that I don't want tracking to be on at all because tracking assumes that I have to fetch a whole entity from DB in order to change one or several properties and save it then. What I really want is just one operation, just one 'Update' method like it was realized in EF 6 EntityFramework.Extended.dll in BatchExtensions class. Why is it not still implemented in official EF?


Code that uses MatType built under 4.9 but not under 4.10

Summary of your issues
I just updated to the latest version of OpenCvSharp.   Suddenly my code no longer builds.  I don't know what the proper way to fix it is.  I cannot even find a discussion of the changes.
Under 4.9 (with .NET 8) this code built just fine (just the first part of a function listed
    public static unsafe Sdk.Image ToSdkImage(this Mat mat)
    {
        // Currently we're only handling a few pixel types.  Expand this later.

        switch (mat.Type())
        {
        case Cv.MatType.CV_32F:
            if (!mat.GetArray<float>(out var arr))
                throw new ArgumentException(nameof(mat));

However under 4.10,  The compiler does not like the case clause;  I get compiler error CS9135 "A constant value of type 'MatType' is expected"
Similarly under 4.9, this code builds
        var surface    = new Mat(hmHeightPx, hmWidthPx, MatType.CV_32FC1, hm.ImageData);
(where hmHeightPx and hmWidthPx are integers and hm.ImageData is of type  float[])
But under 4.0, I get compiler error CS0122 "'Mat.Mat(int, int, MatType, Array, long)' is inaccessible due to its protection level"
Environment
Windows 10.
Visual Studio 2022
.NET 8
C# 12
I have no idea what to do.  Do I make my switch statement switch on mat.Type().Depth instead?  What is the new valid way to compare MatTypes?
And who do I construct a Mat from a width, height, mat-type and an array of raw data?
Example code:

pasted above

Output:

22>C:\Users\joe\source\repos\Main\Mobile\Core\Core\CvMatExtensions.cs(27,14,27,31): error CS9135: A constant value of type 'MatType' is expected
22>C:\Users\joe\source\repos\Main\Mobile\Core\Core\CvMatExtensions.cs(33,14,33,30): error CS9135: A constant value of type 'MatType' is expected
22>C:\Users\joe\source\repos\Main\Mobile\Core\Core\Extensions\HeightMapExtensions.cs(132,30,132,33): error CS0122: 'Mat.Mat(int, int, MatType, Array, long)' is inaccessible due to its protection level
22>C:\Users\joe\source\repos\Main\Mobile\Core\Core\Extensions\ImageExtensions.cs(484,35,484,41): error CS0122: 'Mat.Mat(int, int, MatType, Array, long)' is inaccessible due to its protection level
22>C:\Users\joe\source\repos\Main\Mobile\Core\Core\Extensions\ImageExtensions.cs(485,35,485,41): error CS0122: 'Mat.Mat(int, int, MatType, Array, long)' is inaccessible due to its protection level
22>C:\Users\joe\source\repos\Main\Mobile\Core\Core\Extensions\ImageExtensions.cs(486,35,486,41): error CS0122: 'Mat.Mat(int, int, MatType, Array, long)' is inaccessible due to its protection level
22>C:\Users\joe\source\repos\Main\Mobile\Core\Core\Extensions\ImageExtensions.cs(487,35,487,41): error CS0122: 'Mat.Mat(int, int, MatType, Array, long)' is inaccessible due to its protection level
22>C:\Users\joe\source\repos\Main\Mobile\Core\Core\ScanAdvancedAlignment.cs(705,21,705,33): error CS0266: Cannot implicitly convert type 'OpenCvSharp.MatType' to 'int'. An explicit conversion exists (are you missing a cast?)
22>Done building project "GelSight.Core.csproj" -- FAILED.
StopOnFirstBuildError: Build cancelled because project "Core" failed to build.
Build has been canceled.

What did you intend to be?
No compiler errors :-)

I have thr same issue when migrating from 4.9 to 4.10
"how do I construct a Mat from a width, height, mat-type and an array of raw data?"

Please use Mat.FromPixelData instead.
https://github.com/shimat/opencvsharp/pull/1677/files#diff-4bfce067c7a4f3c0bd76d672e8b7c457350681fb3f89922045c2dcbc05a03fb3R273
With the introduction of nint in C# 9, IntPtr is implicitly replaced by nint. This made overloading the Mat constructors difficult to resolve, so I had no choice but to make this change.

Thank you for this.  However this only address the second problem I was having.  When trying to compare a Mat.Type() value against, say Cv.MatType.CV_32F, I can no longer use a switch` statement.  Is it still meaningful to compare them with operator==()?


glViewport resolution difference

Windows Phone app with ICoreWindow has higher glViewport resolution than Windows Phone app with SwapChainPanel. Tested on emulator and device. How can I use raw pixel glViewport size on the Windows Phone with SwapChainPanel?

Hey Xenice,
Okay. We don't officially support creating the SwapChainPanel in any units other than Dips.
If you really want to create the SwapChainPanel at the native resolution, then you should modify the internals of ANGLE to also call your ConvertDipsToPixels() function in the right places. I believe you'll need to do this in:

src/common/winrt/SwapChainPanelNativeWindow.h

call ConvertDipsToPixels() on the output of "sizeChangedEventArgs->get_NewSize(&newSize);"

src/common/winrt/SwapChainPanelNativeWindow.cpp

call ConvertDipsToPixels() on the result of "uiElement->get_RenderSize(&renderSize);"

I can't promise that these changes won't have any unwanted side-effects, but I can't think of any right now.
Thanks,
Austin

Hi Xenice,
We now have an easy solution to your issue. In "OpenGLESPage::CreateRenderSurface" in OpenGLESPage.xaml.cpp, you can define mRenderSurface using something like this:
    Windows::Graphics::Display::DisplayInformation^ info = Windows::Graphics::Display::DisplayInformation::GetForCurrentView();
    float scale = info->LogicalDpi / 96.0f;
    mRenderSurface = mOpenGLES->CreateSurface(swapChainPanel, nullptr, &scale);

This will create the window surface at the same resolution as the screen (i.e. without scaling).
Thanks,
Austin

It works! Many thanks


ref: JSONFileLogger slog handler, add scrape.FailureLogger interface

Improves upon #15434, better resolves #15433.
This commit introduces a few changes to ensure safer handling of the
JSONFileLogger:

the JSONFileLogger struct now implements the slog.Handler interface,
so it can directly be used to create slog Loggers. This pattern more
closely aligns with upstream slog usage (which is generally based around
handlers), as well as making it clear that devs are creating a whole new
logger when interacting with it (vs silently modifying internal configs
like it did previously).
updates the promql.QueryLogger interface to be a union of the
methods of both the io.Closer interface and the slog.Handler
interface. This allows for plugging in/using slog-compatible loggers
other than the JSONFileLogger, if desired (ie, for downstream projects).
introduces new scrape.FailureLogger interface; just like
promql.QueryLogger, it is a union of io.Closer and slog.Handler
interfaces. Similar logic applies to reasoning.
updates tests where needed; have the FakeQueryLogger from promql's
engine_test implement the slog.Handler, improve JSONFileLogger test
suite, etc.

Signed-off-by: TJ Hoplock<EMAIL_ADDRESS>

cc: @bboreham @SuperQ :eyes:

It's also based off the release-3.0 branch and PR is pointed to release-3.0 as well; assuming this PR is in a similar situation to #15434.

Sorry if I'm being a pain, but I doubt this one belongs on release-3.0.  It's improving things that work, not addressing a regression.
We probably do need to merge 3.0 to main though.

Sorry if I'm being a pain, but I doubt this one belongs on release-3.0. It's improving things that work, not addressing a regression. We probably do need to merge 3.0 to main though.

Heh, no worries, that's a reasonable perspective. Poor assumption on my part. I'll rebase and update the PR :+1:

Alright, now that release-3.0 has been merged back into main, this has been rebased on top of upstream main and PR repointed at main as well.
(I force pushed twice to re-trigger the tests to run against main this time, rather than release-3.0 like the first force push did)

@bboreham ready for round 2 if you get some time :+1:

I see there is slog.NewJSONHandler in the standard library.  Was that considered?

I see there is slog.NewJSONHandler in the standard library. Was that considered?

Yup, we're using it behind the scenes -- NewJSONFileLogger() uses promslog to create a new JSON logger using the stdlib's JSON handler:
https://github.com/prometheus/prometheus/pull/15472/files#diff-643cd098fa2738ab66e88647b9de570b3887db4d1e3fecbd9b864c6c2e8fda7eL45-R52
https://github.com/prometheus/common/blob/main/promslog/slog.go#L188-L190
The stdlib JSON handler just accepts an io.Writer; the JSONFileLogger here is really an abstraction around both a stdlib JSON handler + a file to manage the complete lifecycle.

@bboreham do you have any further thoughts? I see some discussion in #prometheus-dev about scheduling the 3.1 release, I'd love to get this in as a long-term fix in time for release, if possible :pray:

I'm still trying to understand why JSONFileLogger exists.  As far as I can see:

It opens and closes a file, given a name.
It passes through everything else to slog.

Is that right?  I'm surprised we need a 94-line file, plus tests for that.

That is indeed all it does. I also think it's a bit overkill for the job, but the it pre-existed the slog conversion, where I would argue it was more obviously useful.
I would be fine with using a JSON logger and managing the file directly, but as far as I can tell, this abstraction/interface was introduced to allow plugging in alternative logger implementations for promql.QueryLogger. I could also see a potential argument for aligning behavior between the query logger and scrape failure logger.
Do you feel those interfaces are valuable still? Because if not, I'd be willing to rework this to just managing a file+logger directly

@roidelapluie I know you mentioned here that you would have preferred not to adjust the promql.QueryLogger interface, perhaps you could weigh in with a bit more context on its usage? There's the obvious "I don't want to keep making interface updates", but beyond that, do you believe the interface is still useful?


Fix Readme.adoc contributing section

Currently the section shows unresolvable link.

This should go into 4.1.x as well.


Implement fallback mechanism incase native support fails to default option

Description
What is the current behavior?

Currently, if the native support fails, the whole LoadFile fails with relevant errors. Ideally, it should fall back to the default option.

closes: #557
What is the new behavior?

Fall back to the default option when native support fails with correct errors raised.
Does this introduce a breaking change?
Checklist

[ ] Created tests which fail without the change (if possible)
[ ] Extended the README / documentation, if necessary

@sunank200 We can also introduce a boolean param to control if we want to fall back to the default path or not.


feat: adds put method to tls credential context

:tada: This PR is included in version 2.12.0 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


If Custom Header is added and UDP length argument is passed as input, what should be UDP length configured in ixNetwork user specified length or auto?

If Custom Header is added and UDP length argument is passed as input, what should be UDP length configured in ixNetwork user specified length or auto?

UDP length field, if assigned explicitly by user, will remain set to assigned value (wireshark might flag if UDP length is incorrect).
If not explicitly assigned, it should automatically be assigned correct value by the implementation (e.g. almost guarantee that length will be correct).
+@ajbalogh for context.


afew: 3.0.0 -> 3.0.1

Motivation for this change
Update afew to its latest release.
Things done

[x] Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS linux)
Built on platform(s)

[x] NixOS
[ ] macOS
[ ] other Linux distributions

[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[ ] Tested compilation of all pkgs that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review wip"
[x] Tested execution of all binary files (usually in ./result/bin/)
[ ] Determined the impact on package closure size (by running nix path-info -S before and after)
[ ] Ensured that relevant documentation is up to date
[x] Fits CONTRIBUTING.md.

Result of nixpkgs-review pr 100331 1

1 package built:
- afew


chore: Load keyvault url from environment variable in example

Reason for Change:
Make it easy to test in sovereign clouds
Please answer the following questions with yes/no:
Does this change contain code from or inspired by another project? If so, did you notify the maintainers and provide attribution?

[ ] yes
[x] no

Notes for Reviewers:

/azp run Azure Workload Identity CI

/azp run Azure Workload Identity CI


Fixes NPE - ReplicatedSubscriptionsController send marker message when enable deduplicated.

Motivation
ReplicatedSubscriptionsController send marker message will cause NPE when enable deduplicated.
The stacktrace here.
java.lang.NullPointerException: null
	at org.apache.pulsar.broker.service.persistent.MessageDeduplication.isDuplicate(MessageDeduplication.java:317) ~[classes/:?]
	at org.apache.pulsar.broker.service.persistent.PersistentTopic.publishMessage(PersistentTopic.java:413) ~[classes/:?]
	at org.apache.pulsar.broker.service.persistent.ReplicatedSubscriptionsController.writeMarker(ReplicatedSubscriptionsController.java:272) ~[classes/:?]
	at org.apache.pulsar.broker.service.persistent.ReplicatedSubscriptionsSnapshotBuilder.start(ReplicatedSubscriptionsSnapshotBuilder.java:83) ~[classes/:?]
	at ...

Modifications

Marker messages don't need to be deduplicated.

Verifying this change

[x] Make sure that the change passes the CI checks.

Documentation
Check the box below or label this PR directly (if you have committer privilege).
Need to update docs?

[x] no-need-doc

@codelipenghui
This bug may affect all replicator marker send fail. should we cherry-pick this PR to branch 2.8?

@mattisonchao Yes, we should cherry-pick to branch-2.8


publisher only load the tasklist on maya

at opening, kitsupublisher only open the tasklist part of the publisher window and return an error

clicking the details or cancel button does nothing. maya console return :
=== An error occured !===  Error message: Traceback (most recent call last):   File "/mnt/Pipeline/Test/kitsupublisher/kitsuPublisher/lib/python2.7/site-packages/kitsupublisher/views/MainWindow.py", line 118, in run     self.function(self.args, **self.kwargs)   File "/mnt/Pipeline/Test/kitsupublisher/kitsuPublisher/lib/python2.7/site-packages/kitsupublisher/views/MainWindow.py", line 79, in set_up_thread_listeners     create_event(events, self.table_updated)   File "/mnt/Pipeline/Test/kitsupublisher/kitsuPublisher/lib/python2.7/site-packages/kitsupublisher/utils/connection.py", line 60, in create_event     event_client = gazu.events.init()   File "/mnt/Pipeline/Test/kitsupublisher/kitsuPublisher/lib/python2.7/site-packages/gazu/events.py", line 18, in init     main_namespace = event_client.define(BaseNamespace, "/events")   File "/mnt/Pipeline/Test/kitsupublisher/kitsuPublisher/lib/python2.7/site-packages/socketIO_client/init.py", line 381, in define     self.wait(for_namespace=namespace)   File "/mnt/Pipeline/Test/kitsupublisher/kitsuPublisher/lib/python2.7/site-packages/socketIO_client/init.py", line 251, in wait     self._process_packets()   File "/mnt/Pipeline/Test/kitsupublisher/kitsuPublisher/lib/python2.7/site-packages/socketIO_client/init.py", line 278, in _process_packets     self._process_packet(engineIO_packet)   File "/mnt/Pipeline/Test/kitsupublisher/kitsuPublisher/lib/python2.7/site-packages/socketIO_client/init.py", line 491, in _process_packet     delegate(parse_socketIO_packet_data(socketIO_packet_data), namespace)   File "/mnt/Pipeline/Test/kitsupublisher/kitsuPublisher/lib/python2.7/site-packages/socketIO_client/init.py", line 523, in _on_error     namespace._find_packet_callback('error')(data_parsed.args) TypeError: on_error() takes exactly 2 arguments (1 given) // Warning: Panel size cannot accommodate all requested Heads Up Display elements. //
and the terminal launching maya return :
QObject::setParent: Cannot set parent, new parent is in a different thread QApplication: Object event filter cannot be in a different thread.
this issue occur on maya 2019 - centos 7.8 - python 2.7

Thank you @Kaiz3rTool for reporting. We will have a look at this.

hello,
a small update on this, the problem is exactly the same in houdini 18.5

@Kaiz3rTool can you please check what kitsu version do you run? you can check that in the browser while logged in and clicking on your name. let me know :) thanks

Hi, I use kitsu 0.12.59

@Kaiz3rTool more questions, do you self host kitsu? means not CGwire provided? is it a docker image or "regular" install using the guide from deplying kitsu/zou etc?

Sorry  i forgotten to mention that.
Yes it's self hosted, following the install guide
Zou's host OS is ubuntu LTS
The database is on an other server running on centos and postgres 12
From web interface everything runs well

Thanks for info! :)  It confirms some suspicions  I had about it.
Needs more digging, ill update you when I have a solution.

Thanks !

hi, any news on this ? I still can't use kitsu publisher for now
thank you


xService throws error when service already exists

When the Path property is provided the DSC resource throws an error if the service exists instead of returning true for Test-TargetResource or continuing with the WriteWriteProperties calls for Set-TargetResource. The Path property will always be present in the configuration.

Any ETA on this being included in the dev branch? Alternatively, I could just pull down this change and merge in myself locally if @mgr32 is confident that it works.

It's already available in the dev branch, https://github.com/PowerShell/xPSDesiredStateConfiguration/pull/36 has been merged.
Closing this issue, but feel free to reopen if you have further questions.

Awesome!


Fix missing upscale constant in CLI example

The current command results in the following:
main.py: error: argument --upscale: expected one argument

Appreciated.


Configure Business Rules, Workflow and Process Visibility

Tutorials: https://developers.sap.com/tutorials/cp-starter-ibpm-employeeonboarding-2-configure.html
Write here how you think we can improve the tutorial ...
I am a beginner, when I try to finish the 2nd tutorial in Mission Beginer 'Automate and Extend Employee Onboarding',  the STEP 6 did no t work whether i tried many times with different PC.
I have to say it is so frustrating.  I do every details precisely according to the tutorial.
But in the first picture following, the note above the picture help me nothing.
All l got when i tried to deploy the .mtar is the 2nd picture following.
I just want to finish the tutorial, but i am stuck here.
Looking forward to your reply and help me to finish it.
Pls contect me<EMAIL_ADDRESS>

You have to login to CF in the Business Application Studio to be ale to deploy successfully as mentioned in the note. There are many ways to connect to CF. You can use CF command line in studio or click function F1 and in wizard that opens, type login and follow the wizard


strategy=replace complains of duplicates

A community member was trying to do a realm import with the command:
ealm-cli import --strategy=replace --include-dependencies --app-id=the_app_id
and got:
failed to diff app with currently deployed instance: error: must specify unique names when importing MongoDB Rules; duplicate name: wildaid.MenuData
Let's investigate whether or not this is expected and if there's a different way we should export the realm template for importing.
This is important for being able to update exisiting Realm code.

The import of realm functions has been much improved in current versions.


Add inputmode to TextField

I trying to force a numeric keyboard to some text inputs.
In Brazil we have some fields that needs a mask and we have to force the users to input only digits and the "tel" type for the input is not the best approach to do this. Adding the "inputmode = numeric" solve the question on a normal "input text". If i can do this in the TextField component, it will be amazing!

@luisquicidev I hear ya.
Does the Numeric with NgModel example accomplish this for ya?
https://trimox.github.io/angular-mdc-web/#/angular-mdc-web/text-field-demo/examples
<mdc-text-field type="number"
  name="demoweight"
  label="Weight"
  ngModel
  #demoWeightModel="ngModel"
  required>
</mdc-text-field>

@trimox this example works fine if i have a numeric-only input. But the input has a mask that write some non-numeric chars (like "." and "-"). In this case, the numeric keyboard will open in the mobile device but the additional chars of the mask will not be write. When the non-numeric chars will be inserted by the mask function, the input reject and not let the rest of number write in the input.
For "numeric" inputs with masks or other situations, the best approach is to set the inputmode. With the inputmode the mobile device will be recognize which keyboard will open.
My request for the inputmode attribute is for that situations.
To accept non-numeric chars today, we have to set the type to "tel", but the tel keyboard don't have only numeric keys.
I created a directive for angular to force the inputmode on TextField (the directive modifies the DOM and insert the inputmode on the input inside the TextField component). It works, but an "native" attribute is more elegant. =D
PS: The input looks like "000.000.000-00". is an example. The user have to write only the digits.
PS: I'm using ionic 4 with your mdc library and it's so great! Thanks a lot for that.


Which script can remove human sequence which contained in bam files?

When I repeat your research, I can not figure out how to remove human sequence which contained in bam files, according to your paper.

Could you kindly suggest a method to do it?
Thank you for your time.

Hi there, as written in that snippet you posted, we first extracted unmapped (i.e., non-human) reads from the pre-computed bam files prior to profiling them with Kraken. For this paper, we used the samtools view -f 4 command. However, since then we have updated our process to do another host depletion step after the initial extraction, using the piped command below:
samtools view -f 4 -O BAM $in_dir/$filename |
samtools bam2fq - |
fastp -l 45 --stdin -w $cpus --stdout --interleaved_in |
minimap2 -ax sr -t $cpus $db - |
samtools fastq -@ $cpus -f 12 -F 256 - -1 $out_dir/$base_name.R1.trimmed.fastq.gz -2 $out_dir/$base_name.R2.trimmed.fastq.gz

where $in_dir/$filename denotes the input file, $cpus denotes the number of cores for the job, $db denotes a minimap .mmi file containing the GRCh38 human genome and PhiX viral genome, and $out_dir/$base_name.R1.trimmed.fastq.gz denotes the outputted host-depleted forward read file (R2 is the reverse). Note also that this piped command has a hard cutoff of a minimum length of 45 bp (fastp -l 45), which may not be optimal for all studies.
Nonetheless, if you just want to follow the protocol in the original Nature paper, you can just use the samtools view -f 4 command to extract the unmapped reads from the pre-computed TCGA bam files.

Thank you for your detailed reply!

How did you remove human sequence, when samples only have fastq files?

All TCGA samples had precomputed bam files based on alignments to the human genome. The only fastq files came from the validation (plasma) study, and they were aligned to the human genome using the methods described in the paper (see Bioinformatic processing for plasma microbiome samples section in Methods, partially copied below):
"A total of 21,600,141,264 reads were generated on the single NovaSeq 6000 sequencing run across all samples. Of these, 19,046,611,360 reads were assigned to human samples (that is, negative and positive controls removed), and 2.186% of the total reads were classified as non-human. Raw sequencing data were demultiplexed and adaptor-trimmed using Atropos. Additional quality filtering was done using Trimmomatic with the following settings—(ILLUMINACLIP:TruSeq3-PE-2.fa:2:30:7, MINLEN:50, TRAILING:20, AVGQUAL:20, SLIDINGWINDOW:20:20). An additional adaptor sequence consisting of a string of only G was added to the standard TruSeq adapters to remove trailing G stretches from the 5′ ends of reads. Read pairs were discarded if either mate mapped to the human genome (major-allele-SNP reference from 1000 Genomes Project) using Bowtie2 with the fast-local parameter set. Paired-end reads were then merged using FLASH with the following parameters— (minimum overlap: 20, maximum overlap: 150, mismatch ratio: 0.01).
The filtered, merged reads were then processed either by Kraken, using the same workflow and database (n = 59,974 microbial genomes) detailed above, or with SHOGUN as detailed here."

Thank you!


ToC Cleanup

Preliminary cleanup of the toc, suggested titles, merged files

@sarmento I did judge based on the text diffs and what was included in the final ToC, but maybe they were duplicated to avoid conflicts. I realised I was making changes on the duplicate and this is why i wasn't able to see anything. @IvanPombo can you just make sure everything is there? i added a new folder now that keeps all the duplicate files in one place in case we need to refer back to them later on.


Inspiration section

Have a question? Please checkout our Slack Community or visit our Slack Archive.

Describe the Feature
Since this is a universal tool of tools, we have learned (and evolved) from a lot of tools like the following

variant
ahoy
choria-io

And I think this should be shown in an inspiration section. We agreed to this in a previous PR https://github.com/cloudposse/atmos/pull/168 and I wrote this up so we do not forget about it.

This was mostly addressed in https://atmos.tools/reference/alternatives


Have some forum that lets newer users post questions about the usage of wallet client?

I'm a new user and I have some question about the bitore-wallet-client usage but i think this Issue section doesn't is the place to solve that questions. I've been searching on google and Stackoverflow but I not found any forum. So, please, have any place that i can ask for a senior user about my questions?

You can find help here: https://forum.bitcore.io/c/bitcore-wallet
On Wed, Aug 17, 2016 at 5:06 PM +0100, "Alvaro Paçó"<EMAIL_ADDRESS>wrote:
I'm a new user and I have some question about the bitore-wallet-client usage but i think this Issue section doesn't is the place to solve that questions. I've been searching on google and Stackoverflow but I not found any forum. So, please, have any place that i can ask for a senior user about my questions?
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub, or mute the thread.


[BUG] RuntimeError when running inference on ScienceQA

When did you clone our code?
I cloned the code base after 5/1/23
Describe the issue
Issue:
Command:
python -m llava.eval.model_vqa_science \
    --model-name /path/to/LLaVA-13b-v0-science_qa \
    --question-file /path/to/ScienceQA/data/scienceqa/llava_test.json \
    --image-folder /path/to/ScienceQA/data/scienceqa/images/test \
    --answers-file vqa/results/ScienceQA/test_llava-13b.jsonl \
    --answer-prompter
    --conv-mode simple

Log:
RuntimeError: cuDNN error: CUDNN_STATUS_INTERNAL_ERROR

Screenshots:

You may attach screenshots if it better explains the issue.

Hi, you may try reinstalling PyTorch with CUDA 11.7, with the commands this user from our community provides: https://github.com/haotian-liu/LLaVA/issues/123#issuecomment-1539434115.


Add use case for user stories 4-6 in DG, update target user profile and value proposition in DG

Closes #17

Should you refer to our google docs for the target user and value propositions that we have discussed about? 🤔

Forgot about that. Updated now.

LGTM!


Fix duplicated repo name ids

fixes #494

Codecov Report

Merging #495 into master will decrease coverage by 0.01%.
The diff coverage is 20.00%.

@@            Coverage Diff             @@
##           master     #495      +/-   ##
==========================================
- Coverage   57.83%   57.82%   -0.02%
==========================================
  Files        1064     1064
  Lines       34393    34400       +7
  Branches     4876     4878       +2
==========================================
- Hits        19892    19891       -1
- Misses      14501    14509       +8


Added support for Metrics3 Gauge

Hi!
I added support for Metrics3 Gauge, so when using reporting functions from Metrics3 it gets the values for Gauges too.

Thanks for the contribution. I have a lot going on today, but I should be able to review it tomorrow.

@brharrington, no problem, i'm glad to help!

Mostly looks good to me. When trying it the one problem I found was with duplicate registrations.
  @Test
  public void gaugeNumberDuplicate() {
    MetricRegistry codaRegistry = new MetricRegistry();
    MetricsRegistry r = new MetricsRegistry(clock, codaRegistry);
    AtomicInteger num1 = r.gauge("foo", new AtomicInteger(42));
    AtomicInteger num2 = r.gauge("foo", new AtomicInteger(21));
    Assert.assertEquals(63.0, (Double) codaRegistry.getGauges().get("foo").getValue(), 1e-12);
  }

This throws an exception:
java.lang.IllegalArgumentException: A metric named foo already exists

	at com.codahale.metrics.MetricRegistry.register(MetricRegistry.java:91)
	at com.netflix.spectator.metrics3.MetricsGauge.<init>(MetricsGauge.java:42)
	at com.netflix.spectator.metrics3.MetricsRegistry.gauge(MetricsRegistry.java:65)
	at com.netflix.spectator.metrics3.MetricsRegistry.gauge(MetricsRegistry.java:61)
	at com.netflix.spectator.api.Registry.gauge(Registry.java:407)
	at com.netflix.spectator.metrics3.MetricsRegistryTest.gaugeNumberDuplicate(MetricsRegistryTest.java:85)

In general for spectator the philosophy for exceptions is to log a warning but not throw by default (exception propagation). For tests there is a property which can be set to enable throwing exceptions so it is more likely that bugs will get caught early on.
The reasoning for this is that users often don't expect or think about exceptions coming from the instrumentation code. This has caused outages at Netflix before where a precondition in the monitoring library threw an exception and caused a customer facing issue. It was a bug in the way they were using the library, but overall we prefer if the fallout of such issues is loss of visibility rather than a bigger problem.

@brharrington, didn't know about this philosophy, i'm new to Spectator, and i didn't make code compatible with the gauge philosophy of aggregating the metrics with the same value, i'm gonna fix it.

@brharrington, i got a doubt, the Throwables is a package private class, i can't use it from the code i'm implementing, there is any alternative or i'm missing something?

@brharrington, i refactored the code to respect the gauges contract, now it seems to work fine, i just let a FIXME to throw a exception with Throwables like you suggested but since it's package private and i can't access i'm waiting on a suggestion from you, since i'm not very familiarised with Spectator API yet.

@kennedyoliveira thanks. I suppose the best option is to move the Throwables utility into the impl package. That is how we currently share some of the other utilities that we have to make public, but want to make clear are considered an internal api and should not be used outside of spectator itself.

I think #274, should take care of the Throwables problem you mentioned. Let me know if you still see a gap or have a better alternative.

@brharrington, it sure solves the problem! I rarely send pull requests so i don't know how to procede in this situation, i should wait your pr being merged to merge mine with master and get your changes or should i merge with your pr and update it already?

Great! I went ahead and merged #274 so you should be able to just fetch and merge master back into your branch.

@brharrington, thank you! I fixed the things you mentioned, and i opted to use your  Concurrent Map suggestion for holding or registers since the metrics really build a new map each time getGauges is called, sounds like the most readable solution to me.

Looks good to me. Thanks again.

@brharrington, your welcome, i thank you for the patience haha and for the notes. I'm glad to help :D


Implement Storage

Basic storage for Product, Order Shopping list , and Inventory.
@eugenelim97 @liushiru Check if it works. Could be buggy since I have not done a complete task.
@chekjun I haven't added any storage for sales since I am not sure if your model design is final as of now. You can add yours later.

I have tested the product section with basic add edit delete command and so far it looks fine. Codewise it has very little dependencies and is very cohesive. The structure is almost the same as ab3 so I think should be fine for DG? Will raise an issue if any bugs or problems are found in the future.

I have tested the product section with basic add edit delete command and so far it looks fine. Codewise it has very little dependencies and is very cohesive. The structure is almost the same as ab3 so I think should be fine for DG? Will raise an issue if any bugs or problems are found in the future.

Thanks. Need to add sales and shortcuts though.
Yes. But for DG we still need to draw our own diagrams so there could be some (tiring) work :-(((


firebaseArray is not updating view somehow.

Hello. First of all i want to made a plunkr for this but code is so complex and reproducing this may cost a lots of time. But i am gonna attach pictures about this problem.
Problem is: Data is coming perfectly from database, and its assigning the data to array but somehow view is not updating.
1-) I have an array of objects. So i used firebaseArray for this.
This is my first array

2-) I am checking data on Console.Log and its coming, its changing.. $timeout, setTimeout doesnt working..
I am new and this is my first project with Firebase&AngularFire. Maybe i did something wrong, maybe i am doing all wrong but i dont know what.. BTW; this is service not controller, i am not/can not using SCOPE.

This is a usage question, which is better suited for Stack Overflow or the Firebase Google Group. Can you please re-post on one of those forums and paste the link here? Please also remember to include version information and a code sample (if relevant) to help us resolve your issue.
It would be helpful to see how you are using liveData in your HTML view. The second block of code you included should not be necessary since $firebaseArray handles all of that stuff for you. You should just reference your liveData array variable in your view and that's it.

@jwngr - First of all thank you for help. Firebase Google Group doesnt showing my question somehow. On stackoverflow no body tells me anything.. I dont know what i am gonna do with that data.
Its annoying, its just not updating view..


JSON output does not include namespace

If possible, it would be nice to include the namespace here to properly identify the object with the issue.
https://github.com/yannh/kubeconform/blob/master/pkg/output/json.go#L14

Right, but not all Kubernetes objects have a namespace, so this would be more specific for resources that do have one.. I' m trending towards a "I' d rather not implement this".. Do you have troubles finding the faulty resource in the file with the output provided?

@yannh if you don't like it, we can close it. Typically only a few files change so the namespace is not critical.
The reason I requested it is that we're running a set of validators, like OPA and kubeconform, on a large repository. In this repository we could have 30+ objects named db in namespace app-1, app-2 etc.
To identify an object in kubernetes, you need namespace, name, kind and group. This is the fully qualified name in kubernetes, and we could extract this information consistently for other linters. This matches ObjectReference too. https://kubernetes.io/docs/reference/kubernetes-api/common-definitions/object-reference/


PCD endpoint exposes EPR/PEGS variables

This issue is to report that the PCD endpoint is incorrectly exposing EPR/PEGS variables. The variables are empty (meaning all values are zero), which is expected as the EPR/PEGS data are available only for the asthma and covid cohorts. As such, the last join step should not be run for the PCD dataset.
Example:

curl -X 'GET' \
  'https://icees-pcd.renci.org/patient/cohort/COHORT%3A1/features' \
  -H 'accept: text/tabular'

EPR/PEGS variables:
+--------------------------------+---------+
| feature                        | count   |
+================================+=========+
| D28B_STILL_HAVE_ASTHMA = True  | 0       |
|                                | 0.00%   |
+--------------------------------+---------+
| D28B_STILL_HAVE_ASTHMA = False | 0       |
|                                | 0.00%   |
+--------------------------------+---------+
| D28B_STILL_HAVE_ASTHMA = None  | 335686  |
|                                | 100.00% |
+--------------------------------+---------+
+---------------------------------+---------+
| feature                         | count   |
+=================================+=========+
| D28C_ASTHMA_EPISODE_12M = True  | 0       |
|                                 | 0.00%   |
+---------------------------------+---------+
| D28C_ASTHMA_EPISODE_12M = False | 0       |
|                                 | 0.00%   |
+---------------------------------+---------+
| D28C_ASTHMA_EPISODE_12M = None  | 335686  |
|                                 | 100.00% |
+---------------------------------+---------+
+----------------------------------+---------+
| feature                          | count   |
+==================================+=========+
| D28D_ASTHMA_ER_VISIT_12M = True  | 0       |
|                                  | 0.00%   |
+----------------------------------+---------+
| D28D_ASTHMA_ER_VISIT_12M = False | 0       |
|                                  | 0.00%   |
+----------------------------------+---------+
| D28D_ASTHMA_ER_VISIT_12M = None  | 335686  |
|                                  | 100.00% |
+----------------------------------+---------+

@karafecho Looks like this issue is caused by the PCD feature yaml file as well. For example, this feature variable D28B_STILL_HAVE_ASTHMA is defined in the feature yaml file. If we remove these feature variables from the feature yaml file, these EPR/PEGS variables should not show up.

Kara to update YAML file after Hong writes a script to create a diff file showing discrepancies in variables between the patient dataset and the all_features YAML file.

Complete, closing issue.


[Clean-Up] Add the ClearGarbage back to StopGC.

This adds the call to ClearGarbage function back to the Garbage Collector. It turns out that the Garbage Collector already has a StopGC function that will be called when Peloton shuts down. So I just added the call there.

@tcm-marcel Can you help review this when it passes the build? I only touched two functions so it should be very easy.

Coverage increased (+0.1%) to 75.73% when pulling 6c9489cceb395049c87b4a22c94a97cca4f97612 on malin1993ml:cleargarbage-fix into 4e18d217347c2087a62b8a44ddc93762213dff20 on cmu-db:master.

Coverage increased (+0.09%) to 75.874% when pulling bc89722a4b4411bc21d527ba14468eec04a5ac5b on malin1993ml:cleargarbage-fix into 2c2477b36402fcf78957da257bfa088b3450cb9e on cmu-db:master.

Changes Unknown when pulling 355347346ca8fdf6308d0c80ed75aca9f727d355 on malin1993ml:cleargarbage-fix into ** on cmu-db:master**.

Coverage increased (+0.1%) to 75.887% when pulling 355347346ca8fdf6308d0c80ed75aca9f727d355 on malin1993ml:cleargarbage-fix into 334016edf49e5fee16876691d1f9db81b7628487 on cmu-db:master.


Support Postgre SQL as a datastore

User story
As a sotware engineer, I want to use Postgre SQL as a datastore so that I can use Postgre SQL compatible managed SQL databases on other clouds (e.g. Amazon Aurora).
Acceptance criteria
When I deploy FHIR Server I can connect it to a Postgre SQL based datastore.
All features supported by SQL Server datastore, should also be supported by Postgre SQL datastore.
Additional info
I have fully implemented support for Postgre SQL datastore for the FHIR Server. I would like to start a discussion, on whether you would be interested in pulling it upstream?
The current implementation basically replaces any references to SQL Server with Postgre SQL and is based on fairly old commit (f20c5b2e). A number of refactorings to existing SQL Server would be neccessary to support both flavours of SQL, but a significant portion of the code is reusable. Hence, before I start on any of that, I would like to know if you would be interested in such a PR.

This has been mentioned in previous issues before (https://github.com/microsoft/fhir-server/issues/808 and https://github.com/microsoft/fhir-server/issues/800). I'd be very much interested in Postgres support, especially if it were to also support Databases like YugaByte or CockroachDB which provide compatibility with Postgres clients.
I would absolutely support and help with your efforts if you need!

@anyname2 we don't plan to support Postgres in the future right now, but definitely see the value in doing some of the refactoring work to make it easy for you to use your own SQL datalayer that isn't SQL Server. No timing on when we would do this yet, but will leave this open for this work.

@CaitlinV39 I will actually plan to create a new issue for the refactorin work and close this issue.

Sounds good!


CFN Changeset preview for TransitGatewayAttachment tag update shows false information

The changeset preview shows the resource replacement as "false" when we are updating the tags for TransitGatewayAttachment via CFN in us-west-2 region. This is an incorrect information as the resource tag update require replacement as per the docs https://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/aws-resource-ec2-transitgatewayattachment.html.
Apart from this false info on the changesetset preview, I would like add that CFN should not replace the TransitGatewayAttachment on the tag updates as this leads to error because CFN will create the new resource which will fail as you can only have one attachment between the same VPC and transit gateway pair. As of now as per the doc all property update for TransitGatewayAttachment require replacement which will lead to the below error. The open issue for this is - https://github.com/aws-cloudformation/aws-cloudformation-resource-providers-transitgateway/issues/124
Resource handler returned message: "tgw-xxxx has non-deleted Transit Gateway Attachments with same VPC ID. (Service: Ec2, Status Code: 400, Request ID: xxxx, Extended Request ID: null)" (RequestToken: xxx, HandlerErrorCode: GeneralServiceException)

Hello, we have added the modify functionality to the AWS::EC2::TransitGatewayAttachment resource and those changes are currently being rolled out. The documentation should update by the end of the week to align with the resource behavior.


Attentionpooling nonlinear_ops

Hi Jacob,
Thanks a lot for this neat package. I don't know if you take on requests, but it would be great to see support for Attention pooling layers, and others present in Enformer. Do you plan to write functions for these in the future?
Thanks

Howdy
You can pass in custom operations using the additional_nonlinear_ops parameter in deep_lift_shap. So, if you have a GeLU function implemented somewhere you would do something like...
additional_nonlinear_ops = {GeLU: _nonlinear} where _nonlinear is from tangermeme.deep_lift_shap.
This should be fairly straightforward for activation functions in whatever implementation you're using.
I'm not actually sure how to handle attention pooling layers though -- pooling is sort of its own beast because you need a function to unpool the data as well. If you could figure out what the appropriate to do is I could see how to incorporate it.
A challenge is that most of the non-standard ops are implemented in the same package as Enformer is and, since the dictionary requires a reference to the object type (like GeLU above), having these built-in means having the layers built-in.

Hi Jacob,
Still on this topic, I wanted to ask if it's that straightforward to expose ReLU functions that are not defined as layers.
For context, I'm playing with tangermeme to generate attributions for the Pangolin model, where ReLU activations are applied within the residual blocks. It seems that deep_lift_shap does not register any non-linear operations in this case.
Thanks for the package, it will be super useful.

No, it's not straightforward to register operations that are not defined as layers. I'm not sure it's even possible. You need the layer object to assign the hook that overrides the backward pass.
You'd have to make your own model definition that uses ReLU layers and load up the weights into it. That should work because you're not changing the weight values or shapes.

Just to add to this thread, we are using the attentionpool layer in enformer-pytorch here: https://github.com/lucidrains/enformer-pytorch/blob/9ffeb8b62927d752b4983ef308a28bf70b34b160/enformer_pytorch/modeling_enformer.py#L159. Any suggestions for how to create a dictionary for this layer to use with deepshap?

Attention pooling looks tricky because it seems like it might be linear except for the softmax. Annoyingly, rather than using a torch.nn.Softmax layer, which would already be registered, they use the built-in .softmax method call that is not even a layer that can be registered. There is a _softmax function built in to tangermeme that can be used for other layers, but it can't handle shape changes between the input to the layer and the output because it's supposed to be used on activations. Unfortunately, the cleanest solution may be to try to push a PR to that repo changing the layer... but that may break their saved models. I will think more about it.

So, if I:

Define a class identical to AttentionPool except that it uses nn.softmax
Replace all the attention pools in enformer with my new class
Copy over the weights from the old model

That should just work?

Hm. Looking closer at the implementation, I think that the solution might be a little more complicated. You need to account for the dot product which is the final line, as well. Sorry for not mentioning that before. We encountered a similar issue with the profile attributions: https://github.com/jmschrei/bpnet-lite/blob/master/bpnetlite/bpnet.py#L54
Basically, registered operations:
(1) must have the same input and output size
(2) cannot have multiple inputs to the forward pass
(2) seem to need to include the dot product when you apply a non-linear set of operations to a value, and then do the dot product between the original values and the transformed ones.
I think you'll need to do something conceptually similar to what I did except that you'll also need to run the convolution. I haven't tested this code, just to show you what needs to go where:
class AttentionPool(nn.Module):
    def __init__(self, dim, pool_size = 2):
        super().__init__()
        self.pool_size = pool_size
        self.pool_fn = Rearrange('b d (n p) -> b d n p', p = pool_size)
        self.attention = _AttentionPoolOp

    def forward(self, x):
        b, _, n = x.shape
        remainder = n % self.pool_size
        needs_padding = remainder > 0

        if needs_padding:
            x = F.pad(x, (0, remainder), value = 0)
            mask = torch.zeros((b, 1, n), dtype = torch.bool, device = x.device)
            mask = F.pad(mask, (0, remainder), value = True)

        x = self.pool_fn(x)
        return self._attention(x)

class _AttentionPoolOp(torch.nn.Module):
    def __init__(self):
        self.softmax = torch.nn.Softmax()
        self.conv = nn.Conv2d(dim, dim, 1, bias = False)

        nn.init.dirac_(self.to_attn_logits.weight)
        with torch.no_grad():
            self.to_attn_logits.weight.mul_(2)

    def forward(self, X):
        logits = self.to_attn_logits(X)

        if needs_padding:
            mask_value = -torch.finfo(logits.dtype).max
            logits = logits.masked_fill(self.pool_fn(mask), mask_value)

        attn = self.softmax(logits)
        return (X * attn).sum(dim = -1)

Then, all you'll need to do is register _AttentionPoolOp with _nonlinear from tangermeme.


Loading CI-Test throws "Invalid user role ''" error

See below. Loading up CI-Test immediately errors for a user role which is not specified.

I think the problem is to do with a blank in the example queries file. I'll take a look.

I forgot to tag this fix in my commit, but this is fixed.


fix some deprecation / unused import warnings

Various small tweaks caused some bitrot, cleaning up here.

Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 84.67%. Comparing base (99b007d) to head (522e77f).

Additional details and impacted files
@@            Coverage Diff             @@
##             main      #56      +/-   ##
==========================================
- Coverage   84.69%   84.67%   -0.02%
==========================================
  Files          15       15
  Lines         980      979       -1
  Branches      980      979       -1
==========================================
- Hits          830      829       -1
  Misses        103      103
  Partials       47       47

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

🚨 Try these New Features:

Flaky Tests Detection - Detect and resolve failed and flaky tests


upgrade csi driver version

azurefile-csi:v1.8.0, azuredisk-csi:v1.9.0 is not used in AKS rp yet, so it's safe to upgrade in AgentBaker directly.

cc @AbelHu


Added eth_chainId

Fixes trufflesuite#339
Latest betas of web3.js have trouble cooperating with ganache because eth_chainId was unsupported. This PR adds support for handling such requests.

@davidmurdoch the Travis build is still failing for Node.js v12, can we merge this anyway and therefore close issue #339?

Guys, web3 and ganache are not working on the latest version. Please fix/merge this PR and release a new version. We are relying on new API changes of the web3 library and if ganache does not manage to keep up we will have to switch development strategy for test chains. keep in mind, this issue has been known since the 26.02.2019 and fixed (rather well imho) by @tcichowicz since 11 days!


SIGSEGV on startup on M1

Describe the bug
Running the example from the Rust Quick Start page segfaults on 0.9.0, 0.9.1, and 0.10.0-alpha.5.
Running rerun-cli segfaults on 0.9.1, and 0.10.0-alpha.5<EMAIL_ADDRESS>failed to build), and the current main branch (commit 432d7d2).
In both cases, running the binary from inside lldb results in normal function.
To Reproduce
cargo install rerun-cli@{any of the versions given above} and then simply rerun.
Note that /usr/bin/lldb rerun runs without faulting.
The first example from https://www.rerun.io/docs/getting-started/rust can also be used, which will also generate a segfault.
Expected behavior
No segfaults on startup.
Backtrace
Stack trace cargo install<EMAIL_ADDRESS>RUST_LOG=debug rerun

[2023-10-12T19:47:14Z DEBUG re_memory::memory_limit] Setting memory limit to 24.0 GiB, which is 75% of total available memory (32.0 GiB).
[2023-10-12T19:47:14Z INFO  re_sdk_comms::server] Hosting a SDK server over TCP at <IP_ADDRESS>:9876. Connect with the Rerun logging SDK.
[2023-10-12T19:47:14Z DEBUG eframe] Using the wgpu renderer
[2023-10-12T19:47:14Z DEBUG eframe::native::run] Entering the winit event loop (run_return)…
[2023-10-12T19:47:14Z DEBUG eframe::native::file_storage] Loading app state from "/Users/bosporos/Library/Application Support/rerun/app.ron"…
[2023-10-12T19:47:14Z DEBUG eframe::epi] Failed to decode RON: 1:474: Unexpected missing field `generation` in `SerializedElement`
[2023-10-12T19:47:14Z DEBUG egui_winit::clipboard] Initializing arboard clipboard…
[2023-10-12T19:47:14Z DEBUG re_viewer::native] wgpu adapter name: "Apple M1 Max", device_type: IntegratedGpu, backend: Metal, driver: "", driver_info: ""

Rerun caught a signal: SIGSEGV
Troubleshooting Rerun: https://www.rerun.io/docs/getting-started/troubleshooting
Report bugs: https://github.com/rerun-io/rerun/issues

   2: re_crash_handler::install_signal_handler::signal_handler
   3: _OSAtomicTestAndClearBarrier
   4: <unknown>
   5: <unknown>
   6: <unknown>
   7: <unknown>
   8: <unknown>
   9: <unknown>
  10: <unknown>
  11: <unknown>
  12: <unknown>
  13: <unknown>
  14: <unknown>
  15: eframe::native::epi_integration::EpiIntegration::update
  16: <eframe::native::run::wgpu_integration::WgpuWinitApp as eframe::native::run::WinitApp>::run_ui_and_paint
  17: eframe::native::run::run_and_return::{{closure}}
  18: <winit::platform_impl::platform::app_state::EventLoopHandler<T> as winit::platform_impl::platform::app_state::EventHandler>::handle_nonuser_event
  19: winit::platform_impl::platform::app_state::Handler::handle_nonuser_event
  20: winit::platform_impl::platform::app_state::AppState::cleared
  21: std::panicking::try
  22: winit::platform_impl::platform::observer::control_flow_end_handler
  23: <unknown>
  24: <unknown>
  25: <unknown>
  26: <unknown>
  27: <unknown>
  28: <unknown>
  29: <unknown>
  30: <unknown>
  31: <unknown>
  32: <unknown>
  33: winit::platform_impl::platform::event_loop::EventLoop<T>::run_return
  34: eframe::native::run::with_event_loop
  35: eframe::native::run::wgpu_integration::run_wgpu
  36: eframe::run_native

Rerun caught a signal: SIGSEGV
Troubleshooting Rerun: https://www.rerun.io/docs/getting-started/troubleshooting
Report bugs: https://github.com/rerun-io/rerun/issues

Stack trace cargo install<EMAIL_ADDRESS>RUST_LOG=debug rerun.

[2023-10-12T19:43:58Z DEBUG re_memory::memory_limit] Setting memory limit to 24.0 GiB, which is 75% of total available memory (32.0 GiB).
[2023-10-12T19:43:58Z INFO  re_sdk_comms::server] Hosting a SDK server over TCP at <IP_ADDRESS>:9876. Connect with the Rerun logging SDK.
[2023-10-12T19:43:58Z DEBUG eframe] Using the wgpu renderer
[2023-10-12T19:43:58Z DEBUG eframe::native::run] Entering the winit event loop (run_return)…
[2023-10-12T19:43:58Z DEBUG eframe::native::file_storage] Loading app state from "/Users/bosporos/Library/Application Support/rerun/app.ron"…
[2023-10-12T19:43:58Z DEBUG eframe::epi] Failed to decode RON: 1:474: Unexpected missing field `generation` in `SerializedElement`
[2023-10-12T19:43:58Z DEBUG egui_winit::clipboard] Initializing arboard clipboard…
[2023-10-12T19:43:58Z DEBUG re_viewer::native] wgpu adapter name: "Apple M1 Max", device_type: IntegratedGpu, backend: Metal, driver: "", driver_info: ""

Rerun caught a signal: SIGSEGV
Troubleshooting Rerun: https://www.rerun.io/docs/getting-started/troubleshooting
Report bugs: https://github.com/rerun-io/rerun/issues

   2: re_crash_handler::install_signal_handler::signal_handler
   3: _OSAtomicTestAndClearBarrier
   4: <unknown>
   5: <unknown>
   6: <unknown>
   7: <unknown>
   8: <unknown>
   9: <unknown>
  10: <unknown>
  11: <unknown>
  12: <unknown>
  13: <unknown>
  14: <unknown>
  15: eframe::native::app_icon::AppTitleIconSetter::update
  16: eframe::native::epi_integration::EpiIntegration::update
  17: <eframe::native::run::wgpu_integration::WgpuWinitApp as eframe::native::run::WinitApp>::run_ui_and_paint
  18: eframe::native::run::run_and_return::{{closure}}
  19: <winit::platform_impl::platform::app_state::EventLoopHandler<T> as winit::platform_impl::platform::app_state::EventHandler>::handle_nonuser_event
  20: winit::platform_impl::platform::app_state::Handler::handle_nonuser_event
  21: winit::platform_impl::platform::app_state::AppState::cleared
  22: std::panicking::try
  23: winit::platform_impl::platform::observer::control_flow_end_handler
  24: <unknown>
  25: <unknown>
  26: <unknown>
  27: <unknown>
  28: <unknown>
  29: <unknown>
  30: <unknown>
  31: <unknown>
  32: <unknown>
  33: <unknown>
  34: winit::platform_impl::platform::event_loop::EventLoop<T>::run_return
  35: eframe::native::run::with_event_loop
  36: eframe::native::run::wgpu_integration::run_wgpu
  37: eframe::run_native

Rerun caught a signal: SIGSEGV
Troubleshooting Rerun: https://www.rerun.io/docs/getting-started/troubleshooting
Report bugs: https://github.com/rerun-io/rerun/issues

[1]    90663 segmentation fault  RUST_LOG=debug rerun

Full output from https://github.com/rerun-io/rerun with cargo build -p rerun-cli and then RUST_LOG=debug target/debug/rerun:

[2023-10-12T19:36:21Z DEBUG re_memory::memory_limit] Setting memory limit to 24.0 GiB, which is 75% of total available memory (32.0 GiB).
[2023-10-12T19:36:21Z INFO  re_sdk_comms::server] Hosting a SDK server over TCP at <IP_ADDRESS>:9876. Connect with the Rerun logging SDK.
[2023-10-12T19:36:21Z DEBUG eframe] Using the wgpu renderer
[2023-10-12T19:36:21Z DEBUG eframe::native::run] Entering the winit event loop (run_return)…
[2023-10-12T19:36:21Z DEBUG eframe::native::file_storage] Loading app state from "/Users/bosporos/Library/Application Support/rerun/app.ron"…
[2023-10-12T19:36:21Z DEBUG eframe::epi] Failed to decode RON: 1:474: Unexpected missing field `generation` in `SerializedElement`
[2023-10-12T19:36:21Z DEBUG egui_winit::clipboard] Initializing arboard clipboard…
[2023-10-12T19:36:21Z DEBUG re_viewer::native] wgpu adapter name: "Apple M1 Max", device_type: IntegratedGpu, backend: Metal, driver: "", driver_info: ""

Rerun caught a signal: SIGSEGV
Troubleshooting Rerun: https://www.rerun.io/docs/getting-started/troubleshooting
Report bugs: https://github.com/rerun-io/rerun/issues

      re_crash_handler::install_signal_handler::signal_handler
             at re_crash_handler/src/lib.rs:171:25
   4: _OSAtomicTestAndClearBarrier
   5: <unknown>
   6: <unknown>
   7: <unknown>
   8: <unknown>
   9: <unknown>
  10: <unknown>
  11: <unknown>
  12: <unknown>
  13: <unknown>
  14: <unknown>
  15: <unknown>
  16: eframe::native::app_icon::set_title_and_icon_mac
             at eframe-0.23.0/src/native/app_icon.rs:225:28
      eframe::native::app_icon::set_title_and_icon
             at eframe-0.23.0/src/native/app_icon.rs:64:12
      eframe::native::app_icon::AppTitleIconSetter::update
             at eframe-0.23.0/src/native/app_icon.rs:25:27
  17: eframe::native::epi_integration::EpiIntegration::update
             at eframe-0.23.0/src/native/epi_integration.rs:521:9
  18: <eframe::native::run::wgpu_integration::WgpuWinitApp as eframe::native::run::WinitApp>::run_ui_and_paint
             at eframe-0.23.0/src/native/run.rs:1372:17
  19: eframe::native::run::run_and_return::{{closure}}
             at eframe-0.23.0/src/native/run.rs:169:17
  20: <winit::platform_impl::platform::app_state::EventLoopHandler<T> as winit::platform_impl::platform::app_state::EventHandler>::handle_nonuser_event::{{closure}}
      winit::platform_impl::platform::app_state::EventLoopHandler<T>::with_callback
             at winit-0.28.7/src/platform_impl/macos/app_state.rs:70:13
      <winit::platform_impl::platform::app_state::EventLoopHandler<T> as winit::platform_impl::platform::app_state::EventHandler>::handle_nonuser_event
             at winit-0.28.7/src/platform_impl/macos/app_state.rs:91:9
  21: winit::platform_impl::platform::app_state::Handler::handle_nonuser_event
             at winit-0.28.7/src/platform_impl/macos/app_state.rs:199:21
  22: winit::platform_impl::platform::app_state::AppState::cleared
             at winit-0.28.7/src/platform_impl/macos/app_state.rs:388:13
  23: winit::platform_impl::platform::observer::control_flow_end_handler::{{closure}}
             at winit-0.28.7/src/platform_impl/macos/observer.rs:79:21
      winit::platform_impl::platform::observer::control_flow_handler::{{closure}}
             at winit-0.28.7/src/platform_impl/macos/observer.rs:41:9
      std::panicking::try::do_call
             at std/src/panicking.rs:500:40
      std::panicking::try
             at std/src/panicking.rs:464:19
      std::panic::catch_unwind
             at std/src/panic.rs:142:14
      winit::platform_impl::platform::event_loop::stop_app_on_panic
             at winit-0.28.7/src/platform_impl/macos/event_loop.rs:245:11
      winit::platform_impl::platform::observer::control_flow_handler
             at winit-0.28.7/src/platform_impl/macos/observer.rs:39:5
      winit::platform_impl::platform::observer::control_flow_end_handler
             at winit-0.28.7/src/platform_impl/macos/observer.rs:74:9
  24: <unknown>
  25: <unknown>
  26: <unknown>
  27: <unknown>
  28: <unknown>
  29: <unknown>
  30: <unknown>
  31: <unknown>
  32: <unknown>
  33: <unknown>
  34: winit::platform_impl::platform::event_loop::EventLoop<T>::run_return::{{closure}}
             at winit-0.28.7/src/platform_impl/macos/event_loop.rs:220:22
      objc2::rc::autorelease::autoreleasepool
             at objc2-0.3.0-beta.3.patch-leaks.3/src/rc/autorelease.rs:313:5
      winit::platform_impl::platform::event_loop::EventLoop<T>::run_return
             at winit-0.28.7/src/platform_impl/macos/event_loop.rs:211:25
  35: <winit::event_loop::EventLoop<T> as winit::platform::run_return::EventLoopExtRunReturn>::run_return
             at winit-0.28.7/src/platform/run_return.rs:51:9
      eframe::native::run::run_and_return
             at eframe-0.23.0/src/native/run.rs:147:16
      eframe::native::run::wgpu_integration::run_wgpu::{{closure}}
             at eframe-0.23.0/src/native/run.rs:1566:17
      eframe::native::run::with_event_loop::{{closure}}
             at eframe-0.23.0/src/native/run.rs:130:9
      std::thread::local::LocalKey<T>::try_with
             at std/src/thread/local.rs:270:16
      std::thread::local::LocalKey<T>::with
             at std/src/thread/local.rs:246:9
      eframe::native::run::with_event_loop
             at eframe-0.23.0/src/native/run.rs:124:16
  36: eframe::native::run::wgpu_integration::run_wgpu
             at eframe-0.23.0/src/native/run.rs:1563:13
      eframe::run_native
             at eframe-0.23.0/src/lib.rs:233:13

Rerun caught a signal: SIGSEGV
Troubleshooting Rerun: https://www.rerun.io/docs/getting-started/troubleshooting
Report bugs: https://github.com/rerun-io/rerun/issues

[1]    90506 segmentation fault  RUST_LOG=debug target/debug/rerun

Desktop (please complete the following information):

OS: macOS Monterey 12.5 (running on M1 Max)

Rerun version
0.9.0, 0.9.1, 0.10.0-alpha.5, main@commit 432d7d2.

Thanks for the bug report @max-cura, and sorry you had that happen!
Would you mind seeing if you can run through the python quick start on your system?

Also segfaults;
I ran pip3 install rerun-sdk then ran python3 -m rerun_demo, which gave
Rerun caught a signal: SIGSEGV
Troubleshooting Rerun: https://www.rerun.io/docs/getting-started/troubleshooting
Report bugs: https://github.com/rerun-io/rerun/issues

Rerun caught a signal: SIGSEGV
Troubleshooting Rerun: https://www.rerun.io/docs/getting-started/troubleshooting
Report bugs: https://github.com/rerun-io/rerun/issues

/opt/homebrew/lib/python3.11/site-packages/rerun_sdk/rerun_demo/__main__.py:24: DeprecationWarning: Please migrate to `rr.log(…, rr.Points2D(…))` or `rr.log(…, rr.Points3D(…))`.
  See: https://www.rerun.io/docs/reference/migration-0-9 for more details.
  rr.log_points("cube", positions=cube.positions, colors=cube.colors, radii=0.5)

We tested 0.9.1 on  MacOs 14.0 and 13.4 but I don't think anyone else tried 12.5.
Given that it crashes inside a setting the app icon (eframe::native::app_icon::AppTitleIconSetter::update) it's not unlikely that this is about your older Mac version.
I know it's a big ask, but would you mind trying if the problem persists after updating your system?

Hi again @max-cura, thanks for checking with Python! Before potentially upgrading your OS, perhaps you could try out a simpler eframe based app that also uses a custom app icon like https://crates.io/crates/puffin_viewer just to confirm our suspicion?

Yeah, installed puffin_viewer and it indeed has the same pattern (segfault on start, no segfault if started in lldb).
I'll try updating my system tonight.

Upgraded to macOS 14.0.
Tried to run the Rust rerun-cli again, got this:
[2023-10-14T05:12:49Z INFO  re_sdk_comms::server] Hosting a SDK server over TCP at <IP_ADDRESS>:9876. Connect with the Rerun logging SDK.

Rerun caught a signal: SIGBUS
Troubleshooting Rerun: https://www.rerun.io/docs/getting-started/troubleshooting
Report bugs: https://github.com/rerun-io/rerun/issues

   2: re_crash_handler::install_signal_handler::signal_handler
   3: __platform_memmove
   4: <unknown>
   5: <unknown>
   6: <unknown>
   7: <unknown>
   8: <unknown>
   9: <unknown>
  10: <unknown>
  11: <unknown>
  12: <unknown>
  13: <unknown>
  14: <unknown>
  15: eframe::native::epi_integration::EpiIntegration::update
  16: <eframe::native::run::wgpu_integration::WgpuWinitApp as eframe::native::run::WinitApp>::run_ui_and_paint
  17: eframe::native::run::run_and_return::{{closure}}
  18: <winit::platform_impl::platform::app_state::EventLoopHandler<T> as winit::platform_impl::platform::app_state::EventHandler>::handle_nonuser_event
  19: winit::platform_impl::platform::app_state::Handler::handle_nonuser_event
  20: winit::platform_impl::platform::app_state::AppState::cleared
  21: std::panicking::try
  22: winit::platform_impl::platform::observer::control_flow_end_handler
  23: <unknown>
  24: <unknown>
  25: <unknown>
  26: <unknown>
  27: <unknown>
  28: <unknown>
  29: <unknown>
  30: <unknown>
  31: <unknown>
  32: <unknown>
  33: winit::platform_impl::platform::event_loop::EventLoop<T>::run_return
  34: eframe::native::run::with_event_loop
  35: eframe::native::run::wgpu_integration::run_wgpu
  36: eframe::run_native

Rerun caught a signal: SIGBUS
Troubleshooting Rerun: https://www.rerun.io/docs/getting-started/troubleshooting
Report bugs: https://github.com/rerun-io/rerun/issues

[1]    3848 bus error  rerun

Error persisted after reinstalling rerun-cli.
Same as before, no error when starting from lldb.

Thanks for upgrading your system and trying again. This is pretty bad indeed

I wonder what makes @max-cura:s computer different from mine. Have you tried attaching a debugger @max-cura?

@emilk: If you read further up on the issue, max wrote that attaching the debugger removed the problem.

@max-cura you're still hitting this I assume? It's been a few version and as far as we know no other user ran into this this 😕


What about conversion to Swift 3.0?

Shouldn't you convert it to Swift 3.0 since Xcode 8 is in release mode?:-) Waiting for your reply.... Cheers.

This is in progress, however it's not mandatory yet. Swift 2.3 is completely compatible with Xcode 8.


Node disk unit error? [ValueError: invalid literal for int() with base 10: '51175Mi']

Hi,
Just ran the disk command with: python kube-node-usage.py --disk but it fails with the following error:
# Kube-Node-Usage
# Release 2.0.0
# https://github.com/AKSarav/Kube-Node-Usage

Traceback (most recent call last):
  File "/home/chris/workspace/Kube-Node-Usage/kube-node-usage.py", line 361, in <module>
    main()
  File "/home/chris/workspace/Kube-Node-Usage/kube-node-usage.py", line 352, in main
    action(usagetype, sortby, isreverse, filternodes, filtercolors)
  File "/home/chris/workspace/Kube-Node-Usage/kube-node-usage.py", line 165, in action
    max_inmb=round(int(maximum) / 1024 / 1024)
ValueError: invalid literal for int() with base 10: '51175Mi'

From the kubectl get nodes -o json command output; here is an example of the returned values:
                "allocatable": {
                    "cpu": "40",
                    "ephemeral-storage": "50977832921",
                    "hugepages-1Gi": "0",
                    "hugepages-2Mi": "0",
                    "memory": "65491060Ki",
                    "pods": "110"
                },
                "capacity": {
                    "cpu": "40",
                    "ephemeral-storage": "51175Mi",
                    "hugepages-1Gi": "0",
                    "hugepages-2Mi": "0",
                    "memory": "65491060Ki",
                    "pods": "110"
                },

Is this an issue with the k8s format?
For information, here is the version of k8s:
kubectl version
Client Version: version.Info{Major:"1", Minor:"25", GitVersion:"v1.25.4", GitCommit:"872a965c6c6526caa949f0c6ac028ef7aff3fb78", GitTreeState:"clean", BuildDate:"2022-11-09T13:36:36Z", GoVersion:"go1.19.3", Compiler:"gc", Platform:"linux/amd64"}
Kustomize Version: v4.5.7
Server Version: version.Info{Major:"1", Minor:"22", GitVersion:"v1.22.7+k3s1", GitCommit:"8432d7f239676dfe8f748c0c2a3fabf8cf40a826", GitTreeState:"clean", BuildDate:"2022-02-24T23:03:47Z", GoVersion:"go1.16.10", Compiler:"gc", Platform:"linux/amd64"}

Hope this will help.
Regards,
Chris

In the new release powered by Go Lang - I am not using Kubectl anymore and using K8s Client SDK and API - Please check if this resolves the issue - as I have reproduced this is no longer appearing
Thanks for pointing this issue - you were one of the reason for me to rewrite this implementation with K8s API instead of Kubectl


How to estimate power, area and performance of the eTeak generated circuits?

eTeak as the same as its predecessor counterpart, the Balsa synthesis system, reports area estimation of the generated Verilog circuit. However, this highly depends on the utilised cell library (ASIC/FPGA) and, hence the technology mapping process performed by the tool.
Similar to any high-level synthesis tool eTeak/Balsa generated Verilog code can be synthesised using conventional synchronous EDAs such as Synopsys. Thereafter the technology mapped circuits can be simulated for timing analysis and critical path evaluation. You certainly need a harness file for you design at this stage.
It is also possible to generate switching activity file (.vcd) for power assessments which is more accurate and realistic than the power estimation techniques performed by the tools based on the circuit models.

I have done an asynchronous design, and have achieved its verilog code.
Now, I need to do power estimation for my design.
I saw in the papers like [1], that Synopsys can be used in this purpose, i.e. it receives also asynchronous verilog code for power analysis.
But when I tried synopsys, I realized that it needs input clock for analysis.
Then, what should I do?
Is there any manual or example that you can refer or provide?
[1].Oh, Myeong-Hoon, et al. "Architectural Design Issues in a Clockless 32 Bit Processor Using an Asynchronous HDL." ETRI Journal 35.3 (2013): 480-490.

Absolutely and well done on using eTeak,
after mapping the design and producing the Verilog netlist you can simply follow the instructions below to drive synopsys: Note that you will need to produce foo.vcd from simulation after tech mapping. you can use vcd2saif from synopsys to convert foo.vcd to foo.saif:
analyze -format verilog
elaborate teak_Sorter -architecture verilog -library WORK
current_design
link
saif_map -start
compile -exact_map -map_effort medium -area_effort medium
read_saif -auto_map_name -instance_name DUT -input foo.saif
report_power

I have followed the instructions to evaluate power performance of my design. Towards this end,after set address in teak_inclusions.v I have run "harness.v" file.
However, it results an error as follows:

From my point of view, there is something wrong with teak_top, because the software cannot define DUT.

I have developed my Balsa code, and done the synthesis (including buffering and optimization).
Then, I tried to simulate it, and it worked successfully without displaying error message in the terminal.
I saw that only the .vcd file contains data. I used this .vcd file to analyze the power consumption of my design. The power analyzer of synopsys responds that ''No switching activity has been annotated''. My insight to this problem is that the vcd file only contains the inputs to the design, and it doesn't contain the outputs.
I will appreciate if one provides a start pack for beginners which includes:   a sample test in Balsa language, its synthesized version in Verilog,  its harness, the outputs files resulted from the simulation (out.dat and report). Then I will be able to track what has caused this problem. Thank you guys in advance.

use vcd2saif of Synopsys to convert your vcd to saif format.
(tho It was mentioned in the previous comment)


Counting only non null values in pivot table

Hello Doug,
really appreciate creation of such useful tool.
I am not yet much familiar with it, but I suppose that I have found an error.
I have plenty of data, this is how my script looks like:
import-csv $file.FullName -Delimiter ";"| Export-Excel "C:\temp\tempPivot.xlsx" `
-Show `
-IncludePivotTable `
-PivotDataToColumn `
-PivotRows 'Provider' `
-PivotTableName "Pivot PowerShell" `
-PivotData @{'Target'='count';'GN'='count'}`
-PivotTotals "Both"`

The clue is, that Target and GN should have different counts, because GN is not often filled. Unfortunately, I have always receive the same values.
Furthermore, In this excel workbook, I have always receive the same amounts.
Opening new instance and creating pivot table - expected results.
Is this something wrong there, or I am doing this action in wrong way ?

Could you post the CSV?

Not full csv, because it could contain confident data.
I have quite anonymised the sheet and uses less data, and the result looks the same.
The CSV:
test3.txt
And result:

Expected result:

Fixes it
Not sure this is the best answer. May give some clues.
$xlfile="$env:TEMP\test.xlsx"
rm $xlfile -ErrorAction SilentlyContinue

$d=Import-Csv c:\temp\test3.txt -Delimiter ';'

$d | % {if($_.gn.length -eq 0) {$_.gn=$null}}

$d | Export-Excel $xlfile -Show -AutoSize -IncludePivotTable -PivotDataToColumn -PivotRows 'Provider' -PivotTableName "Pivot PowerShell" -PivotData @{'Target'='count';'GN'='count'} -PivotTotals "Both" -Activate

Hello Doug,
I can agree - this fixes my issue, really thanks :)
But I have one more question - is it possible to count only distinct values using your library ?

Here is a different way to remove empty cells from a column and a way to count distinct values in a column as well
$xlfile="$env:TEMP\test.xlsx"
rm $xlfile -ErrorAction SilentlyContinue

$d=Import-Csv c:\temp\test3.txt -Delimiter ';'
#Export the data but keep the file open
$excel =  Export-Excel $xlfile -InputObject $d -AutoSize -IncludePivotTable -PivotDataToColumn -PivotRows 'Provider' -PivotTableName "Pivot PowerShell" -PivotData @{'Target'='count';'GN'='count'} -PivotTotals "Both" -Activate -PassThru

#Find the column where Row 1 contains "gn"
$width = $excel.Sheet1.Dimension.Columns
$gnCol = 1 ; while ($gnCol -le $width -and $excel.Sheet1.Cells[1,$gnCol].value -ne "gn") {$gnCol++}

#make an address which is row 2 to end of data in the "GN" column.
$gnAddress = [OfficeOpenXml.ExcelAddress]::new(2,$gnCol,$excel.Sheet1.Dimension.Rows,$gnCol).Address

#for each cell in that address range, if the cell holds an empty string, clear the cell.
foreach ($cell in $excel.Sheet1.Cells[$gnAddress]) {if ($cell.value -eq "") { $cell.clear()}}

#Find the column where Row 1 contains "Provider"
$providerCol = 1 ; while ($providerCol -le $width -and $excel.Sheet1.Cells[1,$providerCol].value -ne "Provider") {$providerCol++}

#make an address which is row 2 to end of data in the "Provider" column.
$providerAddress = [OfficeOpenXml.ExcelAddress]::new(2,$providerCol,$excel.Sheet1.Dimension.Rows,$providerCol).Address

#create a hash table which holds True (or anything you want) for each value found in the provider range.
$hash = @{}
foreach ($cell in $excel.Sheet1.Cells[$providerAddress]) {if ($cell.value.tostring() -ne "") { $hash[$cell.value] = $true }}

#the number of entries in the hash will be the number of distinct providers. store that somewhere
$excel.'Pivot PowerShell'.cells["A12"].Value = "Distinct Providers"
$excel.'Pivot PowerShell'.cells["B12"].Value = $hash.Count

Close-ExcelPackage -Show $excel

Alternatively you can use this before exporting
$hash = @{} ; foreach ($row in $d) {if (-not $hash[$row.provider]) {Add-Member -InputObject $row -MemberType NoteProperty -name FirstProv  -Value $row.provider; $hash[$row.provider] = $true }}
You can then use the "firstProv" column in the pivot table - BUT excel does not have a way of counting unique values in a pivot so if you want to count given unique providers for each last date, that hash needs to use $rowProvider+$row."last date".tostring() as a key.
@dfinke  - Is it worth adding any of the above to the examples ?. The pattern "I'm not sure which column gn will be, but find it and do things to it" (e.g. apply conditional formatting) is one that has come up more than once IIRC.

Yeah, my first shot was to try countif instead of count -PivotData @{'Target'='count';'GN'='count'}}`.
No go.
It might be worth adding as examples, feels like the typical data scrubbing challenges that come with this analysis.
Having examples to point to can give folks clues.
Been playing with building this.


Action buttons move up when the add/plus button is clicked

I use the action buttons on a scrollview but when i click the plus button, all sub-buttons appear but they are translated upward. What might be causing this? Thanks!

Can you post a screenshot ?

Even when i dont add the "Related Content" button and Ad view at the bottom, the flaoting action buttons still move.

Ok, let me check, are you using swift ? Cos i havent tested it out in swift

I'm using Objective-C. And the value for withScrollView is a webview's scrollview.
withScrollview:self.webView.scrollView

Hi @gizmoboy7! Any update on this? Thanks!

Got the same issue after changed UINavigationBar backgroundImage.
Add below code and issue happens:
UINavigationBar *navBar = [[self navigationController] navigationBar];
UIImage *backgroundImage = [UIImage imageNamed:@"MyNavigationBarBackground"];
[navBar setBackgroundImage:backgroundImage forBarMetrics:UIBarMetricsDefault];

I fix this issue in a project using:
In My ViewController.m I remove the NavigationBar and StatusBar height size.
CGRect frame = CGRectMake(size.width - FAB_SIZE - MARGIN,
                          size.height - FAB_SIZE - MARGIN - navBarHeight - statusBarHeight,
                          FAB_SIZE,
                          FAB_SIZE);

I defined a new method in the VCFloatingActionButton.h
-(id)initWithFrame:(CGRect)frame
       normalImage:(UIImage*)passiveImage
   andPressedImage:(UIImage*)activeImage
    withScrollview:(UIScrollView*)scrView
  andNavigationBar:(UINavigationBar*)navBar;

and Here the implementation of the new Method in VCFloatingActionButton.m
-(id)initWithFrame:(CGRect)frame
       normalImage:(UIImage*)passiveImage
   andPressedImage:(UIImage*)activeImage
    withScrollview:(UIScrollView*)scrView
  andNavigationBar:(UINavigationBar*)navBar {

  self = [self initWithFrame:frame normalImage: passiveImage andPressedImage:activeImage withScrollview:scrView];

  if(navBar) {
      int statusBar = [UIApplication sharedApplication].statusBarFrame.size.height;

      _buttonView.frame = CGRectMake(frame.origin.x,
                                     frame.origin.y + navBar.frame.size.height + statusBar,
                                     frame.size.width,
                                     frame.size.height);

      _menuTable.frame = CGRectMake(SCREEN_WIDTH/4,
                                    0,
                                    0.75*SCREEN_WIDTH,
                                    SCREEN_HEIGHT - (SCREEN_HEIGHT - CGRectGetMaxY(self.frame) - navBar.frame.size.height - statusBar) );
    }
    return self;
}


Multi-token pop-up is not appearing a second time after the user tries to change the token on the enter amount page.

Frequency: 100%
Repro on build version: Android Internal Release Build V1.29.0, iOS Test flight Release Build V1.29.0
Repro on devices: iPhone 13 mini (15.1.1), Samsung Galaxy A9 Pro(8.0), iPhone 12(14.7.1), Samsung Galaxy F41 (11.0)
Does Not Repro on build version: Android Internal Release Build V1.28.1, iOS Test flight Release Build V1.28.1
Does Not Repro on devices: iPhone 12(14.7.1), iPhone 13 mini (15.1.1), Google Pixel 2XL(11.0)
Pre-condition:

User must have installed the application and completed the onboarding flow.
User must have multiple tokens balance in the account.
User must be on the enter amount screen.

Repro Steps:

Enter the amount in the field.
Tap on Select token pop-up and select the token.
Again enter the amount in the field.
Tap on select token pop-up and observe.

Bug: Multi-token pop-up is not appearing a second time after the user tries to change the token on the enter amount page.
Expected Behavior: Multi-token pop-up should appear second time when user tries to change the token on the enter amount page.
Investigation:

For request flow also multi-token pop-up is not appearing a second time after the user tries to change the token on the enter amount page.
When user clicks on the same Dapp section for second time pop-up is not appearing and same is also happening for recent Dapp section. Dapp.mp4

.Impact: Bad user impact as user is not able to select the token for the second time.
Attachment: Select Token.mp4

Hey @MuckT, We have verified the above issue on Latest Android Internal Release Build V1.28.1 & Test Flight Release Build and observed that the issue is fixed now. Multi-token pop-up is appearing a second time after the user tries to change the token on the enter amount page.
Devices: iPhone 13 mini(15.1.1), iPhone SE 2020(14.8.1), Google Pixel 2XL (11.0), Google Pixel XL (10.0)
Attachments: Select Token.mp4
Thanks..!!


Action fails if source dir is set

Hey there,
since the last update, our company is experiencing issues when running the action.
It seems line 40 of entrypoint.sh (the find command) returns a non-zero exit code if there are folders with subdirectories to delete, as the parent folder might be deleted first and subsequent calls to remove the child directories cause errors.
This would not really be a problem as the deletion succeeds de facto, but the non-zero exit code of find results in a termination of the action. This might be, because -e is set.
The Problem could be countered by using
find . -not -path './.git*' -not -name '.' -exec rm -rf {} \; || true

instead
Best regards

Hello @bengeser, thanks for reporting.
The issue has just been fixed.
If you are using v2 release, just rerun your workflow.
Otherwise, update to v2.2.1.


iOS RN:0.14.2 Border Radius - Blur

Hi, I've found the borders to blur on iOS when setting border radius on less than four corners...
https://rnplay.org/apps/mGNsBQ

RN version:0.14.2
I originally had commented on this issue: https://github.com/facebook/react-native/issues/3040#issuecomment-159937977 but realised the issue is related to Android.

More examples at https://github.com/facebook/react-native/issues/2089

I'm also seeing this:

Fixed in https://github.com/facebook/react-native/commit/b115277d00f54fa7af5d61062c9e3cf362b7c5da

what version of RN did this make it into?  i'm still affected by this issue running:

"react": "15.3.1",
"react-native": "0.33.0",

I'm also seeing this issue still

Still seeing on 0.35.0:

add this style, overflow: 'hidden'