Tracker issue for intree rbd to ceph csi online migration

Describe the bug
This issue track the few changes required to support in tree rbd migration to ceph csi ( Project # https://github.com/ceph/ceph-csi/projects/18) , this allows an in tree rbd user to do  online migration without changing any existing templates. This feature is tracked in kubernetes for v1.23 as alpha under https://github.com/kubernetes/enhancements/pull/2963.
As discussed in CSI calls, currently identified changes are:

[ ] get clusterid from mon
[ ] use a volume handle passed in and support static volume mounting, unmounting and delete operations on existing volumes.

The volume handle would include the mon, pool and image which could be used for above operations.
Additional Context:
https://github.com/ceph/ceph-csi/issues/1725

@humblec any specific reason not to use/suggest the CSI migration tool which is getting developed by @Yuggupta27 and @subhamkrai?

get clusterid from mon
use a volume handle passed in and support static volume mounting, unmounting, and delete operations on existing volumes.

IMO This is an extra burden to the cephcsi supportability point of view
can you please provide more details with examples of why we are taking this approach?

@humblec any specific reason not to use/suggest the CSI migration tool which is getting developed by @Yuggupta27 and @subhamkrai?

@Madhu-1 For offline migration ( taking down the app and untangling from pvc and attaching old pv after renaming to new pvc)  , the  tool can also be used,   as mentioned in the issue, this is an online migration for existing in tree users, the users will be capable to continue using the templates as they do today and everything will be taken care by the kubernetes, they dont want to change any existing templates like SC, PVC...etc . They will be unaware that, the migration is happening ...etc, thats why the migration framework in kubernetes (https://github.com/kubernetes/kubernetes/pull/95361) becomes handy.  Most of the kube intree drivers have been migrated or more are in migration path.
At any point there want to do offline migration , they could make use of the tool as well..  so users are left with good amount of choices and have options for both online and offline migration and make use of Ceph CSI. !!

get clusterid from mon
use a volume handle passed in and support static volume mounting, unmounting, and delete operations on existing volumes.

IMO This is an extra burden to the cephcsi supportability point of view

I dont think so,  these helpers will be ONLY called for migrated volumes and while csi driver process those , that too with very limited usage like mount , unmount ..etc.  Its is same as we currently support static volumes today.  None of the existing functionality would be broken with this change , so it shouldnt be a burden. Also snapshot , cloning ..etc are not supported on these static kind of volumes.

can you please provide more details with examples of why we are taking this approach?

The intree driver has monitor field available with it, so our configmap can be read to get the clusterid if its a migration request.  Almost like we do read clusterid mapping for replication cases...etc.
Once the clusterID is available , rest of the information is available for continuing to support it as static volume.
the volume handle would be same as our static volume case but just got a couple of strings append to it which carry the monitor and pool in it , very bare minimum stuff without any fancy operations on it.

I dont think so, these helpers will be ONLY called for migrated volumes and while csi driver process those , that too with very limited usage like mount , unmount ..etc. Its is same as we currently support static volumes today. None of the existing functionality would be broken with this change , so it shouldnt be a burden. Also snapshot , cloning ..etc are not supported on these static kind of volumes.

yes if we go for offline tools we can support all these features.

I dont think so, these helpers will be ONLY called for migrated volumes and while csi driver process those , that too with very limited usage like mount , unmount ..etc. Its is same as we currently support static volumes today. None of the existing functionality would be broken with this change , so it shouldnt be a burden. Also snapshot , cloning ..etc are not supported on these static kind of volumes.

we don't support DeleteVolume for the static PVC but you have added it to the list. as I already mentioned in https://github.com/ceph/ceph-csi/issues/1725#issuecomment-823225160 not sure it's worth supporting this one with extra effort.
If we really need/want to support this one please  make sure we support only the ceph version mentioned in the readme

I dont think so, these helpers will be ONLY called for migrated volumes and while csi driver process those , that too with very limited usage like mount , unmount ..etc. Its is same as we currently support static volumes today. None of the existing functionality would be broken with this change , so it shouldnt be a burden. Also snapshot , cloning ..etc are not supported on these static kind of volumes.

yes if we go for offline tools we can support all these features.

Yep, iow, at any point in time ( even after online migration has been enabled) , if users want to go with offline migration (now or  later or even only for few volumes) , they can take that route based on the production downtime and feasibility of making other changes for the  consumers of current volumes and its templates.
Online can be an intermediate path as well for many deployments.

I dont think so, these helpers will be ONLY called for migrated volumes and while csi driver process those , that too with very limited usage like mount , unmount ..etc. Its is same as we currently support static volumes today. None of the existing functionality would be broken with this change , so it shouldnt be a burden. Also snapshot , cloning ..etc are not supported on these static kind of volumes.

we don't support DeleteVolume for the static PVC but you have added it to the list. as I already mentioned in #1725 (comment) not sure it's worth supporting this one with extra effort.

As this delete will be only for "migration volumes" it will be a very shim helper function and can be done with it.

If we really need/want to support this one please make sure we support only the ceph version mentioned in the readme

Sure @Madhu-1 , thats the plan :+1:

@humblec I have added one more todo to Remove E2E hacks and do valid migration testing with Kubernetes 1.23 as its released


Support basic DCE and build tags in the compiler

There are 2 cases for the build tags:

neofs-contract has different logic depending on whether Notary is enabled or disabled. This makes our contracts bigger, it would be nice to have the same code base and specify what we need during compilation.
For tests we may want to compile have debugLog function declared non empty and removed from the release version.

I am hoping this could be done without touching compiler at all, this is just about the files we want to include.
As a consequence, it would be nice to support 2 basic DCE cases:

Empty non-exported function call could be safely removed.
If with constant condition can be replaced with a corresponding branch (e.g. if debug { }).

I don't want to complicate our compiler, but these cases (at least the second) seems simple enough.

Do we have build tags anywhere in the package data? Do we want to parse comments? Constant conditions seem to be simple enough to try optimizing them, but conditional compilation (hi #ifdef) for contracts in Go? SCs are relatively simple and they should be simple enough for audit.

Do we have build tags anywhere in the package data? Do we want to parse comments?

Part of the task is to figure it out, but it seems like we could just pass through the build flags to the go command https://github.com/golang/tools/blob/master/go/packages/packages_test.go#L497

SCs are relatively simple and they should be simple enough for audit.

I see your point, but IMO code can be simpler with build tags: for every single scenario (with/without notary) you can see what is actually compiled and used. Also go:build isn't comparable to #ifdef in terms of possible complexity, because tags can only be provided on a per-file basis.


getProfileMainWindow deprecation

The method will be deprecated starting from 0.13.0. Some tests for the profile are still using it. Substituting the call to the function with the one proposed getProfileManager().getCurrentRoi().getProfileWindow()  raises AttributeError in some of the tests.
======================================================================
ERROR: testProfile2D (silx.gui.plot.tools.test.testProfile.TestGetProfilePlot)
Test that the profile plot associated to a stack view is either a
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/marius/Software/silx/build/lib.macosx-10.15-x86_64-3.7/silx/gui/plot/tools/test/testProfile.py", line 631, in testProfile2D
    self.assertIsNone(toolBar.getProfileManager().getCurrentRoi().getProfileWindow())
AttributeError: 'NoneType' object has no attribute 'getProfileWindow'

BTW, there is also test to check that the deprecated functions are still working.


add prov/state parameters to CountryHoliday()

fixes #128
see issue for details :)

Pull Request Test Coverage Report for Build 407

8 of 8 (100.0%)  changed or added relevant lines in 2 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 100.0%

Totals

Change from base Build 387:
0.0%

Covered Lines:
5148

Relevant Lines:
5148

💛  - Coveralls

Thank you :)


Test failure with Matplotlib 3.9.0rc2

Currently, only one test fails; TestComparisons.test_Surface:
_________________________ TestComparisons.test_Surface _________________________

args = (<tests.test_blocks.TestComparisons object at 0x7f59b179b710>,)
kwargs = {}, anim = <animatplot.animation.Animation object at 0x7f59b1592cf0>
fignum = 1, fig = <Figure size 640x480 with 1 Axes>

    @functools.wraps(func)
    def wrapper(*args, **kwargs):
        # First close anything from previous tests
        plt.close("all")

        anim = func(*args, **kwargs)
        if remove_text:
            fignum = plt.get_fignums()[0]
            fig = plt.figure(fignum)
            remove_ticks_and_titles(fig)
        try:
>           _compare_animation(anim, baseline_images, fmt, nframes, tol)

tests/tools.py:86:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _

anim = <animatplot.animation.Animation object at 0x7f59b1592cf0>
expected = 'Blocks/Surface', format_ = '.png', nframes = 3, tol = 0.001

    def _compare_animation(anim, expected, format_, nframes, tol):
        # generate images from the animation
        base_dir, filename = split(join("tests", "baseline_images", expected))
        out_dir = split(join("tests", "output_images", expected))[0]

        if not os.path.exists(out_dir):
            os.makedirs(out_dir)

        anim.save(os.path.join(out_dir, (filename + format_)), writer=BunchOFiles())

        for i in range(nframes):
            image_name = "%s%d%s" % (filename, i, format_)
            expected_name = os.path.join(base_dir, image_name)
            actual_name = os.path.join(out_dir, image_name)

            err = compare_images(expected_name, actual_name, tol, in_decorator=True)

            if not os.path.exists(expected_name):
                raise ImageComparisonFailure("image does not exist: %s" % expected_name)

            if err:
                import base64

                print("import base64")
                for key in ["actual", "expected"]:
                    err[key] = os.path.relpath(err[key])
                    with open(err[key], "rb") as f:
                        print(
                            f"with open(\"{err[key].replace('/','_')}\", \"wb\") as f:\n    f.write(base64.b64decode({base64.b64encode(f.read())}))\n"
                        )

>               raise ImageComparisonFailure(
                    "images not close (RMS %(rms).3f):\n\t%(actual)s\n\t%(expected)s " % err
                )
E               matplotlib.testing.exceptions.ImageComparisonFailure: images not close (RMS 9.279):
E               	tests/output_images/Blocks/Surface0.png
E               	tests/baseline_images/Blocks/Surface0.png

I think some of it might be related to https://github.com/matplotlib/matplotlib/pull/25272 but also, this test seems far to complex for the 3D renderer in Matplotlib (which is not as good as a real 3D renderer.) Since this was also a problem in #13 for 3.8.0rc1, it might be a good idea to simplifiy the dataset for this test.

Yes, it probably would be good to simplify the test. However, I am not sure just changing the data would have helped in this case.
For now, I think I will just keep updating the images for new matplotlib versions :-/


[Doc] linking cmake based project against toml-f using CPM

I'd like to use toml-f as a dependency in my cmake based project and I use CPM to download and compile dependencies.
It would be cool to add a section in the documentation under the "integrate with cmake" part showing how to do this.
Should look like this:
include(cmake/CPM.cmake)
<EMAIL_ADDRESS>target_link_libraries(${LIB_NAME} PUBLIC toml-f::toml-f)

(and 3 lines to link against toml-f is quite amazing IMHO)
If you want to download CPM on the fly, you could also add this:
set(CPM_DOWNLOAD_LOCATION "${CMAKE_BINARY_DIR}/cmake/CPM.cmake")
file(DOWNLOAD https://github.com/cpm-cmake/CPM.cmake/releases/download/v0.40.1/CPM.cmake ${CPM_DOWNLOAD_LOCATION})
include(${CPM_DOWNLOAD_LOCATION})

Cheers,
Sebastian

Contributions are welcome, feel free to sent a patch for adding this to the docs.


freetype crashes

Hello,
from what i can tell im not missing anything from the example, outside of the fact that im using kotlin.
Im getting this error message in my browser when FreeType is initialized:

Ive used gdx-liftoff to generate my project and the teavm module has the neccessary extension to work with freetype.
Im using my generator like this:
val params = FreeTypeFontGenerator.FreeTypeFontParameter().apply {
    this.size = size
    borderColor = com.badlogic.gdx.graphics.Color.BLACK
    borderWidth = 2F
}

val font: BitmapFont
FreeTypeFontGenerator(Gdx.files.internal("font.ttf")).apply {
    font = generateFont(params)
    dispose()
}

But i doubt that that is the issue, as it crashes even without the generator, when im manually calling FreeType.initFreeType();
Id be very thankfull if you could point me in the right direction here :)

Hey @SvenWollinger, if you still have the same problem try updating to the latest version, that has fixed it for me (b4 -> b6)


dataVolumesFromService is not working for LB services.

Server version - Build from master on 5/29
Steps to reproduce the problem:
Created environment - e1.
Created a service S1 in e1 and activated it.
Created a LB service S2 with dataVolumesFromService pointing to S1.
Activate environment.
LB Agents from S2, do not have VolumesFrom set.

What's the use-case for a load balancer/ load balancer service needing volumesFrom?  The UI doesn't show the option on balancers.

Tested with server version - V0.23.0-rc1
Created environment - e1.
Created a service S1 in e1 and activated it.
Created a LB service S2 with dataVolumesFromService pointing to S1.
Activate environment.
LB Agents from S2 have VolumesFrom set.


pyflyte run imperative workflows

TL;DR
support running imperative workflow by using pyflyte run.
https://github.com/flyteorg/flyte/issues/2706
we try to get the module name from extract_task_module, but it doesn't work for imperative workflow.
You will get the below error when using pyflyte run to run an imperative workflow.
(flytekit-3.9) ➜  flytekit git:(master) ✗ pyflyte --config ~/.flyte/config-remote.yaml run --remote example_imperative.py wf --in1 2 --in2 3
/Users/kevin/opt/anaconda3/envs/flytekit-3.9/lib/python3.9/site-packages/paramiko/transport.py:236: CryptographyDeprecationWarning: Blowfish has been deprecated
  "class": algorithms.Blowfish,
Traceback (most recent call last):
  File "/Users/kevin/opt/anaconda3/envs/flytekit-3.9/bin/pyflyte", line 8, in <module>
    sys.exit(main())
  File "/Users/kevin/opt/anaconda3/envs/flytekit-3.9/lib/python3.9/site-packages/click/core.py", line 1128, in __call__
    return self.main(*args, **kwargs)
  File "/Users/kevin/opt/anaconda3/envs/flytekit-3.9/lib/python3.9/site-packages/click/core.py", line 1053, in main
    rv = self.invoke(ctx)
  File "/Users/kevin/opt/anaconda3/envs/flytekit-3.9/lib/python3.9/site-packages/click/core.py", line 1659, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/Users/kevin/opt/anaconda3/envs/flytekit-3.9/lib/python3.9/site-packages/click/core.py", line 1659, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/Users/kevin/opt/anaconda3/envs/flytekit-3.9/lib/python3.9/site-packages/click/core.py", line 1659, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/Users/kevin/opt/anaconda3/envs/flytekit-3.9/lib/python3.9/site-packages/click/core.py", line 1395, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/Users/kevin/opt/anaconda3/envs/flytekit-3.9/lib/python3.9/site-packages/click/core.py", line 754, in invoke
    return __callback(*args, **kwargs)
  File "/Users/kevin/git/flytekit/flytekit/clis/sdk_in_container/run.py", line 539, in _run
    remote_entity = remote.register_script(
  File "/Users/kevin/git/flytekit/flytekit/remote/remote.py", line 596, in register_script
    upload_location, md5_bytes = fast_register_single_script(
  File "/Users/kevin/git/flytekit/flytekit/tools/script_mode.py", line 102, in fast_register_single_script
    _, mod_name, _, script_full_path = extract_task_module(wf_entity)
  File "/Users/kevin/git/flytekit/flytekit/core/tracker.py", line 237, in extract_task_module
    name = f.__name__.split(".")[-1]
AttributeError: 'ImperativeWorkflow' object has no attribute '__name__'

we can't also use inspect.getmodule to get module name because inspect.getmodule(<imperative_wf>).__name__ is always equal to flytekit.core.workflow
basically, it's unnecessary to get a module name from an entity by calling extract_task_module because we already have a module name that users specify in the pyflyte run command.
To address this issue, we can use the module name passed in the pyflyte run instead
Type

[x] Bug Fix
[ ] Feature
[ ] Plugin

Are all requirements met?

[x] Code completed
[ ] Smoke tested
[x] Unit tests added
[ ] Code documentation added
[ ] Any pending items have an associated Issue

Complete description
How did you fix the bug, make the feature etc. Link to any design docs etc
Tracking Issue
https://github.com/flyteorg/flyte/issues/2706
Follow-up issue
NA

will take a look tomorrow

yes, It's working in the subfolder as well. I've tested it.

can we make it like pyflyte register and pyflyte package in the future?

Not sure what you mean. The reason why it only doesn't work in the pyflyte run is that mod_name in the compress_single_script is generated from extract_task_module, but extract_task_module doesn't work for the imperative workflow. Therefore, we have to use the module name passed from the pyflyte run command.
On the other hand, the pyflyte register uses fast_package, which doesn't require module name. That's why the pyflyte register works now.


Very high and increasing memory usage in browser (wasm) but not as normal executable.

I am working on a small game for some weeks, and every since I started, I noticed that it is using a huge amount of memory running in Google Chrome (and on the iPhone Safari, too, it seems). It won't even start in Firefox or Edge (out of memory error).
Even if I do "nothing" than drawing a static image (intro logo), the RAM usage increases in quarter GB steps, after some short time, there are 30+ GB of memory usage, which immediately vanish when closing the browser tab running the game.
The same code uses a fraction of memory running just from the terminal (and for hours).
Does anybody know what could be wrong there or what's the best way to find out whats the problem here?
The same happens with the last release and master.

If the virtual memory is used, it should be fine even though the memory consumes 30GB or so. If the physical memory is used, this might be a problem.
What about testing a hello-world wasm program in Go without Ebiten?

Well, it is listed as physical memory for the google chrome renderer. When I do memory profiling the JS VM, it just has a few megabytes and shows allocations when I play.

I need to find the smallest version to test.
You could try it by yourself at https://beta.numrix.oderwat.de/ when I didn't destroy it while working on it.

You could try it by yourself at https://beta.numrix.oderwat.de/ when I didn't destroy it while working on it.

Thanks, but Chrome warned this site's certification.

Sure it uses a self-signed certificate. You can just go to http://beta.numrix.oderwat.de/ and not have the warning/encryption through SSL. In the end, it does not really matter. I had used an SSL certificate because some browsers don't allow audio output from iframes if there is no SSL connection.
BTW: This is how they make money because having a self-signed certificate does the same level of encryption but didn't "validate the owner" of the site. Most of the time, it is not really checked by the sellers of certificates, as they only check if you have access to the DNS or E-Mails on that Domain.

I think you are using macOS. How did you show the physical memory?
I showed 'Real memory' with your application, and I didn't see such memory consuming.
Chrome's task manager (probably showing virtual memory usages)

macOS's activity monitor (showing virtual memory usage and real (physical?) memory)

I just checked in Chrome on my new Macbook Air M1, and there it shows more like your values. I also use the activity monitor as your lower image.
My iMac, where it shows the higher values, has 128 GB of RAM. Maybe it has to do with that. Still, I get out of memory in Firefox and Edge directly after loading the page. Also, running on the iPhone uses the battery up in just some minutes and continues even if I close the app, which is another bizarre effect.
Thank you for looking into it. I may try some stuff to get more specific.

I think the situation should be better with the latest version v2.4.2, as https://github.com/hajimehoshi/ebiten/issues/2156 was fixed.
@oderwat Could you check the latest version when you are available? Thanks,

Hi @hajimehoshi, glad to see you coming back to that problem. I just updated everything (I was not touching it for a long time) and wanted to make some tests, but I ran into a problem with transparency. The alpha channel rendering as follows does not work anymore:
cellImg.Fill(color.RGBA{0xff, 0xff, 0, 0x10})

It is only 0 = full transparent. Everything else gets me the full color. Is that known/documented, or is that some bug?
Testing it on my iPhone (same code as before), it works for some time, but then it crashes after some seconds. Independent of using the app or not. I also do not have audio. It also seems to draw some CPU and gets hot, even without doing anything (just showing the static loading screen in Safari).
This newly compiled version is under the same URL as mentioned above.
P.S.: I was about to implement this using Go-App and "raw" canvas or even just HTML5 in the future.
If you want to look into the code or use it for tests, I can invite you to the repository.

Hi @oderwat

cellImg.Fill(color.RGBA{0xff, 0xff, 0, 0x10})

This value doesn't make sense as a premultiplied alpha color. RGB value should not exceed the alpha value (See also https://github.com/hajimehoshi/ebiten/issues/2080).
cellImg.Fill(color.RGBA{0x10, 0x10, 0, 0x10}) or cellImg.Fill(color.NRGBA{0xff, 0xff, 0, 0x10}) should work.
Thanks,

Than you @hajimehoshi
I was not aware of the premultiplication, and as it worked before, I didn't think it was wrong :). This is fixed now!
Sadly, the memory problems are still there. Do you know how to find the culprit (I am probably just doing something else wrong)?

Sadly, the memory problems are still there. Do you know how to find the culprit (I am probably just doing something else wrong)?

If you use Chrome, Chrome's profiling tool should be helpful.
On desktops, you can use go tool pprof.

Another tips are:

Avoid calling ebiten.NewImage* every frame.
Avoid (*ebiten.Image).At or other functions to read pixels.

I removed the last call to ebiten.NewImage* in the render routine and do no poking at pixels anyway. On native OSX, the app is reported with less than 50 MB and stays constant, no matter how long it runs and is being used.
In Chrome, it is the same:

In iOS Safari, it loads the page, and if I don't use the app, it will always run for some time, crash, and then restart the page.  While using Safari Dev Tools connected to my phone, I could not find any error message. An instruments memory trace using instruments does not seem to reveal a lot (I am not experienced with that).

As I said, it gets pretty hot, which seems to be what the instrument's status also finds. Maybe it is not about the memory after all, then? Or it was with older versions and my former newImage heavy code. The app shows that it runs with 6ß fps and 20 tps.
It seems stable on a very cheap Android (up-to-date) phone that we use for testing Wasm PWAs in the low-budget category. But the sound is not working well, and the interface is sluggish. But after some time, it crashes there too. I did not try to figure out how to instrument that.

I agree this is not a memory issue but a CPU issue. 20TPS on iOS Safari seems pretty low.
You can take a profile what function is heavy like this:

If you use wasmserve, please update like this:
go install github.com/hajimehoshi/wasmserve@aab823156ca2de50a7e60bff23d3c46f49a16a19

I serve the Wasm using Nginx as part of all my other servers. The TPS is what I set to make it "less likely" that it takes a lot of CPU. I also do not have screen updates besides outputting the FPS/TPS/Redraw values with text.Draw() and ebitenutil.DrawRect(). But I made progress after going through all code and removing deprecated functions. I did not evaluate what exactly stopped the app from crashing, but I suspect the older ebiten.TouchIDs().
Now I am left with audio problems. It works fine on Mac Desktop in Chrome. I do not get any sound on iOS, and I get sound, but it does not play correctly (for example, it loops or mangles the sound instead of just playing it once). I did not have time to check more details.
P.S.: I am using your wasm audio package solo in another project without problems, so I know it can work.

Hello,
I am running into this issue as well in boxcars. You can reproduce this using v1.3.6. Any browser-specific code is located in this file.
When running as a Linux binary, memory usage remains low.
When running in a browser, memory usage steadily increases by 1 or 2 megabytes every few seconds, even when no additional memory is being allocated by the game.
This may be a Go compiler issue rather than an Ebitengine issue. I am glad to help investigate, just let me know what I can do to help.
Thanks, Hajime, for all that you do.

I hope someone could make a minimized case to reproduce this issue. Thanks

While creating a minimal case I've found my issue is actually caused by a WebSocket library and not Ebitengine. Sorry for the noise.


[Bug] make tailwind should be called tailwind-install instead

What is the problem?
make tailwind feels like it is there to create an output.css file.
But it only installs tailwind if you do not already have it.
As with make templ-install, we should be consistent with the naming.
Operating System
ALL
Architecture Version (x86, x64, arm, etc)
ALL
Steps to reproduce
run make tailwind
Relevant log output
None

I would to Like to work on this issue.
Can you please assign me.

This is yours. I will check the PR

Merged, tnx.


IncentiveCash website registration

Hi, once you reach your max referral you get the error as intended, but if you try to register again (if your max referral is reset) the messages are stacked as in the image below..

I'm struggling to recreate this - can you remember how you got this?

@glowkeeper where you able to recreate? If not probably worth closing this issue down now

Unable to recreate - please close
On Sun, 19 Sept 2021 at 14:42, Sw1fty @.***> wrote:

@glowkeeper https://github.com/glowkeeper where you able to recreate?
If not probably worth closing this issue down now
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/minima-global/Minima/issues/302#issuecomment-922476106,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ACGV6IIZABNUL62KHHBQFW3UCXSFLANCNFSM47BVOWJA
.
Triage notifications on the go with GitHub Mobile for iOS
https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675
or Android
https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.


Use lightweight temporal file dependency

Coverage decreased (-22.6%) to 65.217% when pulling d9cbc99a00343f848ff919437db627e18038cb88 on tmp into 4dfa097816567d4503ab1d00f9a6d8dc12e8a35c on master.


[Addition]:

Hotspot b58 Addresses
11JHAGfrgQzyLGfQfqwrAVtdg8MNjwJns4LAq92SuTLzxTmdppS
119rY5fdL8QHcSReEMQW2NGFj9jNh1sSgzL7B8R2vgDV58rVJzB
11AiYKw8xBTGd341KSXMM9ahNGoi28bMRZMeLLKvNFTZRQxxsdS
11o3RAHKtWxdD1axHR5MwaxToJU69o7774S4ZtcPSvGM5NUxMv
11wyT5g1gbtSoxd2jqCV96bqmasg4E86Mb8QgKbQYz1Q2kM3bNQ
112p7C2wLPRcQcuDx4PK6UCoaiZTRPnny12nvqCk9Cy9NbCC2dPM
112g3uqJo8dyzbz1f38JDwnAWyybgTfEd5RAfVuhRdVaDZmZs1mR
11Aoq4ntAuBZ6E7MAExTdeZdbzbrbgcTAbujmSvZxNdAVWKi9KB
112sLHjDw1s8WWuNvDVuzqNDXJbyMHtqGKzfLxBLkQxwB1Zy4eCk
Discord Handle
malder
Reason(s)
This group of hotspots only witness each other, despite there being 445 other online hotspots within 25 KM
They are Deeper hotspots and they fail to interact with any non-Deeper hotspots in the immediate area.

We have taken into account this addition request in the next iteration of the denylist. Some or all of the Hotspots listed may be added to the denylist. This is an automated comment due to the volume of addition and removal requests. A future tool is in the works to provide more insight into the analysis approach made by the Helium team and community members that maintain this list.


Have a built-in terminal to view VFKit VM

Using @cfergeau  https://github.com/cfergeau/vfkit/tree/pty 's branch it would be great if we could:

Launch a VM with the pseudo-terminal
Have it appear within Podman Desktop similar to the current Terminal screen when going into containers.

Bit of an 'outside the scope of this extension' for now. But nice to have in the future.
I have this somewhat working with only a few vfkit bugs along the way:
https://github.com/containers/podman-desktop-extension-bootc/assets/6422176/e363f1a7-53de-4bf8-98a1-8d461a421df0

Closing this for now as it's "way" outside the scope


add TLS support

Checklist

[X] Used a personal fork of the feedstock to propose changes
[x] Bumped the build number (if the version is unchanged)
[ ] Reset the build number to 0 (if the version changed)
[ ] Re-rendered with the latest conda-smithy (Use the phrase @conda-forge-admin, please rerender in a comment in this PR for automated rerendering)
[ ] Ensured the license file is being packaged.

The reported errors are:
- Encountered problems while solving:
-   - nothing provides requested mbedtls

@jan-janssen maybe the problem is that mbedtls has no windows builds AFAIU. I've opened this issue: https://github.com/conda-forge/mbedtls-feedstock/issues/12

oh, sorry, you have already circumvented the problem! 😄

@conda-forge-admin, please rerender

thanks @brendanf!


[Bug] 边界单元格在编辑状态下，选中框被裁减

Version
1.11.2-alpha.3
Link to Minimal Reproduction
vscreen
Steps to Reproduce
https://www.visactor.io/vtable/demo/edit/edit-cell
Current Behavior

Expected Behavior
蓝色选中框不被裁减
Environment
- OS:
- Browser:
- Framework:

Any additional comments?
No response

预计修复时间：11.29


Git checkout issues when a VS Code workspace has a child directory of git repo as a folder

Issue Type: Bug
Steps to Reproduce:

Create a git repo.
Create a VS Code workspace and save it as e.g. example.code-workspace.
Create a folder inside the git repo, a file inside that folder, and commit.
Create a new branch in the git repo, remove the file and folder, and commit.
Checkout the main branch, and add the folder to the code workspace.
Checkout the other branch.

Expected: the folder and file should be deleted.
Actual: the folder and file stick around, and any attempts to delete them, recreate them, or cd into them results in Permission denied.

Checkout the main branch.

Expected: the folder and file should be recreated without any issue.
Actual: git checkout fails with fatal: cannot create directory at 'folder': Permission denied

When I have git repositories that make use of code workspaces to organize subdirectories, these behavioral inconsistencies are very annoying. I end up having to close VS code, perform the checkout using Git Bash, and reopen VS Code.
VS Code version: Code 1.30.2 (61122f88f0bf01e2ac16bdb9e1bc4571755f5bd8, 2019-01-07T22:54:13.295Z)
OS version: Windows_NT x64 10.0.17134

System Info

Item
Value

CPUs
Intel(R) Core(TM) i7-4770 CPU @ 3.40GHz (8 x 3392)

GPU Status
2d_canvas: enabledchecker_imaging: disabled_offflash_3d: enabledflash_stage3d: enabledflash_stage3d_baseline: enabledgpu_compositing: enabledmultiple_raster_threads: enabled_onnative_gpu_memory_buffers: disabled_softwarerasterization: enabledvideo_decode: enabledvideo_encode: enabledwebgl: enabledwebgl2: unavailable_off

Memory (System)
15.91GB (8.35GB free)

Process Argv

Screen Reader
no

VM
0%

Extensions (13)

Extension
Author (truncated)
Version

npm-intellisense
chr
1.3.0

bracket-pair-colorizer
Coe
1.0.61

vscode-eslint
dba
1.8.0

gitlens
eam
9.4.1

vscode-npm-script
eg2
0.3.5

prettier-vscode
esb
1.8.1

vscode-nuget-package-manager
jmr
1.1.6

theme-monokai-pro-vscode
mon
1.1.9

csharp
ms-
1.17.1

debugger-for-chrome
msj
4.11.1

uuid-generator
net
0.0.3

vetur
oct
0.14.5

gitconfig
sid
2.0.0

(6 theme extensions excluded)

@bpasero Duplicate of https://github.com/Microsoft/vscode/issues/41085, blocked by https://github.com/Microsoft/vscode/issues/3025

Not necessarily a duplicate of #41085, although the two problems are very similar.

This is not necessarily a duplicate of #41085. The issue is not that VS Code does not detect some change in the git branch. The problem is that VS Code somehow prevents git from modifying folders that are part of a code workspace. The issue articulated in #3025 and #41085 is different from this issue.


Can't import libusb using chipwhisperer on MacBook M1, Monterey

Good evening,
I'm trying to use a chipwhisperer on my MacBook M1 and it is using libusb to connect with USB.
When I try to connect to it with :
import chipwhisperer as cw
scope = cw.scope()
I get :
OSError: Could not import libusb dll. Try
pip uninstall libusb1
pip install libusb1
I tried to uninstall it and reinstall it as well as doing the same with brew and libusb but nothing changed.
I also installed pyusb but this didn't change anything.
Could someone help me please ?

I get this detailed search error :
OSError: dlopen(/opt/homebrew/opt/libusb/lib/libusb-1.0.dylib, 0x0006): tried: '/opt/homebrew/opt/libusb/lib/libusb-1.0.dylib' (mach-o file, but is an incompatible architecture (have 'arm64', need 'x86_64')), '/usr/local/lib/libusb-1.0.dylib' (no such file), '/usr/lib/libusb-1.0.dylib' (no such file), '/opt/homebrew/Cellar/libusb/1.0.24/lib/libusb-1.0.0.dylib' (mach-o file, but is an incompatible architecture (have 'arm64', need 'x86_64')), '/usr/local/lib/libusb-1.0.0.dylib' (no such file), '/usr/lib/libusb-1.0.0.dylib' (no such file)

The project you're trying to use appears to require the libusb1  Python package, not PyUSB.

OP asked the question in libusb here.
https://github.com/libusb/libusb/issues/1040
Potential Answer:
https://github.com/vpelletier/python-libusb1/issues/53
https://github.com/pyusb/pyusb/issues/355


How encrypt a bitstream file?

Hi,
is it possible to encrypt a Bitstream file and still being able to use it as an overlay?
In the case, may you provide some hint on how to can do it, please?
Thank you

Yes, this should be possible but it is largely orthogonal to PYNQ. Once you encrypt the bitstream, you should be able to download it with the PYNQ Overlay class.

Hi @ileop, I see your question was already answered. If you are still not satisfied, I need to kindly ask you to redirect your question to our forum: https://discuss.pynq.io
That's the dedicated place to receive support from the community.
The issue tracker here is to report bugs in the codebase.
Closing this now, thanks in advance for your collaboration.


Docker hub rate limit for pro members

Tell us about your request
I would like to see the docker hub rate limit - for utilized and no of left pulls for the day for pro membership
Which service(s) is this request for?
Pro members - for rate limit on docker hub
Tell us about the problem you're trying to solve. What are you trying to do, and why is it hard?
Unlike anonymous user who can see rate limit details, but same doesn't hold good for pro members.
Are you currently working around the issue?
No. we need to have these rate limit details as we are planning for monitoring these docker pull counts
Additional context
Current curl command which doesn give details about rate limit of docker pulls.
curl --head -H "Authorization: Bearer $TOKEN" https://registry-1.docker.io/v2/library/ubuntu/manifests/latest
HTTP/1.1 200 Connection established
HTTP/1.1 200 OK
content-length: 1338
content-type: application/vnd.oci.image.index.v1+json
docker-content-digest: sha256:8a37d68f4f73ebf3d4efafbcf66379bf3728902a8038616808f04e34a9ab63ee
docker-distribution-api-version: registry/2.0
etag: "sha256:8a37d68f4f73ebf3d4efafbcf66379bf3728902a8038616808f04e34a9ab63ee"
date: Thu, 29 Aug 2024 08:50:14 GMT
strict-transport-security: max-age=31536000
docker-ratelimit-source: a645ce4d-4328-42eb-8241-1624241605ef

Thanks for suggestion! We don't have the ability to return rate limit headers for pro accounts at this moment. However we recently launched a dashboard that you can see data for all of your pulls: Hub Usage


Add validation webhook xray

Signed-off-by: Tamal Saha<EMAIL_ADDRESS>

[ ] Write event to operator
[ ] Test webhook after apiserver starts running, otherwise gets into loop

Fixes https://github.com/appscode/voyager/issues/1264


Disk I/O Error on watchOS

i'm Getting fatal disk i/o error whenever i'm trying to read or write. including watch os DB.

We are receiving similar.

@tholder watch os as well?

This is completed. i think, Thanks.


Remove unnecessary extra reader

https://github.com/acmpesuecc/pinger/blob/eac1c46f3e68392b3489a95c66a2449404c2802b/src/main/java/pinger/Pinger.java#L14
This reader is not necessary as there is already another created. Nor is the reader closed. It should be removed and all occurrences of reader1 should be changed to reader

i would like to work on it


Add class Query

This commit adds class Query implementing "query pattern". The API was chosen to be compatible with Smalltalk/X counterpart 1.

The more I am re-reading this code, the more excited I become.  So this program:
^block on: self do: [:q | q resume: value ]

is basically proof of Yoneda, and essentially expresses the meaning of "apply" (cf. Reader and -> in Haskell).  Let's merge this in for now, as a starting point, but I suspect this can serve as the foundation for much deeper results.


MGMT-19390: Update mce's tekton pipelines to be multi-arch

Description

Update the tekton pipelines used to build mce downstream images to be multi-arch.
How was this code tested?

Assignees

/cc @
/cc @
Links

Part-of MGMT-19390
Checklist

[x] Title and description added to both, commit and PR
[x] Relevant issues have been associated
[ ] Reviewers have been listed
[x] This change does not require a documentation update (docstring, docs, README, etc)
[ ] Does this change include unit tests (note that code changes require unit tests)

/test edge-e2e-ai-operator-ztp

/lgtm
/approve


geckodriver problem;how to solve plz help

==> Enter the persons name to find on FB: bjbjb
==> How many jitters, higher is better [max 100] (default=70): 20
==> Opening Webdriver
Traceback (most recent call last):
File "eagle-eye.py", line 228, in
main(skipFB=args.skipfb, FBUrls=[], jsonRep=jsonRepFile, dockerMode=aDocker, dockerName=aName)
File "eagle-eye.py", line 98, in main
f.grabData()
File "/home/kali/EagleEye/grabber/facebook.py", line 16, in grabData
driver = cfg.getWebDriver()
File "/home/kali/EagleEye/utils/config.py", line 45, in getWebDriver
return webdriver.Firefox(profile)
File "/usr/lib/python3/dist-packages/selenium/webdriver/firefox/webdriver.py", line 170, in init
RemoteWebDriver.init(
File "/usr/lib/python3/dist-packages/selenium/webdriver/remote/webdriver.py", line 152, in init
self.start_session(capabilities, browser_profile)
File "/usr/lib/python3/dist-packages/selenium/webdriver/remote/webdriver.py", line 249, in start_session
response = self.execute(Command.NEW_SESSION, parameters)
File "/usr/lib/python3/dist-packages/selenium/webdriver/remote/webdriver.py", line 318, in execute
self.error_handler.check_response(response)
File "/usr/lib/python3/dist-packages/selenium/webdriver/remote/errorhandler.py", line 242, in check_response
raise exception_class(message, screen, stacktrace)
selenium.common.exceptions.SessionNotCreatedException: Message: Unable to find a matching set of capabilities

Had a similar issue, i downloaded kali linux, i ran it in a virtual machine, then used the autoinstall script provided by in the README.md, make sure to execute it in a non-root terminal and solved that issue.
May you should reinstall EagleEye with the autoinstall script, before trying it on a clean linux os image, it might just work and spare yourself the hustle.

Yes it was always tested as a non-root user
thanks @waraga2 :)

Yeah sure thing buddy :)


bug(ci): debug & fix tox -e tests fails with python 3.10 - reenable 3.10 matrix config in CI

#850 consistently failed tox_verify with the Python 3.10 config in the test env with the following test:
=========================== short test summary info ============================
FAILED tests/cancun/eip1153_tstore/test_tstorage.py::test_run_until_out_of_gas[fork_Cancun-blockchain_test-tstore_wide_address_space]
============ 1 failed, 6232 passed, 85 skipped in 252.09s (0:04:12) ============

The error points to a resolver timeout:
=================================== FAILURES ===================================
_ test_run_until_out_of_gas[fork_Cancun-blockchain_test-tstore_wide_address_space] _
[gw3] linux -- Python 3.10.15 /home/runner/work/execution-spec-tests/execution-spec-tests/.tox/tests/bin/python3
.tox/tests/lib/python3.10/site-packages/urllib3/connectionpool.py:468: in _make_request
    six.raise_from(e, None)
.tox/tests/lib/python3.10/site-packages/urllib3/connectionpool.py:463: in _make_request
    httplib_response = conn.getresponse()
../../../.local/share/uv/python/cpython-3.10.15-linux-x86_64-gnu/lib/python3.10/http/client.py:1375: in getresponse
    response.begin()
../../../.local/share/uv/python/cpython-3.10.15-linux-x86_64-gnu/lib/python3.10/http/client.py:318: in begin
    version, status, reason = self._read_status()
../../../.local/share/uv/python/cpython-3.10.15-linux-x86_64-gnu/lib/python3.10/http/client.py:279: in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
../../../.local/share/uv/python/cpython-3.10.15-linux-x86_64-gnu/lib/python3.10/socket.py:717: in readinto
    return self._sock.recv_into(b)
E   TimeoutError: timed out
During handling of the above exception, another exception occurred:
.tox/tests/lib/python3.10/site-packages/requests/adapters.py:667: in send
    resp = conn.urlopen(
.tox/tests/lib/python3.10/site-packages/urllib3/connectionpool.py:802: in urlopen
    retries = retries.increment(
.tox/tests/lib/python3.10/site-packages/urllib3/util/retry.py:552: in increment
    raise six.reraise(type(error), error, _stacktrace)
.tox/tests/lib/python3.10/site-packages/urllib3/packages/six.py:770: in reraise
    raise value
.tox/tests/lib/python3.10/site-packages/urllib3/connectionpool.py:716: in urlopen
    httplib_response = self._make_request(
.tox/tests/lib/python3.10/site-packages/urllib3/connectionpool.py:470: in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
.tox/tests/lib/python3.10/site-packages/urllib3/connectionpool.py:358: in _raise_timeout
    raise ReadTimeoutError(
E   urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=20)
During handling of the above exception, another exception occurred:
tests/cancun/eip1153_tstore/test_tstorage.py:284: in test_run_until_out_of_gas
    state_test(env=Environment(), pre=pre, tx=tx, post=post)
src/pytest_plugins/filler/filler.py:809: in __init__
    fixture = self.generate(
src/ethereum_test_specs/state.py:176: in generate
    return self.generate_blockchain_test().generate(
src/ethereum_test_specs/blockchain.py:731: in generate
    return self.make_fixture(t8n, fork, eips)
src/ethereum_test_specs/blockchain.py:558: in make_fixture
    header, txs, requests, new_alloc, new_env = self.generate_block_data(
src/ethereum_test_specs/blockchain.py:425: in generate_block_data
    transition_tool_output = t8n.evaluate(
src/evm_transition_tool/transition_tool.py:607: in evaluate
    return self._evaluate_server(t8n_data=t8n_data, debug_output_path=debug_output_path)
src/evm_transition_tool/transition_tool.py:426: in _evaluate_server
    response = Session().post(self.server_url, json=post_data, timeout=20)
.tox/tests/lib/python3.10/site-packages/requests/sessions.py:637: in post
    return self.request("POST", url, data=data, json=json, **kwargs)
.tox/tests/lib/python3.10/site-packages/requests/sessions.py:589: in request
    resp = self.send(prep, **send_kwargs)
.tox/tests/lib/python3.10/site-packages/requests/sessions.py:703: in send
    r = adapter.send(request, **kwargs)
.tox/tests/lib/python3.10/site-packages/requests/adapters.py:713: in send
    raise ReadTimeout(e, request=request)
E   requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=20)

The strange thing is that it only failed on 3.10, even though both the 3.10 and 3.12 matrix configs both run on Ubuntu. macOS seems fine (with 3.12). It wasn't reproducible locally with 3.10. As a result, the following matrix config has been temporarily disabled pending resolution, see #850.
          - os: ubuntu-24.04
            python: "3.10"
            evm-type: "stable"
            tox-cmd: "uvx --with=tox-uv tox"  # run-parallel --parallel-no-spinner"  # TODO: disable parallelisation for uv testing

This matrix config never saw a fail:
          - os: ubuntu-24.04
            python: "3.12"
            evm-type: "stable"
            tox-cmd: "uvx --with=tox-uv tox"  # run-parallel --parallel-no-spinner"

Now we are seeing a lot of these:
_ test_valid_inputs[fork_Cancun-blockchain_test-result_Result.SUCCESS-in_bounds_z] _
[gw2] linux -- Python 3.12.6 /home/runner/work/execution-spec-tests/execution-spec-tests/.tox/tests/bin/python3
.tox/tests/lib/python3.12/site-packages/urllib3/connectionpool.py:716: in urlopen
    httplib_response = self._make_request(
.tox/tests/lib/python3.12/site-packages/urllib3/connectionpool.py:416: in _make_request
    conn.request(method, url, **httplib_request_kw)
.tox/tests/lib/python3.12/site-packages/urllib3/connection.py:244: in request
    super(HTTPConnection, self).request(method, url, body=body, headers=headers)
../../../.local/share/uv/python/cpython-3.12.6-linux-x86_64-gnu/lib/python3.12/http/client.py:1336: in request
    self._send_request(method, url, body, headers, encode_chunked)
../../../.local/share/uv/python/cpython-3.12.6-linux-x86_64-gnu/lib/python3.12/http/client.py:1382: in _send_request
    self.endheaders(body, encode_chunked=encode_chunked)
../../../.local/share/uv/python/cpython-3.12.6-linux-x86_64-gnu/lib/python3.12/http/client.py:1331: in endheaders
    self._send_output(message_body, encode_chunked=encode_chunked)
../../../.local/share/uv/python/cpython-3.12.6-linux-x86_64-gnu/lib/python3.12/http/client.py:1091: in _send_output
    self.send(msg)
../../../.local/share/uv/python/cpython-3.12.6-linux-x86_64-gnu/lib/python3.12/http/client.py:1035: in send
    self.connect()
.tox/tests/lib/python3.12/site-packages/requests_unixsocket/adapters.py:35: in connect
    sock.connect(socket_path)
E   ConnectionRefusedError: [Errno 111] Connection refused

I've seen at least two instances where the failure is marked on the first two tests:
4 workers [6318 items]

FF................................................................. [  67/6318]

But I'm not sure if this is a pytest artifact or is it really the first two tests that are consistently failing.


Select game from finder window doesn't show up [macOS 15 Beta 2]

Describe the bug
The finder window to select a game when adding one to phoenix doesn't show up until I drag and drop a game in manually.
To Reproduce
Steps to reproduce the behavior:

Go to "Add game"
Select mac platfrom
Scroll down to "Game"
Click "Browse"

Temporaty fix: Open a new finder window, drag and drop .app file, the "select app" window now shows up
Expected behavior
A "Select app" finder window should open up automatically

macOS Version: macOS 15
Phoenix Version: 0.1.9 (32)

From your buddy, Ari :)

marking as invalid for now bc could be a beta issue :p

nahhh james you cold asf for making this invalid jk jk
I mean we have to fix this before macos 15 does come out tho

bruh no it's apple's problem (potentially)

L


Add pool.SetHelloHostname() to override SMTP HELO hostname (FQDN)

By default, Go's smtp lib uses "localhost" when issuing a HELO to SMTP servers (See https://github.com/mailhog/MailHog/issues/257). Some SMTP servers reject this demanding an FQDN instead.
This PR adds a new method pool.SetHelloHostname() that instructs smtp.Client to use a custom hostname.

LGTM - thanks @knadh!


libbitsandbytes_cpu.so: undefined symbol: cget_col_row_stats

Hello I'm trying to run the generate.py example but I get the following error ("decapoda-research/llama-7b-hf" was previously downloaded) :
===================================BUG REPORT===================================
Welcome to bitsandbytes. For bug reports, please submit your error trace to: https://github.com/TimDettmers/bitsandbytes/issues
================================================================================
/root/anaconda3/envs/alpaca-lora/lib/python3.9/site-packages/bitsandbytes/cuda_setup/main.py:136: UserWarning: /root/anaconda3/envs/alpaca-lora did not contain libcudart.so as expected! Searching further paths...
  warn(msg)
/root/anaconda3/envs/alpaca-lora/lib/python3.9/site-packages/bitsandbytes/cuda_setup/main.py:136: UserWarning: WARNING: The following directories listed in your path were found to be non-existent: {PosixPath('/usr/local/cuda/lib64')}
  warn(msg)
/root/anaconda3/envs/alpaca-lora/lib/python3.9/site-packages/bitsandbytes/cuda_setup/main.py:136: UserWarning: :/usr/local/cuda/lib64/ did not contain libcudart.so as expected! Searching further paths...
  warn(msg)
CUDA_SETUP: WARNING! libcudart.so not found in any environmental path. Searching /usr/local/cuda/lib64...
ERROR: python: undefined symbol: cudaRuntimeGetVersion
CUDA SETUP: libcudart.so path is None
CUDA SETUP: Is seems that your cuda installation is not in your path. See https://github.com/TimDettmers/bitsandbytes/issues/85 for more information.
CUDA SETUP: CUDA version lower than 11 are currently not supported for LLM.int8(). You will be only to use 8-bit optimizers and quantization routines!!
/root/anaconda3/envs/alpaca-lora/lib/python3.9/site-packages/bitsandbytes/cuda_setup/main.py:136: UserWarning: WARNING: No libcudart.so found! Install CUDA or the cudatoolkit package (anaconda)!
  warn(msg)
CUDA SETUP: Highest compute capability among GPUs detected: 7.5
CUDA SETUP: Detected CUDA version 00
CUDA SETUP: Loading binary /root/anaconda3/envs/alpaca-lora/lib/python3.9/site-packages/bitsandbytes/libbitsandbytes_cpu.so...
/root/anaconda3/envs/alpaca-lora/lib/python3.9/site-packages/bitsandbytes/cextension.py:31: UserWarning: The installed version of bitsandbytes was compiled without GPU support. 8-bit optimizers and GPU quantization are unavailable.
  warn("The installed version of bitsandbytes was compiled without GPU support. "
The tokenizer class you load from this checkpoint is not the same type as the class this function is called from. It may result in unexpected tokenization.
The tokenizer class you load from this checkpoint is 'LLaMATokenizer'.
The class this function is called from is 'LlamaTokenizer'.
Loading checkpoint shards:   0%|                                                                                | 0/33 [00:00<?, ?it/s]
Traceback (most recent call last):
  File "/root/projects/alpaca-lora/generate.py", line 13, in <module>
    model = LlamaForCausalLM.from_pretrained(
  File "/root/anaconda3/envs/alpaca-lora/lib/python3.9/site-packages/transformers/modeling_utils.py", line 2646, in from_pretrained
    ) = cls._load_pretrained_model(
  File "/root/anaconda3/envs/alpaca-lora/lib/python3.9/site-packages/transformers/modeling_utils.py", line 2969, in _load_pretrained_model
    new_error_msgs, offload_index, state_dict_index = _load_state_dict_into_meta_model(
  File "/root/anaconda3/envs/alpaca-lora/lib/python3.9/site-packages/transformers/modeling_utils.py", line 676, in _load_state_dict_into_meta_model
    set_module_8bit_tensor_to_device(model, param_name, param_device, value=param)
  File "/root/anaconda3/envs/alpaca-lora/lib/python3.9/site-packages/transformers/utils/bitsandbytes.py", line 70, in set_module_8bit_tensor_to_device
    new_value = bnb.nn.Int8Params(new_value, requires_grad=False, has_fp16_weights=has_fp16_weights).to(device)
  File "/root/anaconda3/envs/alpaca-lora/lib/python3.9/site-packages/bitsandbytes/nn/modules.py", line 196, in to
    return self.cuda(device)
  File "/root/anaconda3/envs/alpaca-lora/lib/python3.9/site-packages/bitsandbytes/nn/modules.py", line 160, in cuda
    CB, CBt, SCB, SCBt, coo_tensorB = bnb.functional.double_quant(B)
  File "/root/anaconda3/envs/alpaca-lora/lib/python3.9/site-packages/bitsandbytes/functional.py", line 1616, in double_quant
    row_stats, col_stats, nnz_row_ptr = get_colrow_absmax(
  File "/root/anaconda3/envs/alpaca-lora/lib/python3.9/site-packages/bitsandbytes/functional.py", line 1505, in get_colrow_absmax
    lib.cget_col_row_stats(ptrA, ptrRowStats, ptrColStats, ptrNnzrows, ct.c_float(threshold), rows, cols)
  File "/root/anaconda3/envs/alpaca-lora/lib/python3.9/ctypes/__init__.py", line 395, in __getattr__
    func = self.__getitem__(name)
  File "/root/anaconda3/envs/alpaca-lora/lib/python3.9/ctypes/__init__.py", line 400, in __getitem__
    func = self._FuncPtr((name_or_ordinal, self))
AttributeError: /root/anaconda3/envs/alpaca-lora/lib/python3.9/site-packages/bitsandbytes/libbitsandbytes_cpu.so: undefined symbol: cget_col_row_stats

I'm running into a conda environment based on python 3.9 and I installed the requirements with pip. Also I compiled the bitsandbytes package from source by running
git clone https://github.com/TimDettmers/bitsandbytes.git
cd bitsandbytes/
make cuda11x
CUDA_VERSION=112
python setup.py install

Here are the nvidia-smi and nvcc --version prints:
Fri Mar 17 13:53:10 2023
+-----------------------------------------------------------------------------+
| NVIDIA-SMI 470.161.03   Driver Version: 470.161.03   CUDA Version: 11.4     |
|-------------------------------+----------------------+----------------------+
| GPU  Name        Persistence-M| Bus-Id        Disp.A | Volatile Uncorr. ECC |
| Fan  Temp  Perf  Pwr:Usage/Cap|         Memory-Usage | GPU-Util  Compute M. |
|                               |                      |               MIG M. |
|===============================+======================+======================|
|   0  Quadro RTX 4000     On   | 00000000:00:10.0 Off |                  N/A |
| 30%   34C    P8     6W / 125W |      1MiB /  7982MiB |      0%      Default |
|                               |                      |                  N/A |
+-------------------------------+----------------------+----------------------+

+-----------------------------------------------------------------------------+
| Processes:                                                                  |
|  GPU   GI   CI        PID   Type   Process name                  GPU Memory |
|        ID   ID                                                   Usage      |
|=============================================================================|
|  No running processes found                                                 |
+-----------------------------------------------------------------------------+

nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2021 NVIDIA Corporation
Built on Sun_Feb_14_21:12:58_PST_2021
Cuda compilation tools, release 11.2, V11.2.152
Build cuda_11.2.r11.2/compiler.29618528_0

which nvcc:
/usr/bin/nvcc
which nvidia-smi:
/usr/bin/nvidia-smi

Any idea what the problem might be? Thank you in advance.

I had the same issue, executing cp libbitsandbytes_cuda117.so libbitsandbytes_cpu.so in the bitsandbytes package folder worked for me- should be in the installation dir for your conda env.

ubuntu@192-9-155-93:~/alpaca-lora$ cp /home/ubuntu/.local/lib/python3.8/site-packages/bitsandbytes/libbitsandbytes_cuda117.so /home/ubuntu/.local/lib/python3.8/site-packages/bitsandbytes/libbitsandbytes_cpu.so

I meet the exact same problem and this works for me

I had the same issue, executing cp libbitsandbytes_cuda117.so libbitsandbytes_cpu.so in the bitsandbytes package folder worked for me- should be in the installation dir for your conda env.

Thank you so much

I ran into a similar problem, but after executing cp libbitsandbytes_cuda117.so libbitsandbytes_cpu.so, and then compiling the model, there was a new problem: CUDA Setup failed despite GPU being available. Inspect the CUDA SETUP outputs above to fix your environment!


Pumphistory safety checks

@hilarykoch recently experienced an A52 error that rebooted the pump and somehow caused decocare/openaps to prematurely stop parsing pumphistory such that it didn't return an error but didn't include recent events.  This in turn resulted in incorrect IOB, causing OpenAPS to overdose insulin, providing Leo with an unscheduled pump break and dessert.
This PR adds some safety checks to make sure that pumphistory is being updated, and that the lastTemp in pumphistory matches the currently running temp basal on the pump.

This is working now: I think it's good to merge.

I've had this happen as well.

@mgranberryto can you describe exactly what happened in your situation?  Did it just fail to read some records, or were new temps and SMBs also not being read?

New temps/SMBs were being unread.  I assumed that it was due to an edited record after the fact, but reading this after the fact I realize that this is the same issue.  It recovered about 6 hours later.


Bug with ending of event

Please, fix bug with ending of event bcz when I create event, for example, from 02:00 to 03:00, in console event show me {start: 02:00, end: 02:01}, I checked, your docs has the same problem (Events-related log)

+1, is there a work around?

Hi @zlodey509, @supersophisticated22,
I'm not sure I understand the issue.
In the documentation in the logs box at https://antoniandre.github.io/vue-cal/#ex--emitted-events, when you click a cell or drag an event end, it will log a time that includes a timezone. this is because the events are JSON stringified in that logs box.
In this screenshot, I resized the bottom of the event, then it logs 12:11 but the endTimeMinutes is correct and if you console.log() it will show up correctly.

If not solved, please reopen with a clear description of the problem and a reproduction where I can see the issue. :)


Peref in NetCDF output

Closes #421.

Thanks. I have to implement the 2D changes also.

Ok, I implemented the 2D case. I compiled from scratch .. which works fine. I tested normal starts and restarts. I haven't checked the data, but they didn't not crash and I got reasonable terminal output.


Adding Metrics Table fo readme.md

Is there an existing issue for this?

[X] I have searched the existing issues

Issue Description
Issue: Add Metrics Table to README
Suggested Change
It would enhance the README file significantly to include a table displaying key repository metrics such as the number of stars, forks, pull requests, and any other relevant statistics. This addition will make the repository more informative and visually appealing to users.
Benefits:

Improves the overall presentation of the README.
Encourages contributions by showcasing community involvement.

KINDLY ASSIGN ME THIS ISSUE
Rationale
No response
Urgency
High
Record

[X] I agree to follow this project's Code of Conduct
[X] I'm a WOB contributor
[X] I want to work on this issue
[X] I'm willing to provide further clarification or assistance if needed.

assigned to you @neeru24 ,
you can also use badges customized : shields.io


bug: cursor jumps with left and right arrows in vscode wsl2 ubuntu

Does this issue occur when all extensions are disabled?: Yes/No
yes

VS Code Version: newest
OS Version: windows 11 newest, ubuntu wsl2 (happens on windows 10 also)

Steps to Reproduce:

use terminal
use left and right arrows
issue happens intermittently

Please provide a screenshot or a gif illustrating the problem (attaching images won't work via email, you need to go to github.com). See this wiki page for more general info on how to report actionable terminal issues.
/label info-needed terminal

This issue has been closed automatically because it needs more information and has not had recent activity. See also our issue reporting guidelines.
Happy Coding!

$ amazon-linux-extras
-bash: amazo-linux-extras: command not found


Background timer on all platforms

I want to find the best way to abstract the differences between the platforms.
@belac9615 I'll try an implementation but then I'll need help testing for iOS.
Android reference: https://developer.android.com/guide/components/services.html

@belac9615 It seems there are quite a few choices for Android here!
https://www.bignerdranch.com/blog/choosing-the-right-background-scheduler-in-android/:

Let’s summarize the main pros and cons of the different methods we dove into:

When using the AlarmManager, keep alarm frequency and device waking to a minimum, add randomness to the alarm’s timing when performing network requests so as to not overload a server, avoid clock time and precise timing unless the application needs to notify the user of something at a specific time, and consider another scheduler for networking.
JobScheduler provides efficient background scheduling, but only if your user is running API level 21 or higher (that’s about 25% of users at the time of writing this post).
GCM Network Manager provides efficient background scheduling—if your user has Google Play Services installed (this excludes Amazon devices). GCMTaskService is typically simpler to manage and more difficult to mess up than JobService.
Sync Adapters are a great solution to sync local data with server data, especially if you already have User authentication and use Content Providers in your application. If you need to support devices running earlier than Android API level 21 in addition to devices without Google Play Services, Sync Adapter may be your best option.
Doze Mode is wonderful in that developers do not need to do a thing to implement this system battery efficiency. AlarmManager and GCM Network Manager are the only options for interrupting a Doze.

I'm not sure which is best. Sync Adapters seem really cool but are much more complex. Is API level 21+ an okay requirement? JobScheduler is recommended by Google in https://developer.android.com/guide/components/services.html.

I suppose it doesn't hurt to stick with starting a service for now.

This person had trouble with timers in a service being unreliable: https://forums.xamarin.com/discussion/5400/timers-in-a-service

Up-to-date market share stats: https://developer.android.com/about/dashboards/index.html

I might see how involved this is: https://forums.xamarin.com/discussion/16721/getting-a-syncadapter-to-work/p1

In order to try the sync adapter route, I'll need the account provider implemented. I'll start there. https://github.com/jnm2/GitNotified/issues/3

Sync adapters do not provide the kind of control we need over how frequently updates are polled. No longer dependent on #3.


Deleting multiple nodes does not always work correctly

This task is automatically imported from the old Task Issue Board and it was originally created by Keziah Wesley.
Original issue is here.

When I do this:

Use the "Create a new project" button on the Welcome Screen to open a new project with two nodes.
Select both nodes.
Press the delete key.

The result I get is: Usually (not always), only one of the selected nodes is deleted.
Expected result: Both nodes should be deleted.
Example video in attachments.
Comments:
(Keziah Wesley - May 17, 2022)

is this still valid?

It was probably fixed in #4084, not reproducible on a current develop. @kazcw, as the original reporter, please create a new issue if it is still the case.


Fix --tiller-namespace flag for plugins

This fixes using --tiller-namespace $namespace flag (without the equal sign) flag for helm plugins.
This was originally raised here: https://github.com/databus23/helm-diff/pull/44

Retriggered the tests...

hmm, SetupPluginEnv already propagates this to plugins through the TILLER_NAMESPACE environment variable. Will that work for you, or is there a particular use case that reading envvars won't work for helm-diff?

oh I see what you mean. LGTM!


Downgrade version in the ReadMe file

Add note about version 1.5.4

Not actual after change default branch to master


Add GetBrowserPid option to browser.go

The process PID can come in handy when there is talk about running a third party software against a remotely controlled browser.
New PR from clean fork

Friendly ping @Ajod. This would also need a test before merging.

Hi, based on your comment that it might not have a purpose I eventually ended up not needing to expose the PID or the Process at all. This would probably a somewhat pointless PR and I should probably close it if that is okay with you

Sounds good, thanks!

hi guys. I want to kown how to get the browser pid when I open it by chromedp.


Error when starting reach when .cache/nvim does not exist

Hi,
When doing a setup on a clean machine I got an error (see bellow); I suspect it was not able to create reach_cache since the folder .cache/nvim did not exist. (I fixed it by creating the .cache/nvim folder.
Is this expected behavior? Or should it create the cache nvim folder if it does not exist?
This is the error that occurs:
Error detected while processing /Users/nacho/.config/nvim/init.vim:
line  216:
E5108: Error executing lua Vim:E482: Can't open file /Users/nacho/.cache/nvim/reach_cache for writing: no such file or directory
stack traceback:
        [C]: in function 'writefile'
        ...acho/.config/nvim/plugged/reach.nvim/lua/reach/cache.lua:46: in function 'read_cache'
        ...acho/.config/nvim/plugged/reach.nvim/lua/reach/cache.lua:74: in function 'load'
        ...acho/.config/nvim/plugged/reach.nvim/lua/reach/cache.lua:63: in function 'setup'
        ...nacho/.config/nvim/plugged/reach.nvim/lua/reach/init.lua:28: in function 'setup'
        /Users/nacho/.config/nvim/lua/init.lua:1: in main chunk
        [C]: in function 'require'
        [string ":lua"]:1: in main chunk
Press ENTER or type command to continue

I don't think that directory should be created manually.
Can you run nvim --version?

NVIM v0.8.1; this happened on WSL2 with Ubuntu on it, it was a clean install, pretty sure I didn't remove it.
I removed it later to see if that was indeed why it was complaining. Maybe you are right in that the plug in should not create it, and I guess usually the folder will already exist anyway, maybe this is a bit of a corner case situation, not sure what the best approach is in this case.

maybe this is a bit of a corner case situation

We'll leave it at that. The directory should be there and if it isn't, it's not an issue for a plugin to fix.


build/depends: commit dashpay/bls-signatures@66ee820f to source tree as vendored

Issue being fixed or feature implemented
Commit dashpay/bls-signatures@66ee820f to source tree as vendored. Resolves https://github.com/dashpay/dash/issues/5025.
What was done?

See above. Implement build system changes needed to supported subtree vendored copy. Remove build-generated file from tracking.
How Has This Been Tested?

Running make check
Breaking Changes

Will force a depends rebuild. Will need to add back removed build-generated file before updating subtree.
Checklist:

[x] I have performed a self-review of my own code
[ ] I have commented my code, particularly in hard-to-understand areas N/A
[x] I have added or updated relevant unit/integration/functional/e2e tests
[ ] I have made corresponding changes to the documentation N/A

For repository code-owners and collaborators only

[ ] I have assigned this pull request to a milestone

Starting Gitian-Build
% python3 dash/contrib/gitian-build.py -b -o mwl -j 8 -m 14000 -D -n -c pasta d431b52dd44ed4576c63169f1608713f08e05702

This broke develop unfortunately...
testnet:
2022-12-05T22:43:59Z UpdateTip: new best=0000000616102ada34749f82a3f076b80f2bb6055964c648214bfa303eec1d46 height=53172 version=0x20000000 log2_work=53.930421 tx=243370 date='2019-03-02T00:10:47Z' progress=0.042112 cache=49.0MiB(365273txo) evodb_cache=6.1MiB
2022-12-05T22:43:59Z ERROR: ConnectBlock(DASH): ProcessSpecialTxsInBlock for block<PHONE_NUMBER>6d75d8a2d29626479498799adf0528ba66ba2ae18f3f69792c1274 failed with bad-protx-payload (code 16)
2022-12-05T22:43:59Z InvalidChainFound: invalid block=00000014036d75d8a2d29626479498799adf0528ba66ba2ae18f3f69792c1274  height=53173  log2_work=53.93042058  date=2019-03-02T00:12:32Z
2022-12-05T22:43:59Z InvalidChainFound:  current best=0000000616102ada34749f82a3f076b80f2bb6055964c648214bfa303eec1d46  height=53172  log2_work=53.93042057  date=2019-03-02T00:10:47Z
2022-12-05T22:43:59Z ERROR: ConnectTip: ConnectBlock<PHONE_NUMBER>6d75d8a2d29626479498799adf0528ba66ba2ae18f3f69792c1274 failed, bad-protx-payload (code 16)

Reverting these changes (6a9bf06) fixes the issue.


Inconsistency with derive(Debug)

I'm not sure if rust-analyzer is the right place to inform about a annoying inconsistency with some warnings. Please check the following two examples which are essentially the same:

Both are producing the same output but while the second one leaves rust-analyzer silenced, the first one is full with "debatable" warnings. I would expect the derived output to let the warnings be silenced as with the second example as the field gets indeed read.
If the "intentionally ignored" refers to this behavior: Is there any way to turn this "ignorance" off?
This is no real big issue but it clutters the sources code and I think it might confuse especially beginners. If you think that this should be addressed somewhere else: Please guide me.
BTW: I'm using nightly.

You can use #![allow(dead_code)]. These warnings are produced by rustc not rust-analyzer.

I would expect the derived output to let the warnings be silenced as with the second example as the field gets indeed read.

This used to be the case but was intentionally changed in https://github.com/rust-lang/rust/pull/85200.

Derived implementations of Clone and Debug always trivially read all fields, so "field is never read" dead code warnings are never triggered. Arguably, though, a user most likely will only be interested in whether their code ever reads those fields, which is the behavior I have implemented here.

Ok, thanks. So, I will close this issue for rust-analyzer.
FYI:
I know that I could turn off the warning, but I don't want to. In this instance I will just live with those warnings though I think it remains inconsistent even with the rationale in mind that you mentioned; given this rationale I'd expect - from a users point - the warning also on the second example.


keep final_value as array so rev_idx works

single value calls were crashing the code. this fixes that.

Codecov Report

Merging #40 into master will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master      #40   +/-   ##
=======================================
  Coverage   83.95%   83.95%
=======================================
  Files          33       33
  Lines        3097     3097
=======================================
  Hits         2600     2600
  Misses        497      497

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 72ffd20...4c7c4da. Read the comment docs.


Documentation: Http

Codecov Report

Merging #888 (7ff112a) into main (786f51a) will increase coverage by 0.41%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##             main     #888      +/-   ##
==========================================
+ Coverage   53.31%   53.73%   +0.41%
==========================================
  Files          72       72
  Lines        2144     2144
  Branches       62       62
==========================================
+ Hits         1143     1152       +9
+ Misses       1001      992       -9

Impacted Files
Coverage Δ

...io-http/src/main/scala/zhttp/service/Handler.scala
70.00% <0.00%> (+20.00%)
:arrow_up:

zio-http/src/main/scala/zhttp/http/Method.scala
65.62% <0.00%> (+21.87%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 786f51a...7ff112a. Read the comment docs.

The flow of the documentation doesn't feel like I am reading a book It feels like a scaladoc
flow can be something like.
-What is Http?

Http

Creating Http
Handling Errors
Providing environments
Attaching Middleware
Unit testing
...

What is HttpApp?

Special Constructors for HttpApp
Special Operators on HttpApp

Converting a Http to HttpApp

map contramap
middleware

Running a HttpApp


Optimization Mixin Plugins

Throughout #502's development, I've found many areas where I thought "this could be optimized to reduce the amount of entity spawns," or "this type of system can reduce the stress of chunk loads." A few of these optimizations have started making their way into the implementation as Mixin plugins, an example being #566 where some changes in the server performance can be less noticeable.
Ultimately however, I'd like to see about forming a list of potential optimizations and how to group those optimizations as Mixin plugins to where they're applied only when enabled.
The ones I've found currently possible to do:

[ ] Pre-merge ItemStack spawns: This involves CauseTracking as the item stacks would have to be captured prior to being spawned as entities, to which the maximum allowed stack size would be merged, eliminating the necessity for multiple EntityItems to merge after they have been spawned into the world
[ ] Prevent block ticking from loading chunks from file: There are certain corner cases that block ticks will request a BlockState into the neighboring chunk, which has a tendency to be unloaded (meaning the block that is ticking is at the very edge of the chunk radius for a Player anyways). While this is normally what Vanilla Minecraft will do, this can be better optimized to avoid adding extra overhead of these tick caused chunk generation/loading.
[ ] Employ a more powerful object tick range to process closer objects more often versus objects further away. This is partially an idea that CraftBukkit++ had originally, and I've found various areas that we could employ such a system, though nothing set in stone as of yet.

I'd appreciate more ideas from the community, and any code contributions would be well reviewed for acceptance (seriously, don't just copy, there are licenses to follow and copyrights to obey, you should look at a feature and try to work out an implementation without referring to other implementations).

:+1: for using mixin plugins instead of including in core - some optimisations/changes, such as merging itemstacks, are unwanted quite often, so being able to enable/disable each optimisation/change is a huge plus.

Crop growth....

Also, blood had a function within Cauldron that TE's would skip ticks if a player wasn't near.  This can have a bad effect on a mod but a good effect on the servers performance.

Limiting Chunks Generated per tick helps servers with complex map generation (aka TerrainControl).

The fix for end spikes
If we didn't fix the chunk loading from file twice in core we could do that here

@Aikar
This seems to be right up your alley...I know you gave us full permission to use your commits to Paper.
Are there any that you would recommend we do "right away"?
Also pinging @amaranth since he had ideas as well (beyond wall time).

https://github.com/PaperMC/Paper/blob/dea2d41b86e2a749251e12dd33439a08e9622dba/Spigot-Server-Patches/0105-Optimize-Chunk-Access.patch
https://github.com/PaperMC/Paper/blob/dea2d41b86e2a749251e12dd33439a08e9622dba/Spigot-Server-Patches/0082-Chunk-save-queue-improvements.patch
https://github.com/PaperMC/Paper/blob/dea2d41b86e2a749251e12dd33439a08e9622dba/Spigot-Server-Patches/0100-Optimize-Chunk-Unload-Queue.patch
https://github.com/PaperMC/Paper/blob/dea2d41b86e2a749251e12dd33439a08e9622dba/Spigot-Server-Patches/0091-Optimize-BlockStateList-BlockData.patch
https://github.com/PaperMC/Paper/blob/dea2d41b86e2a749251e12dd33439a08e9622dba/Spigot-Server-Patches/0063-Optimize-Pathfinding.patch
https://github.com/PaperMC/Paper/blob/dea2d41b86e2a749251e12dd33439a08e9622dba/Spigot-Server-Patches/0107-Optimize-isValidLocation-for-inlining.patch
I think some of them may depend on some stuff from:
https://github.com/PaperMC/Paper/blob/dea2d41b86e2a749251e12dd33439a08e9622dba/Spigot-Server-Patches/0092-Add-World-Util-Methods.patch
brand new so hasnt had time to report any known bugs but can help tremendously: https://github.com/PaperMC/Paper/blob/dea2d41b86e2a749251e12dd33439a08e9622dba/Spigot-Server-Patches/0125-Do-not-load-chunks-for-light-checks.patch

The patch that optimises isValidLocation for inlining... Does that really make a measurable difference?

@me4502 it's showing up in profilers as a hotspot, meaning it's not inlined. It's one of the most hottest methods called. It's a micro optimization, but at scale, it adds up. Lot of the performance comes by multiple micro optimizations in combination together.

updated chunk access patch to https://github.com/PaperMC/Paper/blob/081420d738fffe256fd18aa57dfe762be356493d/Spigot-Server-Patches/0105-Optimize-Chunk-Access.patch
noted by amaranth that previous version where invalidation was handled manually at caller would be an issue for mods that may mess with the map themselves., so moved the invalidation to be an overloaded .remove()

@aikar
Thanks for the links. This is actually pretty simple to put into place with Mixin's capabilities. The bigger challenge is making sure that what we do doesn't break mods (though SpongeVanilla has full reign to do as it pleases).

A few of the patches @aikar linked might be good being PR'd to Forge instead.

@kashike sure, but you're still leaving out SpongeVanilla.

no, I'm not. I'm saying to PR to Forge instead of SC/SF, and add to SV separately.

@aikar I'm still all ears for adding more optimizations in 1.9.4, or possibly back porting any optimizations for 1.8.9.

Closing as this should already be done.

@gabizou Would you optimize furnaces?


Fix Send button style on Zenburn and Morning themes

@xPaw pointed out that I forgot to update themes in #182. Crypto doesn't need fixing.
Zenburn:

Morning:

:+1:


Error message when using healthtrends package

Hi,
I have installed gtrends-tools, but am unable to import the healthtrends package.
When I run "install healthtrends" I get the error message below.
Any solutions?
Many thanks, Sacha
"
NameError                                 Traceback (most recent call last)
 in
----> 1 import healthtrends
/opt/anaconda3/lib/python3.7/site-packages/healthtrends/init.py in
1 from future import absolute_import, print_function, unicode_literals
2
----> 3 from healthtrends.request import *
4 from healthtrends.decorators import *
/opt/anaconda3/lib/python3.7/site-packages/healthtrends/request.py in
8 import time
9
---> 10 reload(sys)
11 sys.setdefaultencoding("utf-8")
12
NameError: name 'reload' is not defined
"

Are you using Python 2? In Python 3 the reload module needs to be loaded differently:
importlib.reload(module)

I haven't updated the package for Python 3 but I can do so if you can wait a week or so. Otherwise try Python 2 and it should work.

I was wondering if it might still be possible for you to update this for Python 3. If not, could you recommend an alternative with similar functionality? Thanks!

I'm hoping to but I think my API key has expired. This fetches from the standard Google Trends rather than the Health API but the data should be mostly equivalent: https://github.com/GeneralMills/pytrends


Nakadi clients resilience to partial outage and partial success

Is your feature request related to a problem? Please describe.
Nakadi publishing API accepts events in batches. It can fail to publish some events from the batch to underlying storage (Apache Kafka). In that case Nakadi publishing API will return error that batch was partially successful.
It can create problems the following problems, depending on how the Nakadi client and the publishing application deals with this partial success response:

increase in traffic on Nakadi publishing API due to Nakadi clients retrying the whole batch over and over
the application retries identical batches which prevents application from progressing

Describe the solution you'd like

Nakadi client should contain a note to developers that publishing can experience partial success. This should be in the client documentation and ideally also within the self contained code documentation, raising awareness for the users, e.g. via docstrings.

An optional retry method on batch level can be provided for the whole batch, but the default strategy must contain a backoff solution in case of continued errors to publish to Nakadi.

An optional retry method can be provided that only re-publishes unsuccessful events to Nakadi. This retry must also support a backoff strategy by default.

Clients must expose the result of a publishing request in a way that developers can understand that there is the possibility of a partial success for batch publishing.

Current situation
In case of a partial success (or also in cases like validation errors, which are complete failures), Fahrschein will throw an EventPublishingException with the BatchItemResponses (as returned from Nakadi) for the failed items in the responses property.
These objects have the eid of the failed event, a publishingStatus (failed/aborted/submitted (but these are filtered out)), the step where it failed and a detail string.
If the application sets the eids itself (i.e. doesn't let Nakadi do it) and keeps track of them, this allows it to resend only the failed items later. (This is what nakadi-producer is doing.)
It also allows differentiating between validation errors (which likely don't need to be retried, as they are unlikely to succeed the next time, unless the event type definition is changed) and publishing errors (which should be retried, possibly with some back-off).
But it needs some work on the application side.
Possible improvements
(My personal ideas, I'm not a Fahrschein maintainer.)
Instead of the plain response from Nakadi, it could help if the actual event object which was submitted is also included in this exception. This makes it easier for an application to retry just these. (This would require Fahrschein to invent eids where the application doesn't provide them, though.)
Splitting the failed events by failure type (validation/partitioning vs. enriching/publishing) might also help, but one needs to be careful here to not mess up event ordering if that's important, so maybe that's better left for the application.
It might also be an option to have a "retry" method in the exception, but this might be difficult to combine with a back-off strategy.

Current situation
In case of a partial success (or also in cases like validation errors, which are complete failures), Fahrschein will throw an EventPublishingException with the BatchItemResponses (as returned from Nakadi) for the failed items in the responses property.
These objects have the eid of the failed event, a publishingStatus (failed/aborted/submitted (but these are filtered out)), the step where it failed and a detail string.
If the application sets the eids itself (i.e. doesn't let Nakadi do it) and keeps track of them, this allows it to resend only the failed items later. (This is what nakadi-producer is doing.) It also allows differentiating between validation errors (which likely don't need to be retried, as they are unlikely to succeed the next time, unless the event type definition is changed) and publishing errors (which should be retried, possibly with some back-off).
But it needs some work on the application side.
Possible improvements (My personal ideas, I'm not a Fahrschein maintainer.)
Instead of the plain response from Nakadi, it could help if the actual event object which was submitted is also included in this exception. This makes it easier for an application to retry just these. (This would require Fahrschein to invent eids where the application doesn't provide them, though.)
Splitting the failed events by failure type (validation/partitioning vs. enriching/publishing) might also help, but one needs to be careful here to not mess up event ordering if that's important, so maybe that's better left for the application.
It might also be an option to have a "retry" method in the exception, but this might be difficult to combine with a back-off strategy.

I see there is a documentation about retry strategy, maybe can document it further that teams can use it, https://github.com/zalando-nakadi/fahrschein#fahrschein-compared-to-other-nakadi-client-libraries

I see there is a documentation about retry strategy, maybe can document it further that teams can use it, https://github.com/zalando-nakadi/fahrschein#fahrschein-compared-to-other-nakadi-client-libraries

As I understand, that's for the consumption part. Looking at the code, there is no retry logic for publishing, just the exception with the failed events, based on which the application can build their own retry logic.
I'm also not sure an automated re-try on publishing with back-off logic would fit into the philosophy of Fahrschein, but that's something for the maintainers to decide.

Related old ticket: #219

Done except for the retry, which we track in https://github.com/zalando-nakadi/fahrschein/issues/219
Closing this.


[9.x] Restore support for encrypted cookie arrays

https://github.com/laravel/framework/pull/35632 rebased off master as per suggestion
This restores support for encrypted cookie arrays including setting and validating appropriate cookie prefix values which is the reason it was removed initially.

Seems like something went wrong with branching here.


Move snabbdom facade to separate project

This in combination with scala-dom-types would make the codebase of outwach much simpler.

Files in the snabbdom package should not depend on outwatch. Eventually, this would make it possible to move snabbdom to a different repo.
Currently, it depends on outwatch.dom in these places:

https://github.com/OutWatch/outwatch/blob/master/src/main/scala/snabbdom/h.scala#L115
https://github.com/OutWatch/outwatch/blob/master/src/main/scala/snabbdom/VDomProxy.scala

As is, we use a fork of snabbdom and additionally made some amendments to the facade. Therefore, this does not really apply anymore.

It could still make sense to have the facade in a separate sbt sub-project.

Sure, we can do that :)


light theme will now use light navigation bar

Task/Issue URL: https://app.asana.com/0/1157893581871903/1162814661890319
Description:
When the user selected Light Mode, the navigation bar was still showed in Dark. This PR fixes that.
Fixes: https://github.com/duckduckgo/Android/issues/695
Steps to test this PR:

Open current app in Google Play
Open Settings and select Light Theme
Check that Navigation bar is shown in Dark

Building this branch

Open app
Open Settings and select Light Theme
Check that Navigation bar is shown in Light

Screenshots:

Before
After

Yeah! Some OEMs apparently did the right thing and tinted the color of the icons in the navigation bar pre v23. We can't rely on that for all devices, so for that reason we need to leave a dark navigation bar pre v23 even if the light theme is selected.


The difference between pnc-junction and junction

the hdmap proto, there are pnc-junction and junction. I want to known the difference between pnc-junction and junction.

junction is a rough area around a junction/intersection. We mainly use it for perception ROI.
pnc-junction is the junction concept specifically for Planning module. It uses the stop lines of traffic signs(traffic light, stop sign, crosswalk, and etc) as the boundary of the junction. The boundaries are used for decisions and planning in Planning module and must comply with traffic rules.

I understand, Thank You.

Hi, I wonder if the PNC junctions are pre-defined in the HD map files or the planning module add the PNC junctions to the HD map data at runtime?  thanks

Hi, Does anyone know where does PNC_Junctions come from? I couldn't find PNC_Junctions in Apollo xml sample data.

Hi, what is the meaning of pnc-junction boundary?


chore(deps): update terraform-module

This PR contains the following updates:

Package
Type
Update
Change

terraform-ibm-modules/event-notifications/ibm (source)
module
patch
1.10.12 -> 1.10.13

terraform-ibm-modules/kms-all-inclusive/ibm (source)
module
patch
4.15.11 -> 4.15.13

terraform-ibm-modules/secrets-manager/ibm (source)
module
patch
1.18.1 -> 1.18.3

Release Notes

terraform-ibm-modules/terraform-ibm-event-notifications (terraform-ibm-modules/event-notifications/ibm)
v1.10.13
Compare Source
Bug Fixes

deps: update terraform-module (#292) (0e71323)

terraform-ibm-modules/terraform-ibm-kms-all-inclusive (terraform-ibm-modules/kms-all-inclusive/ibm)
v4.15.13
Compare Source
Bug Fixes

deps: update terraform-module (#547) (1a284ed)

v4.15.12
Compare Source
Bug Fixes

deps: update terraform ibm to latest for the deployable architecture solution (#546) (23941aa)

terraform-ibm-modules/terraform-ibm-secrets-manager (terraform-ibm-modules/secrets-manager/ibm)
v1.18.3
Compare Source
Bug Fixes

deps: update terraform terraform-ibm-modules/kms-all-inclusive/ibm to v4.15.12 (#205) (c22f4f7)

v1.18.2
Compare Source
Bug Fixes

deps: update terraform-module (#197) (945a308)

Configuration
📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).
🚦 Automerge: Disabled by config. Please merge this manually once you are satisfied.
♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.
👻 Immortal: This PR will be recreated if closed unmerged. Get config help if that's undesired.

[ ] If you want to rebase/retry this PR, check this box

This PR has been generated by Renovate Bot.

/run pipeline

/run pipeline

/run pipeline

/run pipeline

:tada: This PR is included in version 2.0.0 :tada:
The release is available on:

GitHub release
v2.0.0

Your semantic-release bot :package::rocket:


After update to 1.3.4 getting warning "The flags generateDepth/generateStencilBuffer are mismatched. Depth and stencil are combined in one texture"

Not a bug but I just updated to Babylon React Native 1.3.4 and am now receiving the warning:
The flags generateDepth/generateStencilBuffer are mismatched. Depth and stencil are combined in one texture
Should I be doing something different?

@brian-hay On which platform do you get this message?

@CedricGuillemet this warning was on Android, specifically Android 11 on the Samsung Tab Active Pro (SM-T540).

I am also getting the same with the following packages
"@babylonjs/core": "5.25.0",     "@babylonjs/loaders": "5.25.0",     "@babylonjs/materials": "5.25.0",     "@babylonjs/react-native": "1.3.5",     "@babylonjs/react-native-iosandroid-0-69": "1.3.5",     "@babylonjs/react-native-windows-0-69": "1.3.5",
and here is my device info
System:     OS: macOS 12.5.1     CPU: (10) arm64 Apple M1 Max     Memory: 17.74 GB / 64.00 GB     Shell: 5.8.1 - /bin/zsh   Binaries:     Node: 18.6.0 - /var/folders/dq/p19k2lhx641cgr3mb15vd6w80000gn/T/yarn--1664238256034-0.21948768805165497/node     Yarn: 1.22.19 - /var/folders/dq/p19k2lhx641cgr3mb15vd6w80000gn/T/yarn--1664238256034-0.21948768805165497/yarn     npm: 8.13.2 - /opt/homebrew/bin/npm     Watchman: 2<IP_ADDRESS> - /opt/homebrew/bin/watchman   Managers:     CocoaPods: 1.11.3 - /usr/local/bin/pod   SDKs:     iOS SDK:       Platforms: DriverKit 21.4, iOS 15.5, macOS 12.3, tvOS 15.4, watchOS 8.5     Android SDK: Not Found   IDEs:     Android Studio: 2021.1 AI-211.7628.21.2111.8193401     Xcode: 13.4.1/13F100 - /usr/bin/xcodebuild   Languages:     Java: 11.0.15 - /usr/bin/javac   npmPackages:     @react-native-community/cli: Not Found     react: 18.2.0 => 18.2.0      react-native: 0.69.5 => 0.69.5      react-native-macos: Not Found

I've just test on master, RN 0.65 and 0.69 and babylon 5.25 and I don't repro.
@brian-hay / @nmongiya  Do you get the message in the logcat or the console? do you repro with the playground? ar you both on mac?

Hi @CedricGuillemet I see the warning in both the console and logcat. I'm deploying to Android 11 on the Samsung Tab Active Pro (SM-T540).
The only places in my code I'm explicitly referencing depth are a custom shader and a method to enable/update the depth renderer, similar to:
  public updateDepthRenderer(): DepthRenderer | undefined {
    let depthRenderer: DepthRenderer | undefined;
    if (this.scene) {
      this.scene.disableDepthRenderer();
      depthRenderer = this.scene.enableDepthRenderer();
      depthRenderer.forceDepthWriteTransparentMeshes = true;
    }

    return depthRenderer;
  }

But as I say, prior to upgrading to Babylon React Native 1.3.4, this hasn't been a problem and that particular code hasn't changed.

PR https://github.com/BabylonJS/BabylonNative/pull/1142

@brian-hay Thanks for the report. I've merged a fix. The check was bad. It may take some time before it gets to Babylon React Native. Let us know if you need it earlier for some reason.

Thanks @bghgary & @CedricGuillemet !

Hi @bghgary and @CedricGuillemet. Just wondering when the next Babylon React Native release is scheduled that includes this fix?

We don't have a schedule for releases at the moment. We do it ad-hoc based on needs. Let us know if you need this fix more urgently and we will try to accommodate.

Thanks @bghgary . As it's a warning only, it's not a critical blocker, just an annoyance as it pops up every time we launch the app.


XDai crawlers

Changes
XDai blockchain support
How to test these changes?
Tested locally
Related issues

@bugout-dev check

[ ] First merge PR https://github.com/bugout-dev/moonstream/pull/613


Update scodec-bits to 1.1.29

Updates org.scodec:scodec-bits from 1.1.28 to 1.1.29.
GitHub Release Notes - Changelog - Version Diff
I'll automatically update this PR to resolve conflicts as long as you don't change it yourself.
If you'd like to skip this version, you can just close this PR. If you have any feedback, just mention me in the comments below.
Configure Scala Steward for your repository with a .scala-steward.conf file.
Have a fantastic day writing Scala!

Files still referring to the old version number
The following files still refer to the old version number (1.1.28).
You might want to review and update them manually.
website/jvm/src/hugo/content/changelog.md

Ignore future updates
Add this to your .scala-steward.conf file to ignore future updates of this dependency:
updates.ignore = [ { groupId = "org.scodec", artifactId = "scodec-bits" } ]

labels: library-update, semver-patch, old-version-remains

0.22


release with better deps

dependency on hackney specified in a such way https://github.com/CargoSense/ex_aws/blob/v1.0.0/mix.exs#L38
is conflicting with other libraries.
Current master branch give more freedom in version of hackney.
Could you release the current master branch, please?

👍 Just need to get master up to hex.pm

ExAws 1.1.0 has been released.