Access Violation  sometimes when trying to draw rectangles

Description
When using skiasharp to draw rectangles, it gives access violation error.
This happens when I do from wpf and I use the SkElement and the first time it triggers the PaintSurface Event.
Code
on wpf is this
    private void PaintSurface(object? sender, SKPaintSurfaceEventArgs e)
    {
        Execute.OnUIThread(() =>
        {
            e.Surface.Canvas.Clear();
            _thisSquare.DrawSquare(e.Surface.Canvas, e.Info.Width, e.Info.Height);

        });
    }

on cross platform is this
    public void DrawSquare(SKCanvas thisCanvas, float width, float height)
    {

        var bounds = SKRect.Create(0, 0, width, height);
        _redPenBrush!.StrokeWidth = bounds.Width / 20;
        _slateGrayPenBrush!.StrokeWidth = bounds.Width / 30;
        _blackPenBrush!.StrokeWidth = bounds.Width / 20;
        _darkGrayPenBrush!.StrokeWidth = bounds.Width / 30;
        MiscHelpers.DefaultFont = "Verdana";
        var thisPercs = MiscHelpers.EnumLinearGradientPercent.Angle45;
        if (IsFlipped == true)
        {
            if (IsMine == true || Flagged == true)
            {
                var firstColor = new SKColor(255, 255, 255, 100);
                var secondColor = new SKColor(0, 0, 0, 100);
                var secondBrush = MiscHelpers.GetLinearGradientPaint(firstColor, secondColor, bounds, thisPercs);
                thisCanvas.DrawOval(bounds.Left + (bounds.Width / 2), bounds.Top + (bounds.Width / 2), bounds.Width / 4, bounds.Height / 4, _redSolidBrush);
                // well see how the second part comes along (could be iffy)(?)
                thisCanvas.DrawOval(bounds.Left + (bounds.Width / 2), bounds.Top + (bounds.Width / 2), bounds.Width / 4, bounds.Height / 4, secondBrush);
            }
            else if (NeighborMines > 0)
            {
                var textPaint = MiscHelpers.GetTextPaint(SKColors.Aqua, (bounds.Height * 3) / 4);
                thisCanvas.DrawCustomText(NeighborMines.ToString(), TextExtensions.EnumLayoutOptions.Center, TextExtensions.EnumLayoutOptions.Center, textPaint, bounds, out _); // i think
            }
            if (Flagged == true)
            {
                thisCanvas.DrawLine(bounds.Location.X, bounds.Location.Y, bounds.Location.X + bounds.Width, bounds.Location.Y + bounds.Height, _blackPenBrush);
                thisCanvas.DrawLine(bounds.Location.X + bounds.Width, bounds.Location.Y, bounds.Location.X, bounds.Location.Y + bounds.Height, _blackPenBrush);
            }
        }
        else
        {
            SKRect otherRect;
            otherRect = SKRect.Create(bounds.Location.X + (bounds.Width / 6), bounds.Location.Y + (bounds.Height / 6), (bounds.Width * 2) / 3, (bounds.Height * 2) / 3);
            SKColor firstColor;
            SKColor secondColor;
            SKPaint currentPaint;
            if (Pressed == true)
            {
                currentPaint = _darkGrayPenBrush;
                firstColor = new SKColor(0, 0, 0, 150);
                secondColor = new SKColor(255, 255, 255, 150);
            }
            else
            {
                currentPaint = _slateGrayPenBrush;
                firstColor = new SKColor(255, 255, 255, 150);
                secondColor = new SKColor(0, 0, 0, 150);
            }
            var tempPaint = MiscHelpers.GetLinearGradientPaint(firstColor, secondColor, bounds, thisPercs);
            thisCanvas.DrawRect(bounds, tempPaint);
            thisCanvas.DrawRect(otherRect, currentPaint);
            if (Flagged == true)
            {
                SKPath ThisPath = new SKPath();
                ThisPath.MoveTo(bounds.Location.X + (bounds.Width / 2), bounds.Location.Y + (bounds.Height / 4));
                ThisPath.LineTo(bounds.Location.X + ((bounds.Width * 3) / 4), bounds.Location.Y + ((bounds.Height * 3) / 8));
                ThisPath.LineTo(bounds.Location.X + (bounds.Width / 2), bounds.Location.Y + (bounds.Height / 2));
                thisCanvas.DrawPath(ThisPath, _redSolidBrush);
                thisCanvas.DrawLine(bounds.Location.X + (bounds.Width / 2), bounds.Location.Y + ((bounds.Height * 3) / 4), bounds.Location.X + (bounds.Width / 2), bounds.Location.Y + (bounds.Height / 4), _redPenBrush);
            }
        }
        thisCanvas.DrawRect(bounds, _slateGrayPenBrush);
    }

the 2 lines causing the problem is this
thisCanvas.DrawRect(bounds, tempPaint);
thisCanvas.DrawRect(otherRect, currentPaint);

Expected Behavior
Expected behavior is to actually draw
Actual Behavior
Access violation on one of the 2 lines of code
thisCanvas.DrawRect(bounds, tempPaint);
thisCanvas.DrawRect(otherRect, currentPaint);

Basic Information
version is <IP_ADDRESS>
with wpf.
however, the part that raise the error and won't let me handle it is the cross platform skiasharp.

Is the Execute.OnUIThread blocking? If not (which is likely) the canvas will actually be disposed and you are now trying to access something that is gone from memory.
On this note, why are you using the Execute.OnUIThread method? The paint callback should already be on the UI thread. You shouldn't need to use any additional logic to move it.

I actually tried the same code on the 16.8.0 and the problem did not happen.  I did the OnUIThread to try to fix the problem.  Because when the problem first occured, I tried several things and same issue.  I finally decided to try on an older version of skiasharp and the problem did not happen.

Are you able to attach a full stack trace?
Are you using WPF with .NET Framework or .NET Core?
Does the issue still happen with 1.68.0 without the Execute.OnUIThread?

How do I attach a full stack trace?  I am using WPF with .net core.  I tried without the OnUIThread and the problem did not reoccur with 1.68.0.
It would not even let me to do a try catch to try the drawings again with <IP_ADDRESS>
Even with 1.68.0 I was using .WPF with .net core.  I used

NU1701
 code for the project so i don't get the warnings.

I tried to run it again after changing over to the new version and here is what i was able to copy.
System.AccessViolationException
HResult=0x80004003
Message=Attempted to read or write protected memory. This is often an indication that other memory is corrupt.
Source=
StackTrace:

I checked the stack trace and it showed it as null.  I did a screenshot but could not figure out how to send the screenshot.  The problem would not happen every time but once in a while.

You can just copy-paste the screenshot into the comments box. Or even drag the image into the comments. GitHub should just put the image in line.

Thanks for letting me know.  I tried that and worked.  Here is the full screenshot now.  You can see the stack trace actually showed null.

Very interesting. Especially without the stack trace.
Are you able to create a minimal repro at all? I will help to get started.

I need help with creating a minimum repro.
When the problem happens, the strange thing is it does not happen every time.  Sometimes I can hit new game several times and no problems.  Other times, it happens after 5 times.  When I use the 1.68.0, the problem never happens.  Do you think we can do a visual studio share.  I do know that option is available where you see my code on my machine.

One question.  If you mean to create a repository of the solution I was working on, I can do that.  What I would do is to copy/paste and make sure they are all the same folder and that would be the repository.  If that would be helpful, I can do that then.  What would happen is I would create it where you can always hit next game.  You will see that sometimes, the issue would happen.  But does not happen every time you do new game though.  The cases where it happens, its always at the beginning of new game.

It would be great if you managed to get a repro with as little code as possible. Often just by trying to do that you see some weird things.
But, I am looking at the code that you have here and maybe something is being disposed...
thisCanvas.DrawRect(bounds, tempPaint);
thisCanvas.DrawRect(otherRect, currentPaint);

Is it randomly different ones crashing? Or is it always the second one?
Also, could it be that one of the paints _darkGrayPenBrush or _slateGrayPenBrush is being disposed?
What you can try and see if it is really this method that is failing is to replace the paints with new SKPaint() or the rects with SKRect.Create(10, 10) or something. This way you can remove any external code from the system.
And, another thing to try is to hit continue and see if there is another exception. Or check the output log for any info. Or, you can even check the "Common Language Runtime Exceptions" check box in the exceptions window. Maybe there is another exception that causes this exception.
The whole thing without the stack trace is weird.
One thing you can also try as well is using .NET Core. That might have a better exception.
The fact that there is no stack trace may mean that there is an issue with the version of .net framework. We are using portable pdbs, and .net framework should support it, but this file does say that there are a few issues: https://github.com/dotnet/core/blob/master/Documentation/diagnostics/portable_pdb.md Maybe bump the version to net472 or even 48...

I was actually using .net core 3.1 in wpf.
I would hate to have to use the old framework and not the core.
Not sure if that could be an issue.  I actually had to put some extra code in the project file to eliminate the warnings.  The strange thing is the old version did not have the problem.
Are there plans to have a version that would support the wpf core without the warnings?

I have same behavior

Win 10 (many hosts)
Access Violation
Repeated randomly
DrawRect method
only <IP_ADDRESS>
Xamarin 4.4
both UWP and WPF

Steps to reproduce:
1 On start the UI cache it thread context: MainContext = SynchronizationContext.Current;
2 On paint method use readonly SKPaint paint variables
3 From background thread often and randomly call Invalidate:
MainContext.Post((state) =>((SKCanvasView)state).InvalidateSurface(), canvas);

I now have a simple sample to show this always happening eventually.
My repository is here.
https://github.com/musictopia2/SkiaBugSample
To see it happening, just click new game.  However, do several times.  Eventually the error will occur.  The problem did not happen with the 1.68.0.

I think this may be related to #1121, which I am testing a fix with #1180.
I'll see if I can get feedback on that ASAP and then fix the rest of the views.

I have just published the PR (#1180) NuGet (1.68.2-pr.1180.1) to the preview feed: https://aka.ms/skiasharp-eap/index.json
This contains the fixes for macOS, iOS and Android. More platforms coming soon.
Give that a go and let me know if it fixes the crashes.

How do I get the private feed one.  I went to the preview on nuget and the latest version still showed 1.68.2-preview.43

You need to att https://aka.ms/skiasharp-eap/index.json to the feeds for nuget. In VS add a new package source.
Check out this doc for a visual guide https://docs.microsoft.com/en-us/nuget/consume-packages/install-use-packages-visual-studio#package-sources

I followed to get the private feeds.  Its still showing the same version that the nuget.org showed as you can see from the screenshot.

Look in the drop down for 1.68.2-pr.1180.4 as this is a PR preview and it is somewhere in the middle of the previews

I found it now.  Just did not realize it would not be at the top.  However, the same problem still occured even with that one.  I was using windows 10 with wpf core.

OK, might be something else. Is this link still the correct place?

https://github.com/musictopia2/SkiaBugSample

This is still the correct place.

This is now fixed and no longer crashes on 1.68.2-preview.50

@mattleibow

This is what i get when I call too much the InvalidateVisual() method of the SkElement, I used a SKGLControl to make context current and then used a Surface named 'Surface' to draw on it using the Gl context setted up previously, and I pass the 'Surface' snapshot SkImage to the SkElement and it gives me this : System.AccessViolationException Attempted to read or write protected memory. This is often an indication that other memory is corrupt.
I Looked at the GrContext made by the SKGLConttrol and it seems that the GPU memory ( called cache memory ) never gets free and is still growing ( some sort of memory leaks for the GPU ? )


list_render: Add sorting features.

This adds sorting features to the list_render class that allows you to utilize a generic sorting function with a prop, or specify a custom one to use.

Merged, thanks @brockwhittaker!

Is this for sorting topic list? I'd wish to experiment with using frecency.


Reduce the shutdown_cleanup_period.

This should greatly reduce how long it takes to shutdown a
Connext Node.  In local testing the time went from 3 seconds
to well under a second.
Signed-off-by: Chris Lalancette<EMAIL_ADDRESS>This should fix #325; an open question is whether this has any other side-effects.  I'm going to run a full CI with this change in place, and Connext as the only RMW vendor, to see what happens.

CI:

Linux
Linux-aarch64
macOS
Windows

Another CI, hopefully a little more successful:

Linux
Linux-aarch64
macOS
Windows

The Windows failures are well-known by now, so almost certainly not the result of this PR.  I was sort of hoping the quicker shutdown type would help this, but it was not to be.  In any case, I'm going to merge this one as-is, and we'll deal with the failures elsewhere.


chore: commonjs to es2020

regarding to issue #5, to support Vite 5, I manage to change commonjs to es2020

Thanks a lot for the contribution!


fix(board view): Display newly added work item, added via the detailed view, in the board view. Fixes #1496.

Display newly added work item, added via the detailed view, in the board view. Fixes #1496.

@nimishamukherjee snapshot fabric8-ui is deployed and available for testing at https://fabric8-ui-fabric8-ui-pr-1721-fabric8-planner.int.rdu2c.fabric8.io

[test]

@nimishamukherjee snapshot fabric8-ui is deployed and available for testing at https://fabric8-ui-fabric8-ui-pr-1721-fabric8-planner.int.rdu2c.fabric8.io

@nimishamukherjee snapshot fabric8-ui is deployed and available for testing at https://fabric8-ui-fabric8-ui-pr-1721-fabric8-planner.int.rdu2c.fabric8.io

@nimishamukherjee snapshot fabric8-ui is deployed and available for testing at https://fabric8-ui-fabric8-ui-pr-1721-fabric8-planner.int.rdu2c.fabric8.io


org-mode support

It seems to me that goorgeous may be dead. There is a PR for hugo which introduces an alternative implementation go-org. Here is a demo page shows the html output of goorgeous (left side) and go-org (right side).
#5430, #3122 should receive immediate fixes if go-org is adopted.
Regards.

PR has been merged in commit https://github.com/gohugoio/hugo/commit/fad183c4ae55069be9246e64ab1c8b2f43d08d06

Not sure whether the stale bot is still threatening closing as it appears to have removed the stale label since the reviewed/confirmed tag was put, but this is still an issue.
goorgeous, in addition to the bug described by #3122, is also not generating a table of contents, which go-org does. (I am also not sure whether go-org does provide syntax highlighting, as their screenshot does it but not their demo, so… meh)

there's a hook for syntax highlighting but go-org itself doesn't bundle anything - for the github pages examples I'm using chroma.
If no one is looking into this i can take a look next week.

The development setup seems quite heavy and I have a shitty old laptop - I'm happy to help if you run into any problems but won't take a stab at adding support myself, sorry.

Per #8560


MapAreaControllerRoute does not work with optional controller action

app.UseEndpoints(endpoints =>
            {
                endpoints.MapControllers();
                endpoints.MapAreaControllerRoute("admin", "admin", "admin/{controller=Home}/{action=Index}/{id?}");
                endpoints.MapControllerRoute("default", "{controller=Home}/{action=Index}/{id?}");

            });

Actual
/admin ---> not working !
/admin/Home/Index ---> working
Expected
/admin ---> working
/admin/Home/Index ---> working

Thank you for filing this issue. In order for us to investigate this issue, please provide a minimalistic repro project (ideally a GitHub repo) that illustrates the problem.

WebApplication2.zip

The IndexController in your area is attribute routed - [Route("Admin/[controller]")] which explains why the default route from your Startup isn't used

thanks its working


Haircolor and Eyecolor switched

In the actor entity, the haircolor and eyecolor is switched - the hair color is stored in Data.details.eyecolor.value, the eye color in Data.details.haircolor.value.

I don't know to what location you are refering. Seems fine to me.
Make sure your system version is at 1.4.2.
There are multiple versions you have to keep track of.

Foundry version (currently 0.7.9)
TDE/DSA System version (currently 1.4.2)
And versions for different modules including the core rules for dsa (which is not the system)

Jup, you're right. When I created my character, I was on a version pre 1.4.0. It seems, that between the versions haircolor and eyecolor switched. Or that I was unattantive when created my character. Whatever the reason, now it's working as expected. Setting the issue to closed.
Thank you for the fast answer!


Plot all time series at the same time overlapped

Please is there a way we can view more than one time series at the same time? like overlapped. It makes it easier for the labeling.

@khadijakhaldi can you explain a bit more? Do you mean time series between different tasks, or multiple time series in one task?

Hey @khadijakhaldi — thanks for reaching out!
I love where your brain is at, but I'm also needing more detail to take this back to our product team as an official feature request.
From @hogepodge's comment — having any other information or even mock up visuals would be helpful for us, in addition to use cases. :)

Thank you for your answers!
In my case, detecting anomalies requires to see 4/3 time series at the same time, it is easier visually to label data than plotting each time serie in a separate channel. Here is an example:

This is great feedback, thanks! We've had similar requests before, and I've updated the ticket in the product roadmap to capture it. It's been updated recently, and your feedback helps the team to prioritize features like this.

Hi Chris, here is another example

using label studio here is what I see

It is hard to spot the anomaly especially if each time series has a different magnitude.

I can echo this sentiment as I have a set of reference multivariate data that i need to plot overlapped with sampled data for annotators to label the regions with deltas, which in my use case it not just a simple mathematical operation but requires all signals to be available together for SME evaluation.
Any idea where this is on the roadmap?  TY!

Duplicate: #2373


[CONTROLLER/RECORDER] stops updating vif vm

This PR is for:

Server

stops updating vif vm
Checklist

[ ] Added unit test.

Backport to branches

main

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.zhengya seems not to be a GitHub user. You need a GitHub account to be able to sign the CLA. If you have already a GitHub account, please add the email address used for this commit to your account.You have signed the CLA already but the status is still pending? Let us recheck it.


update the readthedocs address

After the renaming of the git repo we might want to update the address for readthedocs from adler.readthedocs.io to lsst-adler.readthedocs.io

I can do it, the question is do we want to have the hyphen in the url

I can make a new project and regenerate the webhooks it's just a question if we like any of the options for the url

I think lsst-adler is fine.


Allow collapsed (but togglable) sidebar in fixed mode. Allow turning off sidebarExpandOnHover.

There is such cases when sidebar menu will have fairly limited number of menu items, but content will have a lot of content.
For such cases having collapsed menu in fixed menu is very usefull.
This option is forced to true if both the fixed layout and sidebar mini
are used together

Unfortunately, mixing the fixed layout and sidebar mini can't work because of the SlimScroll plugin. It prevents the sidebar elements from showing up on hover since it required the "overflow: hidden" rule on its container. Please see #451

Quick fix:

In sidebar-collapse just disable slimscroll like this
   $.AdminLTE.layout.fixSidebar: function () {

        if ($("body").hasClass("sidebar-collapse")) {
            if (typeof $.fn.slimScroll != 'undefined') {
                $(".sidebar").slimScroll({destroy: true}).height("auto").css('overflow', 'initial');
            }
            return;
        }

and just call $.AdminLTE.layout.fixSidebar every time on $.AdminLTE.pushMenu

I noticed that this is only an issue when the application starts with the "fixed" class on the body tag.  If you wait until after admin lte initiates and then add the fixed class. You can have sidebar mini with fixed layout and no expandOnHover.  I am using the skinning feature for my application and what I do is store the user's preference in cookies and then set the appropriate classes to my body tag when building the razor view.  Not sure if people still use this or not, but I was able to find a solution that isn't too hacky. :)


fix: #114

This PR fixes #114
All information can be read in the issue.

Thanks for the hint. Done


Rollout even if workload revision is not changed

Signed-off-by: mingzhou.swx<EMAIL_ADDRESS>
Ⅰ. Describe what this PR does
You can trigger rollout  manually via adding an annotation rollouts.kruise.io/in-progressing: "true" to Workload, even if workload revision is not changed.

/lgtm

/approve

/cancel


Isn't working for me

Hi,
i have a simple rolle switch configuration. Connected to pin 4 on the board and to the ground. But it doesn't seem to work. Am I doing something wrong here? Here is the log from octopi:
2020-04-28 11:03:48,644 - octoprint.printer.standard.job - INFO - Print job selected - origin: sdcard, path: ce3_bl~1.gco, owner: Admin, user: Admin
2020-04-28 11:03:51,483 - octoprint.util.comm - INFO - Changing monitoring state from "Operational" to "Starting print from SD"
2020-04-28 11:03:51,491 - octoprint.printer.standard.job - INFO - Print job started - origin: sdcard, path: ce3_bl~1.gco, owner: Admin, user: Admin
2020-04-28 11:03:51,513 - octoprint.plugins.filament - INFO - Printing started. Filament sensor enabled.
2020-04-28 11:03:51,518 - octoprint.plugin - ERROR - Error while calling plugin filamentsensorsimplified
Traceback (most recent call last):
File "/home/pi/oprint/local/lib/python2.7/site-packages/octoprint/plugin/init.py", line 224, in call_plugin
result = getattr(plugin, method)(*args, **kwargs)
File "/home/pi/oprint/local/lib/python2.7/site-packages/octoprint_filamentsensorsimplified/init.py", line 138, in on_event
elif event is Events.PRINT_STARTED and self.no_filament():
File "/home/pi/oprint/local/lib/python2.7/site-packages/octoprint_filamentsensorsimplified/init.py", line 117, in no_filament
return GPIO.input(self.pin) != self.switch
RuntimeError: You must setup() the GPIO channel first
2020-04-28 11:03:51,695 - octoprint.util.comm - INFO - Changing monitoring state from "Starting print from SD" to "Printing from SD"
2020-04-28 11:03:53,770 - octoprint.util.comm - INFO - Printer seems to support the busy protocol, will adjust timeouts and set busy interval accordingly
2020-04-28 11:04:02,410 - octoprint.util.comm - INFO - Changing monitoring state from "Printing from SD" to "Cancelling"2020-04-28 11:04:02,422 - octoprint.util.comm - INFO - Force-sending M108 to the printer
2020-04-28 11:04:02,443 - octoprint.printer.standard.job - INFO - Print job cancelled - origin: sdcard, path: ce3_bl~1.gco, owner: Admin, user: Admin
2020-04-28 11:04:02,457 - octoprint.plugins.filament - INFO - Printing stopped. Filament sensor disabled.
2020-04-28 11:04:02,460 - octoprint.plugins.filamentsensorsimplified - INFO - PrintCancelled: Disabling filament sensor.2020-04-28 11:04:02,469 - octoprint.plugin - ERROR - Error while calling plugin filamentsensorsimplified
Traceback (most recent call last):
File "/home/pi/oprint/local/lib/python2.7/site-packages/octoprint/plugin/init.py", line 224, in call_plugin
result = getattr(plugin, method)(*args, **kwargs)
File "/home/pi/oprint/local/lib/python2.7/site-packages/octoprint_filamentsensorsimplified/init.py", line 173, in on_event
GPIO.remove_event_detect(self.pin)
RuntimeError: No access to /dev/mem.  Try running as root!
2020-04-28 11:04:02,498 - octoprint.plugins.filament - INFO - Printing stopped. Filament sensor disabled.
2020-04-28 11:04:02,507 - octoprint.plugins.filamentsensorsimplified - INFO - PrintFailed: Disabling filament sensor.
2020-04-28 11:04:02,510 - octoprint.plugin - ERROR - Error while calling plugin filamentsensorsimplified
Traceback (most recent call last):
File "/home/pi/oprint/local/lib/python2.7/site-packages/octoprint/plugin/init.py", line 224, in call_plugin
result = getattr(plugin, method)(*args, **kwargs)
File "/home/pi/oprint/local/lib/python2.7/site-packages/octoprint_filamentsensorsimplified/init.py", line 173, in on_event
GPIO.remove_event_detect(self.pin)
RuntimeError: No access to /dev/mem.  Try running as root!
2020-04-28 11:06:37,985 - octoprint.server.heartbeat - INFO - Server heartbeat <3
2020-04-28 11:07:37,360 - octoprint.util.comm - INFO - Telling the printer to set the busy interval to our "communicationBusy" timeout - 1s = 2s
2020-04-28 11:07:41,303 - octoprint.util.comm - ERROR - Unexpected error while reading from serial port
Traceback (most recent call last):
File "/home/pi/oprint/local/lib/python2.7/site-packages/octoprint/util/comm.py", line 2823, in _readline
ret = self._serial.readline()
File "/home/pi/oprint/local/lib/python2.7/site-packages/octoprint/util/comm.py", line 4968, in readline
c = self.read(1)
File "/home/pi/oprint/local/lib/python2.7/site-packages/serial/serialposix.py", line 501, in read
'device reports readiness to read but returned no data '
SerialException: device reports readiness to read but returned no data (device disconnected or multiple access on port?)
2020-04-28 11:07:41,315 - octoprint.util.comm - ERROR - Please see https://faq.octoprint.org/serialerror for possible reasons of this.
2020-04-28 11:07:41,332 - octoprint.util.comm - INFO - Changing monitoring state from "Cancelling" to "Offline (Error: SerialException: 'device reports readiness to read but returned no data (device disconnected or multiple access on port?)' @ comm.py:_readline:2823)"

Hello, @s33rw4h, thank you for your issue, Firstly, thank you for providing log files. I am seeing two potential problems here

you are likely using the Octoprint-Filament plugin by MoonshineSG which may interfere with this plugin, simply go to Plugin Manager and turn this off and restart OctoPrint
there is a log when Filament Sensor Simplified plugin starts, I don't see that here, may be higher in you logs, search for "Filament Sensor Simplified started" and "Filament Sensor active on GPIO Pin [YOUR_PIN]", if you can't find such log this plugin wasn't setup correctly for some reason and as a result you're getting this error.

Thanks for the quick reply. There was some filament plugin there, but it wasn't the octoprint-Filament by Moonshine. I've deleted it and tried it again. Here is the full log file.
pi@octopi:~ $ cd .octoprint
pi@octopi:~/.octoprint $ cd logs
pi@octopi:~/.octoprint/logs $ tail -F octoprint.log
File "/home/pi/oprint/local/lib/python2.7/site-packages/octoprint/plugin/init.py", line 224, in call_plugin
result = getattr(plugin, method)(*args, **kwargs)
File "/home/pi/oprint/local/lib/python2.7/site-packages/octoprint_filamentsensorsimplified/init.py", line 50, in on_after_startup
self._setup_sensor()
File "/home/pi/oprint/local/lib/python2.7/site-packages/octoprint_filamentsensorsimplified/init.py", line 63, in _setup_sensor
GPIO.setup(self.pin, GPIO.IN, pull_up_down=GPIO.PUD_UP)
ValueError: The channel sent is invalid on a Raspberry Pi
2020-04-28 13:36:11,351 - octoprint.server.preemptive_cache - INFO - Preemptively caching / (ui _default) for {'query_string': 'l10n=en', 'path': '/', 'base_url': 'http://octopi.local/'}
2020-04-28 13:36:12,041 - octoprint.server.util.sockjs - INFO - User Admin logged in on the socket from client 2607:f2c0:e1de:a5:ac1e:fbb7:5332:eea2
2020-04-28 13:36:34,723 - octoprint.server.preemptive_cache - INFO - ... done in 23.37s
2020-04-28 13:38:00,486 - octoprint.server.util.flask - INFO - Passively logging in user Admin from 2607:f2c0:e1de:a5:ac1e:fbb7:5332:eea2
2020-04-28 13:38:00,491 - octoprint.access.users - INFO - Logged in user: Admin
2020-04-28 13:38:00,764 - octoprint.server.util.sockjs - INFO - Client connection closed: 2607:f2c0:e1de:a5:ac1e:fbb7:5332:eea2
2020-04-28 13:38:01,896 - octoprint.server.util.sockjs - INFO - New connection from client: 2607:f2c0:e1de:a5:ac1e:fbb7:5332:eea2
2020-04-28 13:38:02,061 - octoprint.server.util.flask - INFO - Passively logging in user Admin from 2607:f2c0:e1de:a5:ac1e:fbb7:5332:eea2
2020-04-28 13:38:02,063 - octoprint.access.users - INFO - Logged in user: Admin
2020-04-28 13:38:04,864 - octoprint.server.util.sockjs - INFO - User Admin logged in on the socket from client 2607:f2c0:e1de:a5:ac1e:fbb7:5332:eea2
2020-04-28 13:38:24,723 - octoprint.util.comm - INFO - Changing monitoring state from "Offline" to "Detecting serial port"
2020-04-28 13:38:24,991 - octoprint.util.comm - INFO - Changing monitoring state from "Detecting serial port" to "Error: Failed to autodetect serial port, please set it manually."
2020-04-28 13:38:25,010 - octoprint.plugins.filamentsensorsimplified - INFO - Error: Disabling filament sensor.
2020-04-28 13:38:25,012 - octoprint.plugin - ERROR - Error while calling plugin filamentsensorsimplified
Traceback (most recent call last):
File "/home/pi/oprint/local/lib/python2.7/site-packages/octoprint/plugin/init.py", line 224, in call_plugin
result = getattr(plugin, method)(*args, **kwargs)
File "/home/pi/oprint/local/lib/python2.7/site-packages/octoprint_filamentsensorsimplified/init.py", line 173, in on_event
GPIO.remove_event_detect(self.pin)
ValueError: The channel sent is invalid on a Raspberry Pi
2020-04-28 13:38:52,335 - octoprint.util.comm - INFO - Changing monitoring state from "Offline" to "Detecting serial port"
2020-04-28 13:38:52,458 - octoprint.util.comm - INFO - Changing monitoring state from "Detecting serial port" to "Opening serial port"
2020-04-28 13:38:52,472 - octoprint.util.comm - INFO - Changing monitoring state from "Opening serial port" to "Connecting"
2020-04-28 13:38:52,488 - octoprint.util.comm - INFO - M110 detected, setting current line number to 0
2020-04-28 13:38:52,725 - octoprint.util.comm - INFO - M110 detected, setting current line number to 0
2020-04-28 13:38:57,104 - octoprint.util.comm - INFO - M110 detected, setting current line number to 0
2020-04-28 13:38:57,112 - octoprint.util.comm - INFO - Changing monitoring state from "Connecting" to "Operational"
2020-04-28 13:38:57,152 - octoprint.util.comm - INFO - M110 detected, setting current line number to 0
2020-04-28 13:38:57,202 - octoprint.util.comm - INFO - Printer reports firmware name "Marlin Creality 3D (Creality3D)"
2020-04-28 13:38:57,217 - octoprint.util.comm - INFO - Firmware states that it supports temperature autoreporting
2020-04-28 13:39:30,245 - octoprint.printer.standard.job - INFO - Print job selected - origin: sdcard, path: ce3_bl~1.gco, owner: Admin, user: Admin
2020-04-28 13:41:59,096 - octoprint.util.comm - INFO - Changing monitoring state from "Operational" to "Starting print from SD"
2020-04-28 13:41:59,119 - octoprint.printer.standard.job - INFO - Print job started - origin: sdcard, path: ce3_bl~1.gco, owner: Admin, user: Admin
2020-04-28 13:41:59,142 - octoprint.plugin - ERROR - Error while calling plugin filamentsensorsimplified
Traceback (most recent call last):
File "/home/pi/oprint/local/lib/python2.7/site-packages/octoprint/plugin/init.py", line 224, in call_plugin
result = getattr(plugin, method)(*args, **kwargs)
File "/home/pi/oprint/local/lib/python2.7/site-packages/octoprint_filamentsensorsimplified/init.py", line 138, in on_event
elif event is Events.PRINT_STARTED and self.no_filament():
File "/home/pi/oprint/local/lib/python2.7/site-packages/octoprint_filamentsensorsimplified/init.py", line 117, in no_filament
return GPIO.input(self.pin) != self.switch
ValueError: The channel sent is invalid on a Raspberry Pi
2020-04-28 13:41:59,317 - octoprint.util.comm - INFO - Changing monitoring state from "Starting print from SD" to "Printing from SD"
2020-04-28 13:42:01,390 - octoprint.util.comm - INFO - Printer seems to support the busy protocol, will adjust timeouts and set busy interval accordingly
2020-04-28 13:42:35,573 - octoprint.util.comm - INFO - Changing monitoring state from "Printing from SD" to "Cancelling"
2020-04-28 13:42:35,595 - octoprint.util.comm - INFO - Force-sending M108 to the printer
2020-04-28 13:42:35,614 - octoprint.printer.standard.job - INFO - Print job cancelled - origin: sdcard, path: ce3_bl~1.gco, owner: Admin, user: Admin
2020-04-28 13:42:35,631 - octoprint.plugins.filamentsensorsimplified - INFO - PrintCancelled: Disabling filament sensor.
2020-04-28 13:42:35,651 - octoprint.plugin - ERROR - Error while calling plugin filamentsensorsimplified
Traceback (most recent call last):
File "/home/pi/oprint/local/lib/python2.7/site-packages/octoprint/plugin/init.py", line 224, in call_plugin
result = getattr(plugin, method)(*args, **kwargs)
File "/home/pi/oprint/local/lib/python2.7/site-packages/octoprint_filamentsensorsimplified/init.py", line 173, in on_event
GPIO.remove_event_detect(self.pin)
ValueError: The channel sent is invalid on a Raspberry Pi
2020-04-28 13:42:35,718 - octoprint.plugins.filamentsensorsimplified - INFO - PrintFailed: Disabling filament sensor.
2020-04-28 13:42:35,720 - octoprint.plugin - ERROR - Error while calling plugin filamentsensorsimplified
Traceback (most recent call last):
File "/home/pi/oprint/local/lib/python2.7/site-packages/octoprint/plugin/init.py", line 224, in call_plugin
result = getattr(plugin, method)(*args, **kwargs)
File "/home/pi/oprint/local/lib/python2.7/site-packages/octoprint_filamentsensorsimplified/init.py", line 173, in on_event
GPIO.remove_event_detect(self.pin)
ValueError: The channel sent is invalid on a Raspberry Pi

Thanks, now the problem is that pin number 4 is actually 5V, if you meant GPIO4, change it to 7 and it should work.

Thanks again for the reply, that seems to have fixed that problem. The print does not pause however when the sensor is triggered? Is it only suppose to pop up a message? (Which ends up covering the screen).

If you use octoprint only to start printing from SD card this won't work.

I took the SD card out and tried printing again, only from octoprint. it still did not pause the print. I'm using an Ender 3 that I believe supports M600. Thoughts?

Sorry that you are still having trouble. One thing you can try is issue M600 X0 Y0 command to octoprint terminal when printing. If it does park and begin filament change, could you please provide logs?

Ok I will post that shortly. Another problem is now is just triggering the sensor all the time. Here is the log:
2020-04-28 15:18:27,271 - octoprint.access.users - INFO - Logged in user: Admin
2020-04-28 15:18:30,035 - octoprint.server.util.sockjs - INFO - User Admin logged in on the socket from client 2607:f2c0:e1de:a5:b109:78fd:89b:7c81
2020-04-28 15:18:33,898 - octoprint.util.comm - INFO - Changing monitoring state from "Offline" to "Detecting serial port"
2020-04-28 15:18:34,192 - octoprint.util.comm - INFO - Changing monitoring state from "Detecting serial port" to "Opening serial port"
2020-04-28 15:18:34,197 - octoprint.util.comm - INFO - Changing monitoring state from "Opening serial port" to "Connecting"
2020-04-28 15:18:34,215 - octoprint.util.comm - INFO - M110 detected, setting current line number to 0
2020-04-28 15:18:34,475 - octoprint.util.comm - INFO - M110 detected, setting current line number to 0
2020-04-28 15:18:43,007 - octoprint.util.comm - INFO - M110 detected, setting current line number to 0
2020-04-28 15:18:43,018 - octoprint.util.comm - INFO - Changing monitoring state from "Connecting" to "Operational"
2020-04-28 15:18:43,053 - octoprint.util.comm - INFO - M110 detected, setting current line number to 0
2020-04-28 15:18:43,102 - octoprint.util.comm - INFO - Printer reports firmware name "Marlin Creality 3D (Creality3D)"
2020-04-28 15:18:43,114 - octoprint.util.comm - INFO - Firmware states that it supports temperature autoreporting
2020-04-28 15:19:14,235 - octoprint.plugins.filamentsensorsimplified - INFO - Setting up sensor.
2020-04-28 15:19:14,238 - octoprint.plugins.filamentsensorsimplified - INFO - Using Board Mode
2020-04-28 15:19:14,244 - octoprint.plugins.filamentsensorsimplified - INFO - Filament Sensor active on GPIO Pin [7]
2020-04-28 15:19:46,539 - octoprint.printer.standard.job - INFO - Print job selected - origin: local, path: Prints/NO_BL_TOUCH.gcode, owner: Admin, user: Admin
2020-04-28 15:19:46,570 - octoprint.util.comm - INFO - Changing monitoring state from "Operational" to "Starting"
2020-04-28 15:19:46,590 - octoprint.printer.standard.job - INFO - Print job started - origin: local, path: Prints/NO_BL_TOUCH.gcode, owner: Admin, user: Admin
2020-04-28 15:19:46,606 - octoprint.plugins.filamentsensorsimplified - INFO - PrintStarted: Enabling filament sensor.
2020-04-28 15:19:46,624 - octoprint.util.comm - INFO - M110 detected, setting current line number to 0
2020-04-28 15:19:46,694 - octoprint.util.comm - INFO - Changing monitoring state from "Starting" to "Printing"
2020-04-28 15:19:48,778 - octoprint.util.comm - INFO - Printer seems to support the busy protocol, will adjust timeouts and set busy interval accordingly
2020-04-28 15:19:49,055 - octoprint.plugins.filamentsensorsimplified - INFO - Sensor was triggered
2020-04-28 15:19:49,063 - octoprint.plugins.filamentsensorsimplified - INFO - Sending out of filament GCODE
2020-04-28 15:19:50,071 - octoprint.plugins.filamentsensorsimplified - INFO - Sensor was triggered
2020-04-28 15:19:51,077 - octoprint.plugins.filamentsensorsimplified - INFO - Sensor was triggered
2020-04-28 15:19:52,081 - octoprint.plugins.filamentsensorsimplified - INFO - Sensor was triggered
2020-04-28 15:19:53,083 - octoprint.plugins.filamentsensorsimplified - INFO - Sensor was triggered
2020-04-28 15:19:54,087 - octoprint.plugins.filamentsensorsimplified - INFO - Sensor was triggered
2020-04-28 15:19:55,090 - octoprint.plugins.filamentsensorsimplified - INFO - Sensor was triggered
2020-04-28 15:19:56,093 - octoprint.plugins.filamentsensorsimplified - INFO - Sensor was triggered
2020-04-28 15:19:57,096 - octoprint.plugins.filamentsensorsimplified - INFO - Sensor was triggered
2020-04-28 15:19:58,100 - octoprint.plugins.filamentsensorsimplified - INFO - Sensor was triggered
2020-04-28 15:19:59,102 - octoprint.plugins.filamentsensorsimplified - INFO - Sensor was triggered
2020-04-28 15:20:00,106 - octoprint.plugins.filamentsensorsimplified - INFO - Sensor was triggered
2020-04-28 15:20:01,110 - octoprint.plugins.filamentsensorsimplified - INFO - Sensor was triggered
2020-04-28 15:20:02,113 - octoprint.plugins.filamentsensorsimplified - INFO - Sensor was triggered
2020-04-28 15:20:03,117 - octoprint.plugins.filamentsensorsimplified - INFO - Sensor was triggered
2020-04-28 15:20:04,121 - octoprint.plugins.filamentsensorsimplified - INFO - Sensor was triggered
2020-04-28 15:20:05,125 - octoprint.plugins.filamentsensorsimplified - INFO - Sensor was triggered
2020-04-28 15:20:06,129 - octoprint.plugins.filamentsensorsimplified - INFO - Sensor was triggered
2020-04-28 15:20:07,132 - octoprint.plugins.filamentsensorsimplified - INFO - Sensor was triggered
2020-04-28 15:20:08,134 - octoprint.plugins.filamentsensorsimplified - INFO - Sensor was triggered
2020-04-28 15:20:09,138 - octoprint.plugins.filamentsensorsimplified - INFO - Sensor was triggered
2020-04-28 15:20:10,141 - octoprint.plugins.filamentsensorsimplified - INFO - Sensor was triggered
2020-04-28 15:20:11,144 - octoprint.plugins.filamentsensorsimplified - INFO - Sensor was triggered
2020-04-28 15:20:12,146 - octoprint.plugins.filamentsensorsimplified - INFO - Sensor was triggered
2020-04-28 15:20:13,150 - octoprint.plugins.filamentsensorsimplified - INFO - Sensor was triggered
2020-04-28 15:20:14,155 - octoprint.plugins.filamentsensorsimplified - INFO - Sensor was triggered
2020-04-28 15:20:15,158 - octoprint.plugins.filamentsensorsimplified - INFO - Sensor was triggered
2020-04-28 15:20:15,491 - octoprint.util.comm - INFO - Telling the printer to set the busy interval to our "communicationBusy" timeout - 1s = 2s
2020-04-28 15:20:16,162 - octoprint.plugins.filamentsensorsimplified - INFO - Sensor was triggered
2020-04-28 15:20:16,165 - octoprint.plugins.filamentsensorsimplified - INFO - Sending out of filament GCODE
2020-04-28 15:20:17,170 - octoprint.plugins.filamentsensorsimplified - INFO - Sensor was triggered
2020-04-28 15:20:18,173 - octoprint.plugins.filamentsensorsimplified - INFO - Sensor was triggered
2020-04-28 15:20:18,179 - octoprint.plugins.filamentsensorsimplified - INFO - Sending out of filament GCODE
2020-04-28 15:20:19,183 - octoprint.plugins.filamentsensorsimplified - INFO - Sensor was triggered
2020-04-28 15:20:20,187 - octoprint.plugins.filamentsensorsimplified - INFO - Sensor was triggered
2020-04-28 15:20:20,191 - octoprint.plugins.filamentsensorsimplified - INFO - Sending out of filament GCODE
2020-04-28 15:20:21,196 - octoprint.plugins.filamentsensorsimplified - INFO - Sensor was triggered
2020-04-28 15:20:22,199 - octoprint.plugins.filamentsensorsimplified - INFO - Sensor was triggered
2020-04-28 15:20:23,175 - octoprint.util.comm - INFO - Changing monitoring state from "Printing" to "Cancelling"
2020-04-28 15:20:23,198 - octoprint.util.comm - INFO - Force-sending M108 to the printer
2020-04-28 15:20:23,208 - octoprint.plugins.filamentsensorsimplified - INFO - Sensor was triggered
2020-04-28 15:20:23,231 - octoprint.printer.standard.job - INFO - Print job cancelled - origin: local, path: Prints/NO_BL_TOUCH.gcode, owner: Admin, user: Admin
2020-04-28 15:20:23,239 - octoprint.plugins.filamentsensorsimplified - INFO - PrintCancelled: Disabling filament sensor.
2020-04-28 15:20:23,400 - octoprint.plugins.filamentsensorsimplified - INFO - PrintFailed: Disabling filament sensor.
2020-04-28 15:20:24,213 - octoprint.plugins.filamentsensorsimplified - INFO - Sensor was triggered

Sending M600 X0 Y0 through the terminal, or any command really, doesn't seem to be doing anything. When I click on PAUSE this is what shows up in the logs however:
2020-04-28 15:36:22,298 - octoprint.util.comm - INFO - Changing monitoring state from "Starting" to "Printing"
2020-04-28 15:36:23,234 - octoprint.util.comm - INFO - Changing monitoring state from "Printing" to "Pausing"
2020-04-28 15:36:47,012 - octoprint.printer.standard.job - INFO - Print job paused - origin: local, path: Prints/NO_BL_TOUCH.gcode, owner: Admin, user: Admin
2020-04-28 15:36:47,106 - octoprint.util.comm - INFO - Changing monitoring state from "Pausing" to "Paused"

That is weird, then there's some issue with your printer I'm afraid. But the sensor triggering was happening to me too, are you by any chance running sensor wiring along wires to motors? I was able to resolve this issue using shielded wire for sensor and grounding the shielding, seems interference was the cause. But your logs also showed me one bug which I'm going to fix.

I lied, i can enter commands and it does work, but only on certain things. Entering M600 does not seem to work. The only thing that seems to pause is M25 which is oddly for SD card prints. When I try to restart with M24 it gives me an error. When I try to continue the print with the octoprint button, octoprint crashes. As for the wires, they aren't running that close to the motors. I'm not sure how to shield them further?

You have to get shielded wire. I'm gonna close this as the problem does not seem to be plugin related.

You have to get shielded wire. I'm gonna close this as the problem does not seem to be plugin related.

The only problem plugin related is that, at leat for the Ender3, the M600 command line does not work. The M0 command does however.

It uses M600, specifically M600 X0 Y0 as you already tried.


AWS Glue support

Discussed in https://github.com/provectus/kafka-ui/discussions/1305

Originally posted by miguellgramacho96 December 21, 2021
Hi!
I'm currently storing the avro schema in the aws glue schema registry.
How can I (if its even possible) apply a avro schema to all of the messages from one topic, if I dont connect the kafka-ui to aws glue schema registry? (I think kafka-ui does not support aws glue).
Kind regards.

https://github.com/awslabs/aws-glue-schema-registry

Hi! Do you have an idea when will this issue be implemented? Thanks!

@nikola-vukadinov-htec hey, probably within a few weeks.

So it seems this will be in release 0.5. Is there a roadmap on when that will be released?

@Haarolean can i become a contributor for this feature will be glad to take this from your hand, really love this product,
and would like to help :)

@Haarolean can i become a contributor for this feature will be glad to take this from your hand, really love this product, and would like to help :)

hi and welcome!
Please note that we have some (de)serializers for schema registry, so we'd have to implement some for glue as well. Also note that #1816 is in progress so we might need to refactor it in the future.
Also, feel free to join us on discord if you have any questions (development-related, or in general).

can u give me an invite link for the discord group
u can send it to my email<EMAIL_ADDRESS>

https://discord.gg/4DWzD7pGE5
it's in the readme as well, btw

@DBTK1990 any luck?

I am interested in this too.. let me know when this feature will be implemented. Thanks

@pc-akothapeta it kinda already is. We're waiting for some stuff to be done before it's usable.

@pc-akothapeta it kinda already is. We're waiting for some stuff to be done before it's usable.

Thanks @Haarolean


add savannah, update dependencies

Seems to be issue with Travis CI.

Seeing as it doesn't appear this app is being maintained anymore, we redeployed our own instance at http://click-that-hood.opensavannah.org.

Hey @carlvlewis, are you all seeing a user need for this? Would love to discuss transferring maintenance of this repository over to somebody who is still working on improving it for users.

No, wouldn't say a there's a user need per se, but it's helpful to have, as Savannah has something like 107 neighborhood associations that all have similar issues but never collaborate. A need exists to educate people on their local neighborhoods so that they might get involved with their neighborhood association as well as a need for cross-neighborhood collaboration. Just saw this as possibly part of helping fulfill that gap. Happy to maintain and improve it – don't know if it will be feasible for it to work on mobile, though, as the data density required to use the application won't be usable on a smaller viewport.

I think there is quite some interest from the community in this. I would personally be very happy if someone could take over maintenance of the repository. Since most PRs will probably be about adding new maps having a working sanity check on Travis should help a lot and reduce the manual effort to a minimum.
I'd be happy to help triage the old bugs and fix Travis so that the existing PRs can be merged.

Hey @tdooner! Pardon the delayed responses as of late. Sure, this is something I think should be maintained and possibly improved upon even. Yes, the Travis CI failures are cringe-inducing for me, so if you think you could clear those up, I'd be more than happy to manage PRs of new geojson files as well as (possibly) perform some minor interface improvements for the small neighborhoods and make sure all dependencies stay intact and working.

I'd love to be a maintainer for this project. My pull requests #294 and #295 have been waiting to get reviewed since June 2016.
I promise to promptly review all the contributions waiting in the queue.

Hi there! We recently transferred this repository and the domain click-that-hood.com from @codeforamerica to the @codeforgermany namespace and intend to bring it to life again :) Are some of you still interested to join us in maintaining code and data? Ping @k-nut, @carlvlewis, @specious, @melynnduh.

@fnogatz, that's excellent news. Count me in.

Added you to the repository, @specious.

@carlvlewis, thank you for this contribution. I just cherry picked the data files for Savannah and merged them into master.
Merge commit: 6e6a9fcf012a3304e18403adab898aca14937a0b
This project is alive again. @k-nut, if you're interested in contributing, please jump on board.
@melynnduh, it would be wonderful if you could add Allegheny County. Just take a look at how all the others are done and follow the pattern. Fork this project, get it working, and then open a pull quests.

Thanks for the ping @specious. I'm definitely following the developments and am looking forward to this picking up steam again :)


Put satellites in packages

After this goes into xplat, microbuild will have to change to do localized builds for the nuget builds otherwise nuget pack will fail with not being able to find the packates.

@dotnet-bot test Windows_NT Build for Desktop  please

@dotnet-bot test Windows_NT Build for Desktop please


Fixes NIP-166

The code wasn't looking to see if mcts id was set or not before checking to see if it matched the
id provided in the csv.

LGTM


Data Typing - Pandas, BigQuery, and JS

Background
Coordinating data types between Python, Pandas, BiqQuery, and JavaScript has been problematic. A lot of time is wasted in pipeline testing that can't be done locally to ensure correct types for all data
What's Missing / Problems with the current approach
We would like to send 4 different types from our Python/Pandas dataframes to BiqQuery:

floats (we would like our _pct_share metrics to include a single decimal value, e.g. 40.4%
ints (we would like our _per_100k rates to display as whole numbers, e.g. 345 per 100k
strings (all text, group labels, etc)
boolean (used only for race_includes_hispanic but maybe this will be going away after #1474 is done

There are a few issues with our current approach due to BigQuery  and Panda quirks:

Pandas doesn't like nullable int columns (meaning a column contains a mix of int values and null values). We can get around this using the newer dtype='Int64' in Pandas
BigQuery seems to accept these INT64 data just fine, and the BigQuery ui displays them being stored, however when we fetch them on the frontend it seems to cast BigQuery INTEGER (an alias for INT64 I believe) to JS string. Confusingly, it seems to be casting BigQuery FLOAT as JS number which is exactly what we want.
The frontend has a section in DataFetcher dedicated to testing whether a cell value in a nullable column is == null and if so, explicitly setting it to null. Otherwise, it is casting to Number().

Proposed Solution
I think if we set everything on Pandas writing to BQ to FLOAT when we import into the frontend it will handle all of the above issues. I believe we already have frontend code in place to explicitly include .0 as needed for whole number _pct_share values, and it seems JS auto trims dangling .0 by default, so we don't need to further cast these "float" values as whole numbers
Screenshots / Mockups
Logging the .json response from DataFetcher (prior to any null casting) shows that floats come through as numbers but ints come through as strings. #193

End State

All python data sources use a standardized util function that creates a dtype dict settings numbers to FLOAT and everything else to STRING.
Frontend reads data in directly, and doesn't need the null and Number casting step. JS auto-trims dangling .0 and our components (Vega, etc) will add it back on as needed

How will this move the needle on health equity?
Specifically how this will help advance health equity, and is possible who the target audience might be (policy influencers, non-technical users, etc)
Having a single, defined process to handle these issues will improve development speed on new data sources, make our data sets easier to work and more consistent, also less error prone.
Tasks:

[ ] Confirm above assumptions / loose understandings
[ ] Confirm outlined plan is the simplest and most accurate
[ ] Created backend util fn that automatically generates the needed BigQuery dtypes
[ ] Create sub-tasks for every data source
[ ] Rerun pipelines
[ ] Confirm frontend operating as expected

@benhammondmusic thank you for this.
I think this is right and will greatly simplify our codebase.
One thing, the backend refactor will not necessarily get rid of the race_includes_hispanic boolean.
I think we should get moving on this.

@benhammondmusic thank you for this.
I think this is right and will greatly simplify our codebase.
One thing, the backend refactor will not necessarily get rid of the race_includes_hispanic boolean.
I think we should get moving on this.

Sounds good. Curious where you anticipate us needing the field? My understanding was that for sources where it's available we would add a new column "ethnicity" whose values would be "Hispanic" "non-Hispanic" "unknown"

We can get rid of it if we want but its not connected to the backend refactor.


Fix Menu documentation

Some Menu methods are instance methods, also items is a property.

/cc @jlord

Awesome, thanks @miniak!


do we have a function to trigger if everything is loaded in ngx-carousel?

@tamilvaanan added the afterCarouselViewed output is added. read the changelog and readme file


upload binary to bintray for every PR

For every PR build binary is uploaded to bintray to make it easy for anyone to test PR without a need to rebuild manually.
Followup to this will be creating a script that will automatically post a comment to PR with a link to where binary can be downloaded.

I don't see any glaring issues with this, this LGTM.

@kadel, Not sure if I am missing something... but, aren't we uploading the packages to a separate dir(for pr builds) on bintray because I don't see any dir by name of form https://travis-ci.org/redhat-developer/odo/jobs/440625179#L654 on https://dl.bintray.com/odo/ (Am I looking at the correct url?) in any of its internal dirs..

this looks good to me :)
@kadel , can you we do something like this: odo bot will comment on respective PR with generated binary link, so that reviewer can click on binary and pull it and test it

@kadel , oh I saw description of PR now :smiley_cat:

I had to redo this PR in a different way.
Travis doesn't run deploy stage when PR is built, and it can't be forced.
I had to do it via script.

@kadel, Not sure if I am missing something... but, aren't we uploading the packages to a separate dir(for pr builds) on bintray because I don't see any dir by name of form https://travis-ci.org/redhat-developer/odo/jobs/440625179#L654 on https://dl.bintray.com/odo/ (Am I looking at the correct url?) in any of its internal dirs..

It didn't work before :-( Deploy is stage is never run for PRs :-(
My last update is fixing that.
Now you should be able to find binaries at https://dl.bintray.com/odo/odo/pr<number>
for this PR - https://dl.bintray.com/odo/odo/pr833

IT looks like this approach is not going to work, because of the security restrictions on travis-ci side - https://docs.travis-ci.com/user/pull-requests#pull-requests-and-security-restrictions
I'll have to look for another solutions that doesn't required storing any secrets

closed in favor of #898


Vue stripping out styles from inline SVG

Version
2.6.11
Reproduction link
https://jsbin.com/lurayuxofo/edit?html,js,console,output
Steps to reproduce

Include inline SVG with some styles within a Vue instance
Init vue instance

What is expected?
SVG to be styled according to the style element
What is actually happening?
Vue is giving a warning "[Vue warn]: Templates should only be responsible for mapping the state to the UI. Avoid placing tags with side-effects in your templates, such as

While putting a style tag inside of an svg element is valid HTML, it still has the same effect as putting it outside of it: it leaks its CSS definitions into the global scope, potentially affecting every other element in the application. This is notably the case with generated classes inside .svg files: copying the svg content into a component and leaving the style tag will override existing classes and change existing svgs because of generated classes for different SVG sharing the same name.
When using an img to display an svg, this is not a problem, because the style definitions do not leak globally.
The warning was introduced because it was common for users to fall for this. It's still possible for users to ignore the warning and explicitly inject style tags by using a duplicate namespace or by using v-html="<style>...</style>".

It's not possible when using svg files directly.

How are you using SVG files directly as inline SVG?

How are you using SVG files directly as inline SVG?

Using this config:
// vue.config.js
module.exports = {
  devServer: {
    overlay: false
  },
  chainWebpack: (config) => {
    const svgRule = config.module.rule('svg')

    svgRule.uses.clear()

    svgRule
      .use('vue-loader')
      .loader('vue-loader-v16')
      .end()
      .use('vue-svg-loader')
      .loader('vue-svg-loader')
  }
}

the lib

You can use raw-loader to import the SVG file as a string and then use it in v-html. This would introduce an extra wrapper element though.

You can use raw-loader to import the SVG file as a string and then use it in v-html. This would introduce an extra wrapper element though.

Sure, that would be a solution :+1:
How about adding an optional rule to vue-loader regarding style preservation from svg files?
(is it even the culprit regarding style stripping ?)
Would the team be firmly against it?
I could make a PR.
Coming from a react and vue background I tend to use as much svg files as I can as they are lighter than pngs.

@MeisterTea I agree 100% it would be awesome to not have to think when we use SVGs in our apps.
Using styles tags in SVG represents a significant risk of conflict.
If you are using Illustrator to export your SVG assets, the classes that AI creates are almost always repeated (.st1, filter_2). If two SVGs are displayed on the same page, they might fight each others styles resulting in non-predictable results.
Depending on where your SVG files come from, you might have the option of exporting them with attributes instead of <style>.
Illustrator does it well, sketch does not, Boxy Svg is awesome at it.
With sketch, you can also use the SVGO plugin. The inlineStyles option will move all the content of classes into the object they represent.

I would really like to see better support for SVGs in the Vue ecosystem. I struggled with issues (like style tags getting stripped) when implementing our icon system at work. I implemented svgo-loader + vue-svg-loader to generate uniquely prefixed classnames for the style tags. Here's the prefixIds PR for SVGO which adds that functionality.
@posva The main issue with this solution is that not all styles can be inlined. You can't do anything with pseudo selectors or at-rules (media queries, feature detection). This means that implementing an icon system with interactive svgs becomes very difficult. You can pull out the svg into a v-html but that kind of defeats the purpose of componetizing the SVG in the first place.
SVGO is also available as a webpack loader so I think implementing this inside of vue-cli could be doable.

@posva The main issue with this solution is that not all styles can be inlined. You can't do anything with pseudo selectors or at-rules (media queries, feature detection). This means that implementing an icon system with interactive svgs becomes very difficult. You can pull out the svg into a v-html but that kind of defeats the purpose of componetizing the SVG in the first place.

My comment is only accounting for what was said initially: allowing style tags inside svg.
If there is a webpack loader involved, it will be the loader's job to automate any process to avoid inlining style. It could be extracting the styles to a separate CSS file, inlining styles, wrapping the svg with props to change styles. All of this is way beyond Vue's scope and should live in the loader itself.
I think with the upcoming css vars mode in SFC, there is a lot of room for improvement for loaders to simplify working with svgs and Vue

Inlining styles are not always possible. Eg. things like @keyframes cannot be inlined. As @elevatebart pointed out this introduces high risks of naming conflicts. Is there any chance that we preprocess SVGs in vue-svg-loader to rewrite identifiers (ids, classes, animation names, …) into unique ones to eliminate naming conflicts?

Thanks for the response.
I only care about this issue being acknowledged as a real one and re-opened -- not to imply any scheduling or priority.

My comment is only accounting for what was said initially: allowing style tags inside svg.

This is notably the case with generated classes inside .svg files: copying the svg content into a component and leaving the style tag will override existing classes and change existing svgs because of generated classes for different SVG sharing the same name.

@posva I was trying to address your concern RE: namespace risk, so I brought up SVGO + loaders.

If there is a webpack loader involved, it will be the loader's job to automate any process to avoid inlining style.

You mentioned that the loader can handle this. I agree, this is a good stop-gap. However, if loaders are the final solution, we will diverge from the SVG spec, but only in SFC-compiled components... not template-compiled ones. Keeping template-compiled markup equivalent to Vue SFCs seems like it would be a requirement.
@Justineo I think a webpack-loader approach is possible and an OK near-term solution for many users. Using the prefixIds plugin for SVGO would work to generate unique ids.
Again, I would love this feature to be in the core Vue compiler due to the template-compilation issue outlined above. We seem to be interested in diversifying our build stack from Webpack so if we choose a loader-based solution, this issue may become more apparent as time goes on.
Vue just shouldn't strip style tags in SVG. It's against spec, we should figure a solution

It would be very nice to have options. Stripping styles or preserving them. Also vue could try to make styles scoped if user wants.


ARTEMIS-2445 : fix issue of large message lost on divert

I'm closing this for now. Please re-open when you are able to provide a valid test in the test-suite to validate the fix and prevent future regressions.


How do I exclude by tags?

Hello @azumukupoe tags are not exclusive. you can select tags and the filters will show you games with those tags, but you cannot select a tag to exclude games containing the selected exclusion.


markdown filenames, when written as code marks get promoted to links after a space is typed

for example:

A portion of this was fixed in #142.


[FEATURE] Enhance.com & ISPVMManager

Intergration with https://enhance.com | https://apidocs.enhance.com/
as well as intergration with https://www.ispsystem.com/vmmanager | https://docs.ispsystem.com/vmmanager-admin/developer-section/api/vmmanager-api

Enhance.com: ✔

@CorwinDev thank you for the integration with "Enhance"! But there is an important point, after payment the user does not receive an email with password or any data about "enhance" at all.  Because "enhance" doesn't have a "welcome email" with login data. And "Paymenter" doesn't do that either. Also from the order it is not possible to go to the enhancement panel, as for example it is realized in virtfustion integration.
Below is the response of "enhance" support:
"Enhance does not send welcome emails. Normally the billing platform would do this. I don't know if Paymenter sends these emails, you would need to ask their team.
There is also an SSO function which can be used to log a customer in to their panel without needing separate credentials but again the Paymenter team would need to integrate this."

Hi @Pachini i'll include this feature very soon!

@Pachini just added this feature, please redownload enhance from /admin/extensions/browse and let me know if it works intended :)

Should be fixed
Weird, it might be expired
The route is clients.active-products.show and what emil template is it?

Ok now!
Maybe, anyway I can't reproduce it. Everything is fine
Email template is: NewOrder

I think you can do
@component('mail::button', ['url' => route('clients.active-products.show', $products->first()->id)])
    View order
@endcomponent

I didn't test it tho!
v1 will include this default :)

Awesome, works as it should!
Where I can read about upcoming features in v1 release? :)

We don't have a exact feature list yet, but i can give you some sneakpeeks on our discord https://discord.gg/xB4UUT3XQg (corwindev for dms)


Upgrade to Go 1.17

Upgrading to go 1.17 to address this CVE

Integration tests are passing when building this w/ 1.17.


Add a test-coverage badge to the projects README

Waiting for https://github.com/oven-sh/bun/issues/4015


Dedicated windows

This feature looks nice.

I also wouldn't want to open a new window after marking one as the target for the upcoming buffer, only to have the new buffer pop into my new window instead of the marked one.
The ideal functionality would be for C-c d to dedicate all windows except the current one the first time it is pressed, but when repeated it should undedicate the current window (so you can designate, for instance, two windows to hold the Clojure and ClojureScript REPLs from cider-jack-in-clojurescript). Then e.g. C-c D could be used to undedicate all windows (after the buffer(s) had been popped).

This seems overcomplicated.


The link to https://github.com/weixsong/lunr-languages is broken!

The link to https://github.com/weixsong/lunr-languages is broken!
I then used https://github.com/MihaiValentin/lunr-languages and now I get the same error as in https://github.com/weixsong/elasticlunr.js/issues/80#
Originally posted by @kaijauk in https://github.com/weixsong/elasticlunr.js/issues/80#issuecomment-475981001

@kaijauk , sorry for un-convenience. the repo https://github.com/weixsong/lunr-languages is recovered.


Useless concurrent attribute for synchronizationQueue in AutoPurgingImageCache

Why all calls of synchronizationQueue in AutoPurgingImageCache used barrier flag?

It's a typical many readers, on writer approach to thread safety. In a future version it'll all be removed and switched over to locks / actors, so it's not something we're looking to change at this point.


update readme, switch to lat & lon, unit changeable

Hey,
I noticed that your README wasn't up-to-date anymore regarding the .env file. I changed that and added optional Lat and Lon variables. These are used in the weather API (since I don't live in the US, the zip code was useless for me) and if you don't fill those the Geolocation API is used. I also added a unit variable because I use Celsius.
What do you think about my changes?
Greetings

Hi,
Yes, these are all great changes that needed to be implemented. Thank you for doing do, I will get this merged in.
Best,
Tim


KAFKA-8628: Auto-generated Kafka RPC code should be able to use zero-copy ByteBuffers

It is often more efficient to deal with large fields of type "bytes" as ByteBuffer objects, rather than Java arrays.  ByteBuffers can be used in a "zero-copy" fashion, where they simply serve as pointers into already allocated memory.  This avoids the need to copy the data, as would be necessary when using a regular Java byte array.
There is a drawback to using zero-copy ByteBuffers, though: when they are used, the ByteBuffer from which we deserialized the request must remain valid until we're done with the request.  So the underlying buffer cannot be reused during this period.  Therefore, we don't want all bytes fields to show up as ByteBuffers.
This change adds a "style" field to the RPC specifications which allows specifying that a "bytes" field should be deserialized as a zero-copy ByteBuffer rather than as a byte array.

@cmccabe is this still relevant after https://github.com/apache/kafka/pull/7342?

Closing this as a duplicate of #7342


Customizing logVerbosity crashes secret store provider

What steps did you take and what happened:
We upgraded to the latest version of the csi-secrets-store-provider-azure helm chart (v0.0.14) and customized the logVerbosity to 2.  However, deploying the chart with this configuration results in the secret store provider being unable to start due to an unknown flag that's added when logVerbosity != 0:
❯ k logs csi-secrets-store-provider-azure-1606860391-8s4jg
unknown shorthand flag: 'v' in -v=2
Usage of /bin/secrets-store-csi-driver-provider-azure:
      --endpoint string   CSI gRPC endpoint (default "unix:///tmp/azure.sock")
      --log-format-json   set log formatter to json
      --version           prints the version information

Snippet from the pod description showing the updated argument coming from the logVerbosity configuration:
Containers:
  provider-azure-installer:
    Container ID:  docker://8c3df0b98a0d8bf85fc90fce291c633937fac05a8940b88085a66d25f446df81
    Image:         mcr.microsoft.com/oss/azure/secrets-store/provider-azure:0.0.10
    Image ID:      docker-pullable://mcr.microsoft.com/oss/azure/secrets-store/provider-azure@sha256:f23d699ac74e4a7eae1f7f8f4db010701e6438b4c643056aa6d3df6336f4eab2
    Port:          <none>
    Host Port:     <none>
    Args:
      --endpoint=unix:///provider/azure.sock
      -v=2
    State:          Waiting
      Reason:       CrashLoopBackOff

What did you expect to happen:
Helm chart deploys successfully with a log level configured according to the supplied value.
Anything else you would like to add:
Which access mode did you use to access the Azure Key Vault instance:
Service Principal
Environment:

Secrets Store CSI Driver version: (use the image tag): 0.0.17
Azure Key Vault provider version: (use the image tag): 0.0.10
Kubernetes version: (use kubectl version and kubectl get nodes -o wide): 1.17.11
Cluster type: (e.g. AKS, aks-engine, etc): AKS

@doug-papenthien-by Thank you for reporting the issue. I'll take a look and add the fix to the next release.


Linux Mint 20.2 Support

Is linux mint 20.2 supported?  I get an error during install about the wine-staging package, it's version references hirsute, so it's looking for the ubuntu version.

Linux Mint 20.2 use Ubuntu 20.04 as basis and so you must select this one. 😊
Link: https://wiki.winehq.org/Ubuntu

Thanks, I'm getting broken packages, libc6 in mint 20.2 is at 2.31-0ubuntu9.2
wine-staging:
Depends: libc6 (>=2.33) but 2.31-0ubuntu9.2 is to be installed
Depends: wine-staging-i386 (= 6.14~hirsute-1)
Depends: wine-staging-amd64 but it is not going to be installed

Very interesting. 🤔 Then we must search why it’s so.

I have found this issue: https://askubuntu.com/questions/1315906/unmet-dependencies-libc6-the-package-system-is-broken

@mellery I have change the installation-script! :+1:

thanks!  That fixed the installer, I get a blank window after the fusion 360 splash screen closes

rebooted and left it open for a long time and it started working!  Thanks for the script!


Code for SCG-Net Semantic Segmentation Paper

Hello;
Would you please upload the code for the SCG-Net Semantic Segmentation Paper, for learning and research purposes.
Thanks

Hi @abderraouf2che,
The scg_gcn.py file at https://github.com/samleoqh/MSCG-Net/blob/master/lib/net/scg_gcn.py contains the code you need.


DUPLO16758

Overview
... (don't forget to put your clickup ticket ID in the title) ...
Summary of changes
This PR does the following:

Implements a before hook function for each CRUD operation on DynamoDB tables.
Prefixes the table name with "duploservices" and the tenet name as expected by the API.

Testing performed

[ ] Using unit tests
[X] Manually, on my local system
[ ] Manually, on a remote test system

Describe any breaking changes

Task linked: DUPLO-16758 Upgrade:When upgrading backend from the Feb to the master, the Terraform plan shows changes in the existing DynamoDBV2 resource if DynamoDBV2 was deployed without the Duplo prefix.


Fix/major refactor

Codecov Report

Merging #13 (ba8f7b6) into main (980c764) will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##             main      #13   +/-   ##
=======================================
  Coverage   97.85%   97.85%
=======================================
  Files           4        4
  Lines         140      140
=======================================
  Hits          137      137
  Misses          3        3

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 980c764...ba8f7b6. Read the comment docs.


Flattening Signals

Can we implement a flatten method on nested ReadSignals?
    impl<T> ReadSignal<ReadSignal<T>> {
        fn flatten(&self) -> ReadSignal<T>;
    }

I'm not sure if this is a good idea, and it's not something I've needed yet, so closing for now.


remove save config

:tada: This PR is included in version 1.0.0 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


Can't run Desktop App on Asahi Linux

Attempting to run Bluebubbles from Asahi Linux results in error:
bluebubbles: error while loading shared libraries: libmpv.so.1: cannot open shared object file: No such file or directory
Installed using Flathub and Snap store to same result.
Note: Have used Bluebubbles on Asahi linux before but it's been awhile so an update probably broke it.

Hmm it should be trying to load libmpv.so.2. What version of the app are you running?

Output of `$ snap info bluebubbles
name:      bluebubbles
summary:   BlueBubbles client for Linux
publisher: BlueBubbles (jojejo)
store-url: https://snapcraft.io/bluebubbles
license:   unset
description: |
BlueBubbles is an open-source and cross-platform ecosystem of apps aimed to bring iMessage to
Android, Windows, Linux, and more! With BlueBubbles, you'll be able to send messages, media, and
much more to your friends and family.
Important Note
The following features are not supported on the Snap version:

In-app video playback
Signing in with Google

These features are supported on the Flatpak version, available here:
https://flathub.org/apps/app.bluebubbles.BlueBubbles.
commands:

bluebubbles
snap-id:      6oNtWIWOaMA4O7xbzddHuvhprSnVXYmV
tracking:     latest/stable
refresh-date: today at 18:19 AEDT
channels:
latest/stable:    <IP_ADDRESS> 2024-11-07 (80) 104MB -
latest/candidate: ↑
latest/beta:      ↑
latest/edge:      <IP_ADDRESS> 2024-11-14 (81) 104MB -
installed:          <IP_ADDRESS>            (80) 104MB -
`

I just checked the binaries with ldd and for some reason the x86_64 version depends on libmpv.so.2, while the arm64 version depends on libmpv.so.1. I incorrectly assumed they'd need the same dependency. I'll update the snap and flathub configurations as soon as I can.

Thanks!

Turns out the issue was just that I had built the arm version on an older OS. I've updated my environment, so 1.15 should work as expected. The builds are in the process of being published. I will close this issue when they are released.

1.15 has been published to both stores

Works!


implement throttle setting for MAV_CMD_DO_CHANGE_SPEED

According to https://pixhawk.ethz.ch/mavlink/#MAV_CMD_DO_CHANGE_SPEED
Param 3 should change throttle percentage.
This is not implemented yet:
https://github.com/PX4/Firmware/blob/master/src/modules/navigator/mission_block.cpp#L124

also, no differentiation for the groundspeed / airspeed is made now.
At this moment i will only focus on the throttle setting

implemented in https://github.com/PX4/Firmware/pull/4770


Fixed bug in optimizer rule bitmap

This PR introduces a fix for #1234. The bitset.set() function was being used incorrectly, and not correctly updating the bitmap, leading to false positives. I've also included a test case to check correctness, which without the fix, would highlight the false positive.

Coverage decreased (-1.5%) to 75.507% when pulling 368c201fb6b29ac9ed9f8e360b8afd02a428454f on GustavoAngulo:master into 19dcdfe12d1114dc879162a53799626015466f41 on cmu-db:master.

@GustavoAngulo @chenboy This PR is not passing the Travis test. Please fix the failed test cases before merging.

Bugs should be fixed by #1242, that PR should be merged first.

Okay I'm reviewing that PR.


It might not as they have already been applied against the PR (I disabled cirrus ci against the repo due to hitting the limits)


Fix KyuubiDriverSuite UT failure because of NPE

1. Describe the bug
Run KyuubiDriverSuite in my local IDE, but failed because of NPE(missing kyuubi-version-info.properties).
2. Environments

Mac OS X 10.14.5
Intellij IDEA 19.2
Java 1.8

2.1 Versions

Kyuubi

[x] 1.13.0(master)
[ ] 1.0.3
[ ] 0.8.x and earlier

Spark

[ ] 3.1.x
[ ] 3.0.x
[x] 2.4.x and earlier

2.2 Kyuubi Configurations
none(local UT)
2.3 Spark Configurations
none(local UT)
3. Steps to reproduce
3.1 Operations
3.2 Expected behavior

3.3 Actual behavior
4. Additional context
An exception or error caused a run to abort: Failed to initialize frontend service on /<IP_ADDRESS>:0.
org.apache.kyuubi.KyuubiException: Failed to initialize frontend service on /<IP_ADDRESS>:0.
	at org.apache.kyuubi.service.FrontendService.initialize(FrontendService.scala:102)
	at org.apache.kyuubi.service.CompositeService.$anonfun$initialize$1(CompositeService.scala:40)
	at org.apache.kyuubi.service.CompositeService.$anonfun$initialize$1$adapted(CompositeService.scala:40)
	at scala.collection.mutable.ResizableArray.foreach(ResizableArray.scala:62)
	at scala.collection.mutable.ResizableArray.foreach$(ResizableArray.scala:55)
	at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:49)
	at org.apache.kyuubi.service.CompositeService.initialize(CompositeService.scala:40)
	at org.apache.kyuubi.service.Serverable.initialize(Serverable.scala:44)
	at org.apache.kyuubi.engine.spark.SparkSQLEngine.initialize(SparkSQLEngine.scala:50)
	at org.apache.kyuubi.engine.spark.SparkSQLEngine$.startEngine(SparkSQLEngine.scala:108)
	at org.apache.kyuubi.engine.spark.WithSparkSQLEngine.startSparkEngine(WithSparkSQLEngine.scala:57)
	at org.apache.kyuubi.engine.spark.WithSparkSQLEngine.startSparkEngine$(WithSparkSQLEngine.scala:39)
	at org.apache.kyuubi.jdbc.KyuubiDriverSuite.startSparkEngine(KyuubiDriverSuite.scala:25)
	at org.apache.kyuubi.engine.spark.WithSparkSQLEngine.beforeAll(WithSparkSQLEngine.scala:35)
	at org.apache.kyuubi.engine.spark.WithSparkSQLEngine.beforeAll$(WithSparkSQLEngine.scala:34)
	at org.apache.kyuubi.jdbc.KyuubiDriverSuite.beforeAll(KyuubiDriverSuite.scala:25)
	at org.scalatest.BeforeAndAfterAll.liftedTree1$1(BeforeAndAfterAll.scala:212)
	at org.scalatest.BeforeAndAfterAll.run(BeforeAndAfterAll.scala:210)
	at org.scalatest.BeforeAndAfterAll.run$(BeforeAndAfterAll.scala:208)
	at org.apache.kyuubi.jdbc.KyuubiDriverSuite.run(KyuubiDriverSuite.scala:25)
	at org.scalatest.tools.SuiteRunner.run(SuiteRunner.scala:45)
	at org.scalatest.tools.Runner$.$anonfun$doRunRunRunDaDoRunRun$13(Runner.scala:1322)
	at org.scalatest.tools.Runner$.$anonfun$doRunRunRunDaDoRunRun$13$adapted(Runner.scala:1316)
	at scala.collection.immutable.List.foreach(List.scala:431)
	at org.scalatest.tools.Runner$.doRunRunRunDaDoRunRun(Runner.scala:1316)
	at org.scalatest.tools.Runner$.$anonfun$runOptionallyWithPassFailReporter$24(Runner.scala:993)
	at org.scalatest.tools.Runner$.$anonfun$runOptionallyWithPassFailReporter$24$adapted(Runner.scala:971)
	at org.scalatest.tools.Runner$.withClassLoaderAndDispatchReporter(Runner.scala:1482)
	at org.scalatest.tools.Runner$.runOptionallyWithPassFailReporter(Runner.scala:971)
	at org.scalatest.tools.Runner$.run(Runner.scala:798)
	at org.scalatest.tools.Runner.run(Runner.scala)
	at org.jetbrains.plugins.scala.testingSupport.scalaTest.ScalaTestRunner.runScalaTest2(ScalaTestRunner.java:133)
	at org.jetbrains.plugins.scala.testingSupport.scalaTest.ScalaTestRunner.main(ScalaTestRunner.java:27)
Caused by: java.lang.ExceptionInInitializerError
	at org.apache.kyuubi.package$.<init>(package.scala:51)
	at org.apache.kyuubi.package$.<clinit>(package.scala)
	at org.apache.kyuubi.service.authentication.PlainSASLServer$.<init>(PlainSASLServer.scala:130)
	at org.apache.kyuubi.service.authentication.PlainSASLServer$.<clinit>(PlainSASLServer.scala)
	at org.apache.kyuubi.service.authentication.PlainSASLServer$SaslPlainProvider.<init>(PlainSASLServer.scala:135)
	at org.apache.kyuubi.service.authentication.PlainSASLHelper$.<init>(PlainSASLHelper.scala:36)
	at org.apache.kyuubi.service.authentication.PlainSASLHelper$.<clinit>(PlainSASLHelper.scala)
	at org.apache.kyuubi.service.authentication.KyuubiAuthenticationFactory.getTTransportFactory(KyuubiAuthenticationFactory.scala:74)
	at org.apache.kyuubi.service.FrontendService.initialize(FrontendService.scala:74)
	... 32 more
Caused by: java.lang.NullPointerException
	at java.util.Properties$LineReader.readLine(Properties.java:434)
	at java.util.Properties.load0(Properties.java:353)
	at java.util.Properties.load(Properties.java:341)
	at org.apache.kyuubi.package$BuildInfo$.<init>(package.scala:33)
	at org.apache.kyuubi.package$BuildInfo$.<clinit>(package.scala)
	... 41 more

4.1 Log of the server
4.2 Log of the corresponding engine

looks like we need to add a check for the existence of kyuubi-version-info.properties which is need a maven plugin to generate.

looks like we need to add a check for the existence of kyuubi-version-info.properties which is need a maven plugin to generate.

Figured out I need to invoke mvn generate-sources in my local to generate this file. But failed to download the dependencies from the apache snapshot repository.

@yaooqinn IMO, we need to do some defensive check for this, and give more friendly guide for users especially for newbie. WDYT?

Yes, we and add an explicit null check in org.apache.kyuubi.package for it to give better error msg

looks like we need to add a check for the existence of kyuubi-version-info.properties which is need a maven plugin to generate.

Figured out I need to invoke mvn generate-sources in my local to generate this file. But failed to download the dependencies from the apache snapshot repository.

we have not set up maven repo yet, thanks for pointing this out

looks like we need to add a check for the existence of kyuubi-version-info.properties which is need a maven plugin to generate.

Figured out I need to invoke mvn generate-sources in my local to generate this file. But failed to download the dependencies from the apache snapshot repository.

sounds good. after you publish the snapshot version, please feel free to ping me.

Yes, we and add an explicit null check in org.apache.kyuubi.package for it to give better error msg

can you send a PR for this？

Yes, we and add an explicit null check in org.apache.kyuubi.package for it to give better error msg

can you send a PR for this？

sure, in addition, add more guide(invoke the mvn generate-sources command) for the setup/dev/quick-start documentation?

Ah, I see. I just realized that Kyuubi is not developer-friendly enough.
Maybe we can add something like http://spark.apache.org/developer-tools.html. And we can start with a section where contributors can learn how to set up and test in IDEs, or something.

Ah, I see. I just realized that Kyuubi is not developer-friendly enough.
Maybe we can add something like http://spark.apache.org/developer-tools.html. And we can start with a section where contributors can learn how to set up and test in IDEs, or something.

+1

Ah, I see. I just realized that Kyuubi is not developer-friendly enough.
Maybe we can add something like http://spark.apache.org/developer-tools.html. And we can start with a section where contributors can learn how to set up and test in IDEs, or something.

Let's create a new issue to track this idea and move the discussion under that? WDYT?

sgtm

Moved the further discussion to issue #829 , closing this...


Can't copy the response from UI (Visual Studio Code + Code Builder)

Can't copy the response from UI history previous responses.
Visual Studio Code

Code Builder

Hi abrantes23!  Thank you for this feedback. We will investigate and get back to you soon.

Hi @abrantes23!
If you highlight the prompt while the row is expanded it will collapse, but if you copy at that point you'll get the entire prompt.  Thanks for the feedback.  We've discussed having some copy buttons in there.  We'll see if we can make it more user friendly.

Internal WI created for this issue: W-14141880.

We've got a fix open to address the issue where the row is collapsing, so highlighting to copy + paste will soon be much easier!
On further exploration, the root cause of the copy not working is due to this VS Code bug: https://github.com/microsoft/vscode/issues/141080. The workaround for now is to highlight the text you want to work with and from there you may use the context menu or ctrl+c.


Better result for VQA

Would you mind share some tricks to get ~0.4 improvements (80.04 vs 80.45) using current codebase on VQA? Probably not due to Shuffle the Training Data.

Hi Yixuan, if the GPU memory enables, you can try to increase the image resolution (modify --patch-image-size to a larger value). However, the amount of computation and training step-time will also be significantly increased. The benefit of shuffling is already included in obtaining the result of 80.04. More improvement may be related to further pretraining, which you can try after the code of OFA pretraining is released (planned in this month). If you discover more new strategies during using OFA, we also strongly welcome you to share them with us :)


fix: update level_id in experiences table when levelled up

@7OMI I don't understand what this fixes? level_id is always updated when the User is levelled up.
Can you add a description to the PR that explains why this fix is needed? Provide examples of when the code fails.

@cjmellor
The level_id is only updated in the user table, not in the experiences table.
The getLevel() method retrieves the current level of the user from the experiences table.
The nextLevelAt() method returns 0 because it also retrieves the current level from the experiences table.
Q. Why is the user level stored in two places anyway?
users table:

id
...
level_id
...

3
...
▸2◂
...

experience_audits table:

id
user_id
points
levelled_up
level_to
type
reason
...

1
3
10
0
NULL
add
NULL
...

2
3
100
0
NULL
add
NULL
...

3
3
110
1
▸2◂
level_up
NULL
...

experiences table:

id
user_id
level_id
experience_points
...

1
3
▸1◂
110
...

What code are you running to get this data?
It looks like $user->addPoints(110)
Please let me know the steps you've taken so I can try to replicate.
Thanks.

What code are you running to get this data?
It looks like $user->addPoints(110)
Please let me know the steps you've taken so I can try to replicate.

If it is written out immediately after the point is given, it works:
$user = \App\Models\User::whereId(3)->first(); // or: auth()->user()
$user->addPoints(10);
$user->addPoints(100);
echo 'LEVEL: ' . $user->getLevel() . '
'; // Get: `LEVEL: 2`
echo 'NEXT LEVEL AT: ' . $user->nextLevelAt() . '
'; // Get: `NEXT LEVEL AT: 130`

If you don't add a point, but simply want to write out, it won't work:
$user = \App\Models\User::whereId(3)->first(); // or: auth()->user()
echo 'LEVEL: ' . $user->getLevel() . '
'; // Get: `LEVEL: 1`
echo 'NEXT LEVEL AT: ' . $user->nextLevelAt() . '
'; // Get: `NEXT LEVEL AT: 0`

Also list if you have any of the config settings different to the defaults.

Only one change has been made. This has been added to the .env:
AUDIT_POINTS=true

Additional information:
levels table:

id
level
next_level_experience
...

1
1
0
...

2
2
100
...

3
3
240
...

4
4
520
...

5
5
1080
...

6
6
2200
...

Package Version: 1.0.0
Laravel Version: 10.26.2
PHP Version: 8.2.8
Which operating systems does with happen with? Windows

@7OMI Thanks man for pointing this out!
I've changed the way it is fixed though to better suit the rest of the code. I also added another sanity test.


Move JSON Parsing to AST + JSONC

We currently parse JSON as text, and this has some issues with things like being able to add comments, as these are not valid for JSON either. We can move the processing to use JSONC, which will necessitate us to use an abstract syntax tree (AST) and should open up more options for better tracking of field usage and hand-rolling our own auto-completion that is more like VS Code/Vega Editor.
We will also need to ensure that comments will work in exported/imported templates (although templates with comments will not be importable in earlier versions and will need to be manually corrected if this needs to happen).

Some additional acceptance criteria we need to cover as part of this:

[ ] When we update the template handling logic, we must include the additional settings added in #394 (as it makes no sense to do them there, to re-do them here).
[ ] We currently merge the config from the editor and any config in the spec into a single config object at the top level. When a template is imported, this will get placed into the config editor, as it's now merged. With JSONC, we don't have the luxury of being able to do this as easily as we could for plain JSON objects. As such, we should preserve the config editor metadata within the usermeta portion of the template so that both sets of content are as originally entered by the author. We will consider a more future-proof approach for the v2 template design.

This has been delivered to the alpha channel in its initial form. Given the size of the PR, we will create and track anything to do as new issues (or reopen this if absolutely necessary).


fix typos in workbench/api

This PR fixes typos in the workbrench/api feature area.

Note: Hope that it's not in multiple feature areas 😄

Thanks for the effort here but aren't expecting pull request like this. See https://github.com/microsoft/vscode/wiki/How-to-Contribute#spell-check-errors and the following

Pull requests only fixing spell check errors in source code are not recommended.


[Feature] Create an example doc for Modin

Search before asking

[X] I had searched in the issues and found no similar feature requirement.

Description
https://ray-distributed.slack.com/archives/C02GFQ82JPM/p1718067374071799?thread_ts=1717741098.825609&cid=C02GFQ82JPM
Use case
No response
Related issues
No response
Are you willing to submit a PR?

[ ] Yes I am willing to submit a PR!

@kevin85421 I would like to work on this issue. Thanks.


http://orionjs-foundation.rwatts.meteor.com/admin is down

There is no site deployed at this address.

Thank you,
I believe it was removed. I will deploy a new updated example site. Later this week.


Official Issue Template

Here is the official issue template for submitting an issue about the bot. Make sure to do your research and see if your issue has been resolved. If you do not use this format your issue will be closed immediately without question. Here is the issue template:
Description of Bug:
Log (If Any):
This may be updated so check when you are making a new bug report. Thanks!

CodeError

Reopened so people can view.

CodeError


Refuse to translate if set1 is longer than set2 and set2 ends in a character class

I think we should fall in line with GNU behaviour here.
If you really think you need to do this:
tr [:lower:]123 [:upper:]

you can already do this:
tr [:lower:]123 [:upper:]Z

which does the same thing and is more explicit about which character is repeated to fill set2.
(Although generally, I think that if you are at that point you are already using the wrong tool).
However, I do not have strong opinions on this and would happily implement this the other way  if someone is clearly in favour of  that.

Thanks!