UWP - NAudio dont works with Native tool chain

Visual studio 2017, NAudio 1.8.3 for UWP. When enabled Native tool chain and started the demo sample and clicked play:
Output log:
Exception thrown: 'System.PlatformNotSupportedException' in System.Private.Interop.dll
An exception of type 'System.PlatformNotSupportedException' occurred in System.Private.Interop.dll but was not handled in user code
Operation is not supported on this platform.
Callstack:
at System.Runtime.InteropServices.Marshal.GetExceptionForHR(Int32 errorCode, IntPtr errorInfo) in f:\dd\ndp\fxcore\CoreRT\src\System.Private.Interop\src\System\Runtime\InteropServices\Marshal.cs:line 613
at System.Runtime.InteropServices.Marshal.ThrowExceptionForHRInternal(Int32 errorCode, IntPtr errorInfo) in f:\dd\ndp\fxcore\CoreRT\src\System.Private.Interop\src\System\Runtime\InteropServices\Marshal.cs:line 643
at System.Runtime.InteropServices.Marshal.ThrowExceptionForHR(Int32 errorCode) in f:\dd\ndp\fxcore\CoreRT\src\System.Private.Interop\src\System\Runtime\InteropServices\Marshal.cs:line 631
at NAudio.CoreAudioApi.AudioClient.Initialize(AudioClientShareMode shareMode, AudioClientStreamFlags streamFlags, Int64 bufferDuration, Int64 periodicity, WaveFormat waveFormat, Guid audioSessionGuid) in C:\Repositories\Zquence Studio 2016\Zquence Studio 3\Vendors\Win10\NAudio-master\NAudio\CoreAudioApi\AudioClient.cs:line 65
at NAudio.Win8.Wave.WaveOutputs.WasapiOutRT.Init() in C:\Repositories\Zquence Studio 2016\Zquence Studio 3\Vendors\Win10\NAudio-master\NAudio.Win8\Wave\WaveOutputs\WasapiOutRT.cs:line 413
at NAudio.Win8.Wave.WaveOutputs.WasapiOutRT.d__25.MoveNext() in C:\Repositories\Zquence Studio 2016\Zquence Studio 3\Vendors\Win10\NAudio-master\NAudio.Win8\Wave\WaveOutputs\WasapiOutRT.cs:line 143

Yes, this is a known issue. I'm afraid I haven't been actively working on any NAudio on UWP projects in recent years so no progress has been made on this front.

@markheath Any hint on how we should approach this? My experience with the .NET native and Win32 API's is limited but I would like to give it a try.


Plugin not working

Hello, Gerke Max Preussner.
I compiled UE source with your plugin.
After that I disabled WMF plugin in my project settings:
http://www.quirksmode.org/html5/videos/big_buck_bunny.mp4

and I keep enabled your VLC plugin:

After that I set up MediaPlayer:

After that when I press Play button - "Stopped" flashed and nothing happened.
It still not working? :)

I found interesting things right now...
I've modified some files:
Vlc.cpp:
#define VLC_IMPORT(Name, Func) \
	Func = (FLibvlc##Func##Proc)FPlatformProcess::GetDllExport(LibHandle, TEXT(#Name)); \
	UE_LOG(LogVlcMedia, Warning, TEXT("VLC: LOADING VLC function %s"), TEXT(#Name)); \
	if (Func == nullptr) \
	{ \
		UE_LOG(LogVlcMedia, Warning, TEXT("Failed to import VLC function %s"), TEXT(#Name)); \
		Shutdown(); \
		return false; \
	}

It got to me text, that illustrated, that functions load was successful:
LogVlcMedia:Warning: VLC: LOADING VLC function libvlc_new
LogVlcMedia:Warning: VLC: LOADING VLC function libvlc_release
LogVlcMedia:Warning: VLC: LOADING VLC function libvlc_retain
LogVlcMedia:Warning: VLC: LOADING VLC function libvlc_errmsg
LogVlcMedia:Warning: VLC: LOADING VLC function libvlc_clearerr
LogVlcMedia:Warning: VLC: LOADING VLC function libvlc_event_attach
LogVlcMedia:Warning: VLC: LOADING VLC function libvlc_event_detach
LogVlcMedia:Warning: VLC: LOADING VLC function libvlc_event_type_name
LogVlcMedia:Warning: VLC: LOADING VLC function libvlc_media_event_manager
LogVlcMedia:Warning: VLC: LOADING VLC function libvlc_media_new_callbacks
LogVlcMedia:Warning: VLC: LOADING VLC function libvlc_media_new_location
LogVlcMedia:Warning: VLC: LOADING VLC function libvlc_media_new_path
LogVlcMedia:Warning: VLC: LOADING VLC function libvlc_media_parse_async
LogVlcMedia:Warning: VLC: LOADING VLC function libvlc_media_release
LogVlcMedia:Warning: VLC: LOADING VLC function libvlc_media_retain
LogVlcMedia:Warning: VLC: LOADING VLC function libvlc_media_tracks_get
LogVlcMedia:Warning: VLC: LOADING VLC function libvlc_media_tracks_release
LogVlcMedia:Warning: VLC: LOADING VLC function libvlc_media_player_event_manager
LogVlcMedia:Warning: VLC: LOADING VLC function libvlc_media_player_get_media
LogVlcMedia:Warning: VLC: LOADING VLC function libvlc_media_player_new
LogVlcMedia:Warning: VLC: LOADING VLC function libvlc_media_player_new_from_media
LogVlcMedia:Warning: VLC: LOADING VLC function libvlc_media_player_release
LogVlcMedia:Warning: VLC: LOADING VLC function libvlc_media_player_retain
LogVlcMedia:Warning: VLC: LOADING VLC function libvlc_media_player_set_media
LogVlcMedia:Warning: VLC: LOADING VLC function libvlc_media_player_get_fps
LogVlcMedia:Warning: VLC: LOADING VLC function libvlc_media_player_get_length
LogVlcMedia:Warning: VLC: LOADING VLC function libvlc_media_player_get_position
LogVlcMedia:Warning: VLC: LOADING VLC function libvlc_media_player_get_rate
LogVlcMedia:Warning: VLC: LOADING VLC function libvlc_media_player_get_state
LogVlcMedia:Warning: VLC: LOADING VLC function libvlc_media_player_get_time
LogVlcMedia:Warning: VLC: LOADING VLC function libvlc_media_player_is_seekable
LogVlcMedia:Warning: VLC: LOADING VLC function libvlc_media_player_set_position
LogVlcMedia:Warning: VLC: LOADING VLC function libvlc_media_player_set_rate
LogVlcMedia:Warning: VLC: LOADING VLC function libvlc_media_player_set_time
LogVlcMedia:Warning: VLC: LOADING VLC function libvlc_media_player_is_playing
LogVlcMedia:Warning: VLC: LOADING VLC function libvlc_media_player_pause
LogVlcMedia:Warning: VLC: LOADING VLC function libvlc_media_player_play
LogVlcMedia:Warning: VLC: LOADING VLC function libvlc_media_player_set_pause
LogVlcMedia:Warning: VLC: LOADING VLC function libvlc_media_player_stop
LogVlcMedia:Warning: VLC: LOADING VLC function libvlc_media_player_will_play
LogVlcMedia:Warning: VLC: LOADING VLC function libvlc_audio_get_track
LogVlcMedia:Warning: VLC: LOADING VLC function libvlc_audio_set_track
LogVlcMedia:Warning: VLC: LOADING VLC function libvlc_video_get_height
LogVlcMedia:Warning: VLC: LOADING VLC function libvlc_video_get_width
LogVlcMedia:Warning: VLC: LOADING VLC function libvlc_video_set_callbacks
LogVlcMedia:Warning: VLC: LOADING VLC function libvlc_video_set_format
LogVlcMedia:Warning: VLC: LOADING VLC function libvlc_video_get_spu
LogVlcMedia:Warning: VLC: LOADING VLC function libvlc_video_set_spu
LogVlcMedia:Warning: VLC: LOADING VLC function libvlc_video_get_track
LogVlcMedia:Warning: VLC: LOADING VLC function libvlc_video_set_track
LogVlcMedia:Warning: VLC: LOADING VLC function libvlc_audio_get_track_description
LogVlcMedia:Warning: VLC: LOADING VLC function libvlc_video_get_spu_description
LogVlcMedia:Warning: VLC: LOADING VLC function libvlc_video_get_track_description
LogVlcMedia:Warning: VLC: LOADING VLC function libvlc_track_description_release

After that, I modified file VlcMediaPlayer.cpp:
bool FVlcMediaPlayer::Open(const FString& Url)
{
	UE_LOG(LogVlcMedia, Warning, TEXT("VLC: FVlcMediaPlayer::Open %s"), *Url);

	if (Url.IsEmpty())
	{

		UE_LOG(LogVlcMedia, Warning, TEXT("VLC: FVlcMediaPlayer:: (Url.IsEmpty() "));
		return false;
	}

	Close();

	UE_LOG(LogVlcMedia, Warning, TEXT("VLC: FVlcMediaPlayer:: After Close(); "));

	FLibvlcMedia* NewMedia = nullptr;
		if (Url.Contains(TEXT("://"))) {
			UE_LOG(LogVlcMedia, Warning, TEXT("VLC: FVlcMediaPlayer:: NewMedia IS URL "));
			NewMedia = FVlc::MediaNewLocation(VlcInstance, TCHAR_TO_ANSI(*Url));
		}
		else {
			UE_LOG(LogVlcMedia, Warning, TEXT("VLC: FVlcMediaPlayer:: NewMedia IS FILE SYSTEM"));
			NewMedia = FVlc::MediaNewPath(VlcInstance, TCHAR_TO_ANSI(*Url));
		}

	if (NewMedia == nullptr)
	{

		UE_LOG(LogVlcMedia, Warning, TEXT("VLC: FVlcMediaPlayer:: NewMedia == nullptr "));
		return false;
	}

	MediaUrl = Url;

	return InitializeMediaPlayer(NewMedia);
}

and I found. that
NewMedia = FVlc::MediaNewPath(VlcInstance, TCHAR_TO_ANSI(*Url));

always returns nullptr:
LogVlcMedia:Warning: VLC:  ___ M:/Downloads/Мультфильмы/Simpsons 03/03_01 - Stark Raving Dad.avi ____
LogVlcMedia:Warning: VLC: Extension - avi
LogVlcMedia:Warning: VLC: FVlcMediaPlayer::Open M:/Downloads/Мультфильмы/Simpsons 03/03_01 - Stark Raving Dad.avi
LogVlcMedia:Warning: VLC: FVlcMediaPlayer:: After Close();
LogVlcMedia:Warning: VLC: FVlcMediaPlayer:: NewMedia IS FILE SYSTEM
LogVlcMedia:Warning: VLC: FVlcMediaPlayer:: NewMedia == nullptr

LogVlcMedia:Warning: VLC:  ___ M:/Downloads/Мультфильмы/American.Dad.S01.HQ-DVDRip.x264.MIF/American.Dad.1x03.Stan.Knows.Best.DVDRip.x264.MIF.mkv ____
LogVlcMedia:Warning: VLC: Extension - mkv
LogVlcMedia:Warning: VLC: FVlcMediaPlayer::Open M:/Downloads/Мультфильмы/American.Dad.S01.HQ-DVDRip.x264.MIF/American.Dad.1x03.Stan.Knows.Best.DVDRip.x264.MIF.mkv
LogVlcMedia:Warning: VLC: FVlcMediaPlayer:: After Close();
LogVlcMedia:Warning: VLC: FVlcMediaPlayer:: NewMedia IS FILE SYSTEM
LogVlcMedia:Warning: VLC: FVlcMediaPlayer:: NewMedia == nullptr

How to fix it?

I can repro the problem. Something broke. I'm looking into it now.

So, the problem is our normalized file names. LibVLC will choke on a path with forward slashes if running on Windows. Something like the following almost works.
	FLibvlcMedia* NewMedia = (Url.Contains(TEXT("://"))) 		? FVlc::MediaNewLocation(VlcInstance, TCHAR_TO_ANSI(*Url)) #if PLATFORM_WINDOWS 		: FVlc::MediaNewPath(VlcInstance, TCHAR_TO_ANSI(*Url.Replace(TEXT("/"), TEXT("\\")))); #else 		: FVlc::MediaNewPath(VlcInstance, TCHAR_TO_ANSI(*Url)); #endif
However, there are other problems. I need to rethink how we handle media files in all of the plug-ins, because we cannot allow the third-party libraries to open files like we do right now. Media files may be deployed inside a .pak file where they are inaccessible to third-party libs. We have to pipe all file I/O through the platform file API in UE4 instead.
This will be part of a larger refactor. I'll try to look into it over the weekend.

I checked in some more changes to refactor the plug-ins handling of local media files. The files are loaded via UE4's platform file code and streamed into VLC via its media callback API. Unfortunately, this is not working as expected. I started a post on the VideoLAN forums: https://forum.videolan.org/viewtopic.php?f=32&t=126980
If you sync VlcMedia to head, make sure you also get https://github.com/EpicGames/UnrealEngine/commit/dbfec7de7564b20168eb8d106f2d0669a038df20 from UE4 Master as I changed the IMediaPlayer API.

Wow!
I have always had respect for the programmers so cool as you. Unfortunately, I still not so steep as you. )))
As I see, https://forum.videolan.org/viewtopic.php?f=32&t=126980 has answer from someone...

Ok, I found the problem. Working on a fix now!

Hi...
There are some problem in UE 4 master repo - https://github.com/EpicGames/UnrealEngine/commit/a8c29eb9f1ee02ac2610ce7e04dc94a02a8e3d77
@mkuhlens Added
UMovieSceneTrack* ShotTrack = MovieScene->GetShotTrack();

I can't find MovieScene->GetShotTrack() anywhere...
Because of this I can't compile UE 4 from master...
Can you fix it?

Master should be fixed now.

Yep, I see
https://github.com/EpicGames/UnrealEngine/commit/d5e0c3ab27ed06af830502368fd24a027f268325

Alright, this should work better now. You will need to get another change from Master as well, which is not pushed to GitHub yet, but should be shortly.

https://github.com/EpicGames/UnrealEngine/commit/5e7a0d565aec65831ba54bbd9f0be669c543fef0

Thank you...
Please advice, is it possible to compile UE for Windows on Linux?
My client machine is weak and all my servers on Linux...

Hmm.... good question, I don't know. It's possible to compile Linux from Windows, but I don't think we have a cross-compile tool chain the other way around. Might wanna check on AnswerHub for that.

I asked it https://answers.unrealengine.com/questions/245490/is-it-possible-to-make-nightlybuilds-on-linux.html but still no answers... I knew about compiling for Linux on Windows... But I haven't servers on  Windows...

Ok, I will forward your question to our Linux guy.

And thanks for your help on this plug-in! If you find any more problems (I'm sure there are plenty), please open new issues.
One thing I noticed is that VLC seems to be automatically playing a video once after opening it. I will look into that next.

I would be very grateful to your team if I compile on Linux as a UE, and my game. May be something like command line script, like Setup.sh with some option like "--compile-for-windows" and build tools for game packaging for Windows on Linux hosts...
It would be so cool to build nightly builds of games or UE editor on Linux servers to not waste client's machine's time and to not waste money for Windows licences...

It's worked!
You are great!
But it crashed once.
https://answers.unrealengine.com/storage/attachments/48162-logs.zip

Can you create a new issue and provide repro steps? If you could share the video file in question, that would be great, too. Looking at the log, it seems that VLC is throwing a bunch of errors, but without further instructions I can't do much right now. Thanks!


update pathinfo when changing uri via Request.copy

https://github.com/http4s/http4s/issues/1183
What would you guys think about changing the lazy vals of scriptName + pathInfo to functions like this:
val caret = attributes.get(Request.Keys.PathInfoCaret).getOrElse(0)

def scriptName = {
  uri.path.splitAt(caret)._1
}

def pathInfo = {
  uri.path.splitAt(caret)._2
}

That way we wouldn't need to overwrite the copy method and we could avoid the boilerplate

failed, but I don't think this is related to pathInfo... @rossabaker ?
01:06:32.659 [specs2.fixed.env1722864111-4] ERROR org.http4s.blaze.pipeline.Stage - Error running route: Request(method=GET, uri=/bar, headers=Headers(Transfer-Encoding: chunked))
java.lang.IllegalStateException: Attempted to collect trailers before the body was complete.
	at org.http4s.server.blaze.Http1ServerParser$$anonfun$1.apply(Http1ServerParser.scala:43)
	at org.http4s.server.blaze.Http1ServerParser$$anonfun$1.apply(Http1ServerParser.scala:42)
	at fs2.Task$$anonfun$suspend$1$$anonfun$2.apply(Task.scala:199)
[info] ClientTimeoutSpec
[info]
[info] Http1ClientStage responses should
[info]   + Timeout immediately with an idle timeout of 0 seconds (11 seconds, 856 ms)
[info]   + Timeout immediately with a request timeout of 0 seconds (11 seconds, 191 ms)
[info]   + Idle timeout on slow response (11 seconds, 101 ms)
[error]   x Request timeout on slow response (20 seconds, 352 ms)

wait - i think this is totally unnecessary. pathInfo is a lazy val, and the automatically derived version of copy calls new internally, so the "newed" version is going to reinstantiate pathInfo with the new uri value. I'm running the test cases, and the new pathInfo is reflected whether or not I have a custom copy.
If we want, we can still merge this in for the tests, or create a separate PR

I think it works because your test case has an empty script name and no path info.  Create a request where the URI is split (i.e., the caret attribute is > 0), change the URI, and I think the problem becomes apparent.

I updated with a test for the caret, but it still passes - I'll test more a little later

ah ok - i understand. I added a delete (--) method to AttributeMap, and in Request.copy if the uri changed, I delete PathInfoCaret from the AttributeMap
The problem with that is what happens when someone does req.copy(uri = someOtherUri, attributes = req.attributes ++ Seq(AttributeEntry(Request.Keys.PathInfoCaret, someCaret))) expecting to also set a new caret, but the new caret is still going to be deleted.
I could do a check to see if the caret is the same as before, and only delete then, but it's also possible that someone could provide a new uri along with a new caret that just so happens to be the same as the old caret
Maybe check for reference quality or compare against the hash on the caret? I'd have to look into those more

Ooh, that's a really interesting point on providing an explicit caret.  In practice, I find it hard to imagine that many people are explicitly setting it that way, but it would be very surprising behavior.  Reference equality makes it seem even more likely to cause unexpected behavior.  We also break request.withPathInfo with this, which is implemented in terms of copy.  This is much more complicated that I expected it to be.
What if Request were a sealed abstract case class and attributes moved to a second parameter list, where they don't affect equality?
sealed abstract case class Request(    method: Method = Method.GET,    uri: Uri = Uri(path = "/"),    httpVersion: HttpVersion = HttpVersion.HTTP/1.1,    headers: Headers = Headers.empty,    body: EntityBody = EmptyBody)(    attributes: AttributeMap = AttributeMap.empty )
We'd have to provide our own apply and copy in the Request constructor.  But this corner case would go away.  It's a little weird, but I think we're going to have problems as long as the caret that we're clearing is part of the main parameter list.

I'm not familiar with multi-paremeter lists in case classes - how would that help (equality)?
If we go that route we'll have to change the Message trait to not include attributes, because Request complains about not implementing attributes when you move it to a second parameter list.
The main problem is that we have two pieces of state (Path and Attributes) that need to be in sync, but their not bound together in any way.
We could avoid the boilerplate of rewriting copy and apply if instead we unite the path + caret data by changing the path field in Uri from a Path / String to a
type Caret = Int

case class PathData(path: (Path, Caret)) {
  lazy val (scriptName, pathInfo) = {
    path._1.splitAt(path._2)
  }
}

That way Path and Caret are linked, and scriptName + pathInfo will always reflect the correct values. But we'd also have to change a bunch of things to be something like path.path._1 or provide an implicit for PathData => String

Moving this into a structure is good for enforcing consistency.  It means that the same string split at a different point results in unequal Uri, which is surprising in the context of RFC 3986 Section 6.  We could solve that by overriding equals, which is a surprising thing to do on a case class.  We could also ignore the caret in just the Equal[Uri] instance, which is a surprising when that instance is inconsistent with equals.
I experimented with moving org.http4s.dsl.Path into Uri as the path, and turned Root into a case class with the script name.  It works, but it changes every Root to Root(_) in every DSL match.  That's a really, really big breaking change.
This concept of scriptName and pathInfo is only useful in request routing, so it would be great to banish it further to the edges.  I haven't thought of a good way to mark what part of the path has been consumed without storing it on the request (or its URI).
I have only unsatisfying ideas so far. :(

The trouble begins with the copy method. What if we just suppressed it and provided withMethod, withUri, etc.?  Then in withUri, we zero the caret. Everything else leaves it alone.

so we could make it a sealed abstract case class to suppress copy, then provide each of the with... methods to return a new Request with the updated value? I could get started on that

@sportanova Yes, that's the only solution I can think of.  We can't fix the copy method, so we take it away.  (We could be nice and provide it and deprecate it.)  When the Request becomes sealed abstract, then an apply method on the companion will also need to be written.

@rossabaker I deprecated the copy method, but now I can't run the tests (error on deprecated method). I've tried adding -deprecated to the scalacoptions in build.sbt, but no luck. Any ideas?

Rename copy and make it private and undeprecated.  That way, we can call it safely in all those functions like withMethod.
Change all the references to copy to your renamed, private copy.  This will get rid of the deprecation errors.
Restore a deprecated copy that just calls your renamed, private copy.  This will help people migrate code.

Sounds good, just updated


provide support for granule wildcard patterns in data downloader

Shailen expressed a need for this capability in SWOTCalVal (indirectly, this seems like the most straightforward way to support selective downloading w/o a dedicated UMM field to query on).
I added 2 lines to the subscriber/podaac_data_downloader.py script to allow for CMR wildcard functionality to be supported through the existing options. This adds the wildcard pattern option to request parameters whenever the user gives a granuleur containing '*' or '?':
        #jmcnelis, 2023/06/14 - provide for wildcards in granuleur-based search
        if '*' or '?' in cmr_granule:
            params.append(('options[GranuleUR][pattern]', 'true'))

This supports Shailen's use case where he wants to selectively download granules by campaign (SWOTCalVal). Here are the invocations for two example cases --

Download both files from WM and TM campaigns, based on prior knowledge of the filename convention:

$ python subscriber/podaac_data_downloader.py -c SWOTCalVal_GNSS_L2_1.0 -gr 'SWOTCalVal_??_GNSS_L2_*' -d ./data/
[2023-06-14 14:12:12,727] {podaac_data_downloader.py:270} INFO - Found 2 total files to download
[2023-06-14 14:12:19,628] {podaac_data_downloader.py:313} INFO - 2023-06-14 14:12:19.628547 SUCCESS: https://archive.swot.podaac.earthdata.nasa.gov/podaac-swot-ops-cumulus-protected/SWOTCalVal_GNSS_L2_1.0/SWOTCalVal_T2_GNSS_L2_Rec11_20230201T221500_20230201T232230_20230227T220903.nc
[2023-06-14 14:12:21,952] {podaac_data_downloader.py:313} INFO - 2023-06-14 14:12:21.952641 SUCCESS: https://archive.swot.podaac.earthdata.nasa.gov/podaac-swot-ops-cumulus-protected/SWOTCalVal_GNSS_L2_1.0/SWOTCalVal_WM_GNSS_L2_Rec2_20220729T222100_20220730T023300_20230227T211845.nc
[2023-06-14 14:12:21,952] {podaac_data_downloader.py:324} INFO - Downloaded Files: 2
[2023-06-14 14:12:21,952] {podaac_data_downloader.py:325} INFO - Failed Files:     0
[2023-06-14 14:12:21,952] {podaac_data_downloader.py:326} INFO - Skipped Files:    0
[2023-06-14 14:12:22,329] {podaac_data_downloader.py:334} INFO - END

Download one granule, from WM campaign, ...:

$ python subscriber/podaac_data_downloader.py -c SWOTCalVal_GNSS_L2_1.0 -gr 'SWOTCalVal_WM_GNSS_L2_*' -d ./data/
[2023-06-14 14:12:29,910] {podaac_data_downloader.py:270} INFO - Found 1 total files to download
[2023-06-14 14:12:35,532] {podaac_data_downloader.py:313} INFO - 2023-06-14 14:12:35.532384 SUCCESS: https://archive.swot.podaac.earthdata.nasa.gov/podaac-swot-ops-cumulus-protected/SWOTCalVal_GNSS_L2_1.0/SWOTCalVal_WM_GNSS_L2_Rec2_20220729T222100_20220730T023300_20230227T211845.nc
[2023-06-14 14:12:35,532] {podaac_data_downloader.py:324} INFO - Downloaded Files: 1
[2023-06-14 14:12:35,532] {podaac_data_downloader.py:325} INFO - Failed Files:     0
[2023-06-14 14:12:35,532] {podaac_data_downloader.py:326} INFO - Skipped Files:    0
[2023-06-14 14:12:35,845] {podaac_data_downloader.py:334} INFO - END

This needs further testing by someone besides me.

Here's some evidence that these updates still have the expected outcome after fixes caught by @skorper:
(base) jmcnelis@MT-209219:main  [ ~/subscriber-feature-enhancements/data-subscriber ]
 02:12:35 $ python subscriber/podaac_data_downloader.py -c SWOTCalVal_GNSS_L2_1.0 -gr 'SWOTCalVal_??_GNSS_L2_*' -d ./data/
[2023-06-14 14:50:16,780] {podaac_data_downloader.py:270} INFO - Found 2 total files to download
[2023-06-14 14:50:23,706] {podaac_data_downloader.py:313} INFO - 2023-06-14 14:50:23.706562 SUCCESS: https://archive.swot.podaac.earthdata.nasa.gov/podaac-swot-ops-cumulus-protected/SWOTCalVal_GNSS_L2_1.0/SWOTCalVal_T2_GNSS_L2_Rec11_20230201T221500_20230201T232230_20230227T220903.nc
[2023-06-14 14:50:25,960] {podaac_data_downloader.py:313} INFO - 2023-06-14 14:50:25.960080 SUCCESS: https://archive.swot.podaac.earthdata.nasa.gov/podaac-swot-ops-cumulus-protected/SWOTCalVal_GNSS_L2_1.0/SWOTCalVal_WM_GNSS_L2_Rec2_20220729T222100_20220730T023300_20230227T211845.nc
[2023-06-14 14:50:25,960] {podaac_data_downloader.py:324} INFO - Downloaded Files: 2
[2023-06-14 14:50:25,960] {podaac_data_downloader.py:325} INFO - Failed Files:     0
[2023-06-14 14:50:25,960] {podaac_data_downloader.py:326} INFO - Skipped Files:    0
[2023-06-14 14:50:26,310] {podaac_data_downloader.py:334} INFO - END

(base) jmcnelis@MT-209219:main  [ ~/subscriber-feature-enhancements/data-subscriber ]
 02:50:26 $ python subscriber/podaac_data_downloader.py -c SWOTCalVal_GNSS_L2_1.0 -gr 'SWOTCalVal_WM_GNSS_L2_*' -d ./data
/
[2023-06-14 14:50:37,917] {podaac_data_downloader.py:270} INFO - Found 1 total files to download
[2023-06-14 14:50:43,467] {podaac_data_downloader.py:313} INFO - 2023-06-14 14:50:43.467900 SUCCESS: https://archive.swot.podaac.earthdata.nasa.gov/podaac-swot-ops-cumulus-protected/SWOTCalVal_GNSS_L2_1.0/SWOTCalVal_WM_GNSS_L2_Rec2_20220729T222100_20220730T023300_20230227T211845.nc
[2023-06-14 14:50:43,468] {podaac_data_downloader.py:324} INFO - Downloaded Files: 1
[2023-06-14 14:50:43,468] {podaac_data_downloader.py:325} INFO - Failed Files:     0
[2023-06-14 14:50:43,468] {podaac_data_downloader.py:326} INFO - Skipped Files:    0
[2023-06-14 14:50:43,806] {podaac_data_downloader.py:334} INFO - END

@jjmcnelis A few more things..

Can you please change this PR to point to develop instead of main? new features go into develop, then are eventually merged to main when we release
Can you add a line in the changelog? Create a new [unreleased] section
Can you add something in the downloader readme about this new feature?

@jjmcnelis A few more things..
* Can you please change this PR to point to `develop` instead of `main`? new features go into `develop`, then are eventually merged to main when we release

* Can you add a line in the changelog? Create a new [unreleased] section

* Can you add something in the downloader readme about this new feature?

Thanks for your patience, @skorper. I'm out of my element..
I made edits to each of CHANGELOG.md, Downloader.md, and to the help text for the -gr option inside podaac_data_downloader.py to expand on its use with wildcard patterns. The Downloader.md links CMR Search API docs describing this wildcard search feature, which functions in exactly the same way thru our tool as it does for the REST API parameters (many more of which are supported than just Granule UR, but this one is the most useful to expose to users thru downloader tool IMO). Let me know if these updates don't meet our standards and I'll take another shot at it right away, thanks again

Thank you @jjmcnelis ! The last thing would be to resolve merge conflicts, then I will approve 🙂


Migrate RSC to github.com/surveilr/www.surveilr.com/lib

Migrate github.com/opsfolio/resource-surveillance-commons (RSC) to github.com/surveilr/www.surveilr.com/lib where
Patterns as surveilr products can be deployed and delivered dynamically.

[ ] Add deno to Astro build for src/pages/pattern/[name]/package.sql.js dependency.

[ ] Convert package.sql.js to type-safe package.sql.ts

[x] Migrate RSC/prime ➡ www.surveilr.com/lib/std
[x] Migrate RSC/pattern ➡www.surveilr.com/lib/pattern
[x] Migrate RSC/pattern/digital-health ➡www.surveilr.com/lib/pattern/fhir-explorer
[x] Migrate RSC/pattern/osquery ➡www.surveilr.com/lib/pattern/osquery
[x] Migrate RSC/service ➡www.surveilr.com/lib/service

Example utilization:
$ surveilr shell https://surveilr.com/pattern/fhir-explorer/package.sql

package.sql in www.surveilr.com can be a proxy or aggregator of SQL from any sources (e.g. RSC).

@rinshadka @resulraveendran we need to make sure deno is now installed as part of the Astro Build process. Astro still uses NodeJS as usual but the src/pages/pattern/[name]/package.sql.js endpoint requires deno so SQLa can build package.sql files.

deno latest version added to this workflow

started the migration process for RSC/service/diabetes-research-hub ➡www.surveilr.com/lib/service/diabetes-research-hub

Started the migration of  direct-messaging-service from RSC to www.surveilr.com/lib/patterns/direct-messaging-service

Migrated the direct messaging service pattern to www.surveilr.com

The following patterns from github.com/opsfolio/resource-surveillance-commons have been successfully migrated to github.com/surveilr/www.surveilr.com/lib:
RSC/pattern/info-assurance-controls ➡ www.surveilr.com/lib/pattern/info-assurance-controls
RSC/pattern/info-assurance-policies ➡ www.surveilr.com/lib/pattern/info-assurance-policies
RSC/pattern/info-assurance ➡ www.surveilr.com/lib/pattern/info-assurance
RSC/pattern/info-schema ➡ www.surveilr.com/lib/pattern/info-schema
RSC/pattern/infra-audit ➡ www.surveilr.com/lib/pattern/infra-audit

Migrated the RSC/service/diabetes-research-hub  to  www.surveilr.com/lib/service/diabetes-research-hub

@MeetAnithaVarghese please migrate the "private" pattern also from RSC to www.surveilr.com
cc @razakpm

@pradeepcdlm

migrated privacy pattern from RSC.
Testing pending


[Music]: Love And Add to Library error

Extension
https://raycast.com/fedevitaledev/music
Description
Command failed with exit code 1: osascript -e tell application "Music" to set loved of current track to true
28:62: execution error: “Music”遇到一个错误：描述符类型不匹配。 (-10001)
Steps To Reproduce

listen Apple Music
execute Love And Add to Library

Current Behaviour
No response
Expected Behaviour
No response

follow #8648

@raycastbot close this issue


reference-manual:: boards:: add apalis-imx6 flashing procedure

Signed-off-by: Vanessa Maegima<EMAIL_ADDRESS>

Docs for 1fee40ae773376816c76781a8f67021d58bb73bd are browesable at: https://ci.foundries.io/projects/fio-docs/builds/861/docs/artifacts/html/index.html

Docs for 28960c893731597f61d110370fbf24424fdb2d8a are browesable at: https://ci.foundries.io/projects/fio-docs/builds/865/docs/artifacts/html/index.html


Sampling making sense text

Hi,
I'm finding hard to create sentences which actually make sense, and more difficultly, paragraphs making sense as a whole. Most of the generated text looks non-sense to me. Has anyone cracked down this issue ? I'm feeling the key could be in having the right traning set.
Thanks

It's helpful to think of these RNNs as capturing the "flavor" of text rather than the meaning. Excellent output is nearly perfect in terms of spelling, grammar, and even style -- but there's no "there" there. Remember, the model is being trained to mimic the patterns whatever text it's given. It doesn't have anything to say, nor is it aware that text ever "says anything" at all.
It will require some significant advancements to the state of the art before we can generate text that coherently builds an argument, or a story, over many sentences and paragraphs.
In terms of getting the very best output within those constraints, though, I've found that things get really interesting and robust when you have 50MB+ of text. Which is a lot!

@robinsloan  BTW, what model/parameters did you use for 50MB of text?

@AlekzNet Hey there: the computer with all my RNN stuff on it is currently in a box, in transit, but I will look this up when it's unpacked!

@robinsloan  Thanks! Looking forward!
@PauloOgraddy What is the seq_length set up to?

@AlekzNet I tend to fiddle with my params a lot, but here's a representative sample that produced good results for me:
batch_size 1024
seq_length 128
rnn_size 1024
dropout 0.25
num_layers 2
learning_rate 2e-3

For me, the one thing that never helped was increasing num_layers beyond 2.

So, you successfully used a NN with 13M parameters with 0.25 dropout for 50MB of text and you got reasonable output (e.g. logically consistent paragraphs)? Hmm... interesting... Do you remember what the training loss was?
I tried to use a 5M network (512x3 no dropout) for 17MB text, but I could not make the loss lower than 1.
Currently I'm training this net (24MB corpus):
batch_size 254  seq_length 400 rnn_size 760 dropout 0.1 num_layers 3 learning_rate 1e-3
I will try to use your model for the same data set.

@AlekzNet My loss tended to be ~1.1 for a wide variety of params, and also a wide variety of corpus sizes, from ~50MB to ~150MB. In fact, the only time it dropped below 1 was when I used a smaller corpus of around 20MB… and that model's generated text was, to me, quantitatively worse!
I think that's an important point: for me, loss is just a rough guide, and ultimately I judge models by their generated results. That's also why I tend to use a shorter seq_length: qualitatively (and intuitively) it seems to focus the RNN on spelling, grammar, style, and word choice, rather than inter-sentence structure, which (frankly) it won't ever be able to capture anyway -- at least not until the state of the art improves! (See my previous comment.)

I think that's an important point: for me, loss is just a rough guide, and ultimately I judge models by their generated results.
Agree. This is the reason why I do not use validation, I validate it by myself.  And I prefer to not lose the data that can be used for training.

That's also why I tend to use a shorter seq_length
My experiments with consequent texts (e.g. novels) showed that large windows (e.g. 2000) produce much better results. Currently I'm playing with dialogues, that usually have much less "consequent sense", so I use windows between 200 and 400. I calculated the distribution of the phrase length using Cornell dialogue movie database as an example:

So the window length of 400 should cover most.

Hi, I follow the instructions but why the train.lua gives me this error?
jcc@jcc:~/torch-rnn$ th train.lua -input_h5 my_data.h5 -input_json my_data.json
Running with CUDA on GPU 0
/home/jcc/torch/install/bin/luajit: bad argument #2 to '?' (end index out of bound at /home/jcc/torch/pkg/torch/generic/Tensor.c:992)
stack traceback:
[C]: at 0x7f91bfdef4d0
[C]: in function '__index'
./util/DataLoader.lua:35: in function '__init'
/home/jcc/torch/install/share/lua/5.1/torch/init.lua:91: in function </home/jcc/torch/install/share/lua/5.1/torch/init.lua:87>
[C]: in function 'DataLoader'
train.lua:76: in main chunk
[C]: in function 'dofile'
.../jcc/torch/install/lib/luarocks/rocks/trepl/scm-1/bin/th:150: in main chunk
[C]: at 0x00406670
Help ?

@AlekzNet, @robinsloan, @PauloOgraddy, hi! It's been quite some time since your last posts. And I would like to clarify.
You came to find the optimal settings for a large corpus of training (from 50MB) for English?
I now train RNN on 75МБ reviews about movies from IMDb on the default parameters. I would be interested to spend together an experiment to improve the readability of the final result. I could put the source files and the final checkpoint. And we could try together to achieve the best results, to identify optimal parameters.
What do you say? Would you be interested?
/cc @jcjohnson

Sure, good idea!
My last attempt was 39MB corpus and the following parameters:
GRU: 1000x3
dropout: 0.1
batchnorm
batch_size: 398
seq_length: 300
The final train loss was around 0.92. I do not do validation. The rest you can see here: https://github.com/AlekzNet/rnn-chatbot
My next plan is to use the reddit database (see https://github.com/pender/chatbot-rnn ).

Oh, yes, and every epoch I remove the first line or two from the beginning of the corpus, so the whole content slides across the seq_length windows.

I'm using ~127MB of chat logs and these settings seem to work for me:
Grid GRU, rnn_size=1696, wordvec_size=640, num_layers=4
dropout=0.2
learning_rate=0.0004
lr_decay_factor=0.75, lr_decay_every=2
seq_length=256, batch_size=128
seq_offset=1 (shifts training data by seq_length/2 every other epoch)
40 epochs total, I doubled seq_length and halved batch_size every 10 epochs.

Whoa... GridGRU 1696x4 = 139M parameters! It's bigger than your corpus!

It's only 65M parameters. I tried different settings, but this gave me the best results so far. Validation loss is around 1.0544.

With wordvec_size=1696 it will be 139M. As far as I remember, the original GridGRU implementation by guillitte required wordvec_size to be the same size as the model. But I see you've made a lot of changes. Interesting...

That's correct. The original GridGRU implementation didn't require it, at least when I started using it, it was just a suggestion. I implemented some new features in it and I'm working on some optimizations, but I didn't change its basic functionality.

Ah, OK, at least when I tried it I was getting errors for any wordvec_sizes less than the model size. Possibly I was doing something wrong... I will try your version - it's very interesting to compare.

Alright. I will try to push another performance improvement later today/tomorrow, but my GPU machine is down, so I won't be able to test it.

@AlekzNet @antihutka wow!
Your skill is very high! After your message I realized that what I'm trying to just configure the settings - it is fundamentally not true.
You could tell about the following things:

Why don't you change val_frac and test_frac in preprocessing?
How do you check the result? English is not my primary language. I find it difficult to understand whether the neural network gave the result. You use some checking in the dictionaries/errors/break into tokens, so as not to degradation after another attempt of learning?
You use Grid GRU/GRU networks "Question-answer"? I teach network just to produce high quality results on the source data, at the moment I have spars headers ~200k articles with the Wall Street Journal. And cleared the data from "non-English" characters and various other symbols. It might be interesting to try to train your network on such input data to produce "generation of plausible news headline." If Yes - tell me, I'll post the text file with headers.
Which articles would you recommend a beginner (me) to understand what parameters need to change in order to achieve the best result?
Do I need to added the least train loss and how does it affect the outcome?
Whether I will try to test Grid GRU/GRU to generate text, not thinking that it will be a "Question-answer"?

@AlekzNet @antihutka wow!
Your skill is very high! After your message I realized that what I'm trying to just configure the settings - it is fundamentally not true.
You could tell about the following things:

Why don't you change val_frac and test_frac in preprocessing?
How do you check the result? English is not my primary language. I find it difficult to understand whether the neural network gave the result. You use some checking in the dictionaries/errors/break into tokens, so as not to degradation after another attempt of learning?
You use Grid GRU/GRU networks "Question-answer"? I teach network just to produce high quality results on the source data, at the moment I have spars headers ~200k articles with the Wall Street Journal. And cleared the data from "non-English" characters and various other symbols. It might be interesting to try to train your network on such input data to produce "generation of plausible news headline." If Yes - tell me, I'll post the text file with headers.
Which articles would you recommend a beginner (me) to understand what parameters need to change in order to achieve the best result?
Do I need to added the least train loss and how does it affect the outcome?
Whether I will try to test Grid GRU/GRU to generate text, not thinking that it will be a "Question-answer"?

@AlekzNet @antihutka wow!
Your skill is very high! After your messages I realized that what I'm trying to just configure the settings - it is fundamentally not true.
You could tell about the following things:

Why don't you change val_frac and test_frac in preprocessing?
How do you check the result? English is not my primary language. I find it difficult to understand whether the neural network gave the result. You use some checking in the dictionaries/errors/break into tokens, so as not to degradation after another attempt of learning?
You use Grid GRU/GRU networks "Question-answer"? I teach network just to produce high quality results on the source data, at the moment I have parsed ~200k titles articles with the Wall Street Journal. And cleared the data from "non-English" characters and various other symbols. It might be interesting to try to train your network on such input data to produce "generation of plausible news titles". If Yes - tell me, I'll post the text file with this titles.
Which articles would you recommend a beginner (me) to understand what parameters need to change in order to achieve the best result?
Do I need to added the least train loss and how does it affect the outcome?
Whether I will try to test Grid GRU/GRU to generate text, not thinking that it will be a "Question-answer"?

// sorry to do that.. but I want to draw all to the problem how to choose the optimal parameters for training..
 After your messages I realized that what I'm trying to just configure the settings - it is fundamentally not true.
You could tell about the following things:

Why don't you change val_frac and test_frac in preprocessing?
How do you check the result? English is not my primary language. I find it difficult to understand whether the neural network gave the result. You use some checking in the dictionaries/errors/break into tokens, so as not to degradation after another attempt of learning?
You use Grid GRU/GRU networks "Question-answer"? I teach network just to produce high quality results on the source data, at the moment I have parsed ~200k titles articles with the Wall Street Journal. And cleared the data from "non-English" characters and various other symbols. It might be interesting to try to train your network on such input data to produce "generation of plausible news titles". If Yes - tell me, I'll post the text file with this titles.
Which articles would you recommend a beginner (me) to understand what parameters need to change in order to achieve the best result?
Do I need to added the least train loss and how does it affect the outcome?
Whether I will try to test Grid GRU/GRU to generate text, not thinking that it will be a "Question-answer"?

// sorry to do that.. but I want to draw all to the problem how to choose the optimal parameters for training..
@chubbymaggie @chunsj @cobuma @ColumbiaDVMM @complyue @crassrobot @crazydonkey200 @crazylyf @cutthroat @Darktex @datascibox @davidcelis @devinberg @dgcrouse @justinmrkva @Dorniwang @drakh @drzax @dusenberrymw @DylanAuty @egordienko @ein3108 @elbamos @eldarbabayev @elhomosiguiente @ericqh @Evgeny-B @fantine16 @feiyang-nottingham @feiyuhug @fejiso @feynmanliang @gcheron @gidariss @gjtjx @gokceneraslan @goliasz @gouxiayibu @gphuang @guillitte @gurusura @hal2001 @helennn @HeXingwei @higain @hitluobin @hjpwhu @hnkulkarni @hoangnguyen3892 @hojinyoo @hughperkins @i077 @iamalbert @iassael @ilovecv @imclab @ivanebel @ixtel @JackHopkins @JamesChuanggg @jameskyle @janniktock @jaydenso @jboys @jeiros @jhcmine @JianboTang @jillnotjack @JINGHSU @jithsjoy @jmrinaldi @joelself @jonathanlofgren @jpollack @jsaribeiro @JuliusKunze @jungikim @junhocho @justbuchanan @justinchiu @digideskio @JustinWenzhaoLi @JW-CHEN @jwyang @kalyanp @kdbanman @keepsimpler @ketranm @BinbinBian @KokeCacao @kylemcdonald @learningtitans @lijian8 @LiliMeng @liuyang1123 @LiyuanLucasLiu @llgeek @louissmit @LuZhenHuan @maraoz @masdude @mattbierner @mcr-ksh @miradel51 @mktal @ml-ai-nlp-ir @ml-lab @monolithpl @muhammadriz @mxer @MyOwnClone @nadavbh12 @nateGeorge @NFSCH4 @ngimel @nicolas-ivanov @nightbay @njordsir @Noah1989 @NorThanapon @notimesea @NoviaDroid @nslater @nunb @oaomly @obrianjunior @offbit @oldgil @omshanti @oneyanshi @opraveen @pankajmauryatimes @parety @parthraghav @patiencett @pbayer8 @Peratham @phecy @pierrebeauguitte @pombredanne @praneethbellamkonda @pranjaldaga @preethamsp @ps00k @psfoley @qinghuizhao @qinhongwei @qnix @Razied @reaction @recursiveMake @rillaha @rlabuguen @robinsloan @cgiogkarakis @evelynmitchell @jaronmoore @johndpope @kelu124 @mcwhittemore @OstrichProjects @panyang @ruotianluo @shawkinsl @softpunch @wanjinchang @wuntoguo @yulgolem @Rocknrenew @rohitrawat @root20 @rremani @rsarxiv @rtc-alex @ruguevara @ruizhaogit @rustch3n @SadeghMSalehi @SalemAmeen @sanket-patil @scatterbrain333 @Scitator @selvaggi @shaonaghosh @shaoxuan92 @sidec @skinscanner @smartynov @sohuren @solarbaby @solidaqua @soumith @lgazpio @spaceraccoon @spyatakov @squidszyd @ssokhey @stonedavid @sukiakiumo @SulemanKazi @sumotoy @sunilkgrao @teome @terrykong @thecerial @theclaymethod @TheodoreGalanos @thomwolf @tianlongwang @tinyloop @tisaconundrum2 @tmp6154 @seominlee @todn @tonyzhang1231 @Tr4c3d @tracy-Ming @scutzck033 @troubledjoe @tybxiaobao @UnforeseenOcean @urisavka @urish @vanpersie32 @vi @vode @vseledkin @vyraun @wantajob @wavelets @wenjianhugit @wjpjet @wltongxing @wrapperband @xcyan @xi-studio @XSell @xuyuwei @xwgeng @xxxxxxxx-dl @yanfenglee @yanxiaole @YerevaNN @yfliao @yongduek @ZhangXinNan @zhaowei8188127 @zhixinshu @zhmz90 @zhuth

Your skill is very high! After your messages I realized that what I'm trying to just configure the settings - it is fundamentally not true.
You could tell about the following things:

Why don't you change val_frac and test_frac in preprocessing?
How do you check the result? English is not my primary language. I find it difficult to understand whether the neural network gave the result. You use some checking in the dictionaries/errors/break into tokens, so as not to degradation after another attempt of learning?
You use Grid GRU/GRU networks "Question-answer"? I teach network just to produce high quality results on the source data, at the moment I have parsed ~200k titles articles with the Wall Street Journal. And cleared the data from "non-English" characters and various other symbols. It might be interesting to try to train your network on such input data to produce "generation of plausible news titles". If Yes - tell me, I'll post the text file with this titles.
Which articles would you recommend a beginner (me) to understand what parameters need to change in order to achieve the best result?
Do I need to added the least train loss and how does it affect the outcome?
Whether I will try to test Grid GRU/GRU to generate text, not thinking that it will be a "Question-answer"?

// sorry to do that.. but I want to draw all to the problem how to choose the optimal parameters for training..
@hughperkins @i077 @iamalbert @iassael @ilovecv @imclab @ivanebel @ixtel @JackHopkins @JamesChuanggg @jameskyle @janniktock @jaydenso @jboys @jeiros @jhcmine @JianboTang @jillnotjack @JINGHSU @jithsjoy @jmrinaldi @joelself @jonathanlofgren @jpollack @jsaribeiro @JuliusKunze @jungikim @junhocho @justbuchanan @justinchiu @digideskio @JustinWenzhaoLi @JW-CHEN @jwyang @kalyanp @kdbanman @keepsimpler @ketranm @BinbinBian @KokeCacao @kylemcdonald @learningtitans @lijian8 @LiliMeng @liuyang1123 @LiyuanLucasLiu @llgeek @louissmit @LuZhenHuan @maraoz @masdude @mattbierner @mcr-ksh @miradel51 @mktal @ml-ai-nlp-ir @ml-lab @monolithpl @muhammadriz @mxer @MyOwnClone @nadavbh12 @nateGeorge @NFSCH4 @ngimel @nicolas-ivanov @nightbay @njordsir @Noah1989 @NorThanapon @notimesea @NoviaDroid @nslater @nunb @oaomly @obrianjunior @offbit @oldgil @omshanti @oneyanshi @opraveen @pankajmauryatimes @parety @parthraghav @patiencett @pbayer8 @Peratham @phecy @pierrebeauguitte @pombredanne @praneethbellamkonda @pranjaldaga @preethamsp @ps00k @psfoley @qinghuizhao @qinhongwei @qnix @Razied @reaction @recursiveMake @rillaha @rlabuguen @robinsloan @cgiogkarakis @evelynmitchell @jaronmoore @johndpope @kelu124 @mcwhittemore @OstrichProjects @panyang @ruotianluo @shawkinsl @softpunch @wanjinchang @wuntoguo @yulgolem @Rocknrenew @rohitrawat @root20 @rremani @rsarxiv @rtc-alex @ruguevara @ruizhaogit @rustch3n @SadeghMSalehi @SalemAmeen @sanket-patil @scatterbrain333 @Scitator @selvaggi @shaonaghosh @shaoxuan92 @sidec @skinscanner @smartynov @sohuren @solarbaby @solidaqua @soumith @lgazpio @spaceraccoon @spyatakov @squidszyd @ssokhey @stonedavid @sukiakiumo @SulemanKazi @sumotoy @sunilkgrao @teome @terrykong @thecerial @theclaymethod @TheodoreGalanos @thomwolf @tianlongwang @tinyloop @tisaconundrum2 @tmp6154 @seominlee @todn @tonyzhang1231 @Tr4c3d @tracy-Ming @scutzck033 @troubledjoe @tybxiaobao @UnforeseenOcean @urisavka @urish @vanpersie32 @vi @vode @vseledkin @vyraun @wantajob @wavelets @wenjianhugit @wjpjet @wltongxing @wrapperband @xcyan @xi-studio @XSell @xuyuwei @xwgeng @xxxxxxxx-dl @yanfenglee @yanxiaole @YerevaNN @yfliao @yongduek @ZhangXinNan @zhaowei8188127 @zhixinshu @zhmz90 @zhuth

Your skill is very high! After your messages I realized that what I'm trying to just configure the settings - it is fundamentally not true.
You could tell about the following things:

Why don't you change val_frac and test_frac in preprocessing?
How do you check the result? English is not my primary language. I find it difficult to understand whether the neural network gave the result. You use some checking in the dictionaries/errors/break into tokens, so as not to degradation after another attempt of learning?
You use Grid GRU/GRU networks "Question-answer"? I teach network just to produce high quality results on the source data, at the moment I have parsed ~200k titles articles with the Wall Street Journal. And cleared the data from "non-English" characters and various other symbols. It might be interesting to try to train your network on such input data to produce "generation of plausible news titles". If Yes - tell me, I'll post the text file with this titles.
Which articles would you recommend a beginner (me) to understand what parameters need to change in order to achieve the best result?
Do I need to added the least train loss and how does it affect the outcome?
Whether I will try to test Grid GRU/GRU to generate text, not thinking that it will be a "Question-answer"?

// sorry to do that.. but I want to draw all to the problem how to choose the optimal parameters for training..
@masdude @mattbierner @mcr-ksh @miradel51 @mktal @ml-ai-nlp-ir @ml-lab @monolithpl @muhammadriz @mxer @MyOwnClone @nadavbh12 @nateGeorge @NFSCH4 @ngimel @nicolas-ivanov @nightbay @njordsir @Noah1989 @NorThanapon @notimesea @NoviaDroid @nslater @nunb @oaomly @obrianjunior @offbit @oldgil @omshanti @oneyanshi @opraveen @pankajmauryatimes @parety @parthraghav @patiencett @pbayer8 @Peratham @phecy @pierrebeauguitte @pombredanne @praneethbellamkonda @pranjaldaga @preethamsp @ps00k @psfoley @qinghuizhao @qinhongwei @qnix @Razied @reaction @recursiveMake @rillaha @rlabuguen @robinsloan @cgiogkarakis @evelynmitchell @jaronmoore @johndpope @kelu124 @mcwhittemore @OstrichProjects @panyang @ruotianluo @shawkinsl @softpunch @wanjinchang @wuntoguo @yulgolem @Rocknrenew @rohitrawat @root20 @rremani @rsarxiv @rtc-alex @ruguevara @ruizhaogit @rustch3n @SadeghMSalehi @SalemAmeen @sanket-patil @scatterbrain333 @Scitator @selvaggi @shaonaghosh @shaoxuan92 @sidec @skinscanner @smartynov @sohuren @solarbaby @solidaqua @soumith @lgazpio @spaceraccoon @spyatakov @squidszyd @ssokhey @stonedavid @sukiakiumo @SulemanKazi @sumotoy @sunilkgrao @teome @terrykong @thecerial @theclaymethod @TheodoreGalanos @thomwolf @tianlongwang @tinyloop @tisaconundrum2 @tmp6154 @seominlee @todn @tonyzhang1231 @Tr4c3d @tracy-Ming @scutzck033 @troubledjoe @tybxiaobao @UnforeseenOcean @urisavka @urish @vanpersie32 @vi @vode @vseledkin @vyraun @wantajob @wavelets @wenjianhugit @wjpjet @wltongxing @wrapperband @xcyan @xi-studio @XSell @xuyuwei @xwgeng @xxxxxxxx-dl @yanfenglee @yanxiaole @YerevaNN @yfliao @yongduek @ZhangXinNan @zhaowei8188127 @zhixinshu @zhmz90 @zhuth

Your skill is very high! After your messages I realized that what I'm trying to just configure the settings - it is fundamentally not true.
You could tell about the following things:

Why don't you change val_frac and test_frac in preprocessing?
How do you check the result? English is not my primary language. I find it difficult to understand whether the neural network gave the result. You use some checking in the dictionaries/errors/break into tokens, so as not to degradation after another attempt of learning?
You use Grid GRU/GRU networks "Question-answer"? I teach network just to produce high quality results on the source data, at the moment I have parsed ~200k titles articles with the Wall Street Journal. And cleared the data from "non-English" characters and various other symbols. It might be interesting to try to train your network on such input data to produce "generation of plausible news titles". If Yes - tell me, I'll post the text file with this titles.
Which articles would you recommend a beginner (me) to understand what parameters need to change in order to achieve the best result?
Do I need to added the least train loss and how does it affect the outcome?
Whether I will try to test Grid GRU/GRU to generate text, not thinking that it will be a "Question-answer"?

// sorry to do that.. but I want to draw all to the problem how to choose the optimal parameters for training..
@recursiveMake @rillaha @rlabuguen @robinsloan @cgiogkarakis @evelynmitchell @jaronmoore @johndpope @kelu124 @mcwhittemore @OstrichProjects @panyang @ruotianluo @shawkinsl @softpunch @wanjinchang @wuntoguo @yulgolem @Rocknrenew @rohitrawat @root20 @rremani @rsarxiv @rtc-alex @ruguevara @ruizhaogit @rustch3n @SadeghMSalehi @SalemAmeen @sanket-patil @scatterbrain333 @Scitator @selvaggi @shaonaghosh @shaoxuan92 @sidec @skinscanner @smartynov @sohuren @solarbaby @solidaqua @soumith @lgazpio @spaceraccoon @spyatakov @squidszyd @ssokhey @stonedavid @sukiakiumo @SulemanKazi @sumotoy @sunilkgrao @teome @terrykong @thecerial @theclaymethod @TheodoreGalanos @thomwolf @tianlongwang @tinyloop @tisaconundrum2 @tmp6154 @seominlee @todn @tonyzhang1231 @Tr4c3d @tracy-Ming @scutzck033 @troubledjoe @tybxiaobao @UnforeseenOcean @urisavka @urish @vanpersie32 @vi @vode @vseledkin @vyraun @wantajob @wavelets @wenjianhugit @wjpjet @wltongxing @wrapperband @xcyan @xi-studio @XSell @xuyuwei @xwgeng @xxxxxxxx-dl @yanfenglee @yanxiaole @YerevaNN @yfliao @yongduek @ZhangXinNan @zhaowei8188127 @zhixinshu @zhmz90 @zhuth

Your skill is very high! After your messages I realized that what I'm trying to just configure the settings - it is fundamentally not true.
You could tell about the following things:

Why don't you change val_frac and test_frac in preprocessing?
How do you check the result? English is not my primary language. I find it difficult to understand whether the neural network gave the result. You use some checking in the dictionaries/errors/break into tokens, so as not to degradation after another attempt of learning?
You use Grid GRU/GRU networks "Question-answer"? I teach network just to produce high quality results on the source data, at the moment I have parsed ~200k titles articles with the Wall Street Journal. And cleared the data from "non-English" characters and various other symbols. It might be interesting to try to train your network on such input data to produce "generation of plausible news titles". If Yes - tell me, I'll post the text file with this titles.
Which articles would you recommend a beginner (me) to understand what parameters need to change in order to achieve the best result?
Do I need to added the least train loss and how does it affect the outcome?
Whether I will try to test Grid GRU/GRU to generate text, not thinking that it will be a "Question-answer"?

// sorry to do that.. but I want to draw all to the problem how to choose the optimal parameters for training..
@sumotoy @sunilkgrao @teome @terrykong @thecerial @theclaymethod @TheodoreGalanos @thomwolf @tianlongwang @tinyloop @tisaconundrum2 @tmp6154 @seominlee @todn @tonyzhang1231 @Tr4c3d @tracy-Ming @scutzck033 @troubledjoe @tybxiaobao @UnforeseenOcean @urisavka @urish @vanpersie32 @vi @vode @vseledkin @vyraun @wantajob @wavelets @wenjianhugit @wjpjet @wltongxing @wrapperband @xcyan @xi-studio @XSell @xuyuwei @xwgeng @xxxxxxxx-dl @yanfenglee @yanxiaole @YerevaNN @yfliao @yongduek @ZhangXinNan @zhaowei8188127 @zhixinshu @zhmz90 @zhuth

@saippuakauppias please do not spam '@' references and then edit your comment to hide it.

for the posterity if you were spammed @ by @saippuakauppias https://twitter.com/pombr/status/838017330189844480

Sorry, guys), But this repository can already be considered dead, as has long been no new commits and issues. And learn important things is unrealistic. Yes, I used a bad method to attract your attention. But maybe it will give some results.

Sorry, guys), But this repository can already be considered dead, as has long been no new commits and issues. And learn important things is unrealistic. Yes, I used a bad method to attract your attention. But maybe it will give some results.

@saippuakauppias Please do not do this ever again.

@brisker, please stop posting unrelated comments in threads.

This issue has gone out of control and off-topic, so I am closing it.


Rubocop Defaults

Rubocop is making our travis logs pretty spamming because we don't have defaults set for some of the newer cops. We need someone to look at the missing cops, add them to our .rubocop.yml file.
Alternatively, if someone wanted to remove rubocop and all its artifacts and instead move us to the standard gem that would also be a good solution.

I'd like to solve this one!

Let me know if this meets the standards.


[mini.files] show line numbers

Contributing guidelines

[X] I have read CONTRIBUTING.md
[X] I have read CODE_OF_CONDUCT.md

Module(s)
mini.files
Description
Hi together,
If it's possible already, I'd love to hear, but the request is basically to have the option to enable relative line numbers in the filetree. I navigate a lot with motions like 5j , so it's crucial to have those.

Yes, it is possible through custom autocommand. See this comment.

Yes, it is possible through custom autocommand. See this comment.

oh wow, the day will come when i can easily think of those custom autocmds on my own :D
Thanks a lot.


Azure rollback scripts don't work

Susan and I tried to do a rollback in staging and found a few issues.

[] one or two incremental scripts don't have the executable bit
[] the rollback script doesn't export the TF image name
[] There is an invalid method call that we believe can just be removed.

we want to make sure this works for aws, but not really priority for azure

It would be good to remove or at least make it obvious in the relevant non working ones that they don't work.


streaming example, chunked body error

Describe the bug
i found that (streaming example) use chunked, by setting contentLength = - 1 but the body is not the chunked body, chunked body can be found in here, the example may mix the streaming and chunked

cc @FGYFFFF

"contentLength = - 1" is a flag for the framework to handle chunks, which are automatically encoded internally and set to "Transfer-Encoding"


Resolves #98 - catch error when stringifying coverage data and rethro…

doesn't fix stringify error but doesn't leave us spelunking for actual issue

Good call


Tests/cmontecarlo

Hi @kaushik94 - so this is a good way to use fixtures. We now have 419 tests running. Have a look and let me know if you have any questions

Ah you should also try to use 4 spaces for indentation and not tabs.

@wkerzendorf ahh now I get it. Will make the changes right away.


CustomDialog in Visual Studio Designer throws exception

HI,
I would like to see the preview of my CustomDialog in Visual Studio but unfortunately it shows the folling error message.

The fix is realy simple, in BaseMetroDialog -> HandleTheme add the NULL check for windowTheme

                var windowTheme = DetectTheme(this);

	            if (windowTheme == null)
		            return;

                var theme = windowTheme.Item1; <-- Throws

Thanks!

I apologize if this is the incorrect place to post a question, but I didn't want another duplicate of this problem (I'll remove it and ask somewhere else if needed).
I'm having this same problem with the newest version of MahApps.Metro.  The mentioned code fix is in place but my problem is identical to the original post by marcpiechura.
I added a UserControl (WPF) and added this code to my new xaml file
             xmlns:Dialogs="clr-namespace:MahApps.Metro.Controls.Dialogs;assembly=MahApps.Metro"
             xmlns="http://schemas.microsoft.com/winfx/2006/xaml/presentation"
             xmlns:x="http://schemas.microsoft.com/winfx/2006/xaml"
             xmlns:mc="http://schemas.openxmlformats.org/markup-compatibility/2006"
             xmlns:d="http://schemas.microsoft.com/expression/blend/2008"
             mc:Ignorable="d"
             d:DesignHeight="300" d:DesignWidth="300">
    <Grid>

    </Grid>
</Dialogs:CustomDialog>```

I imagine this is human error (since I'm new to wpf in general), but I wanted to make sure it wasn't the same bug.

@johnsimmons
You need to upgrade to the latest 1.1.3 alpha, it's not included in 1.1.2.
@punker76
Maybe you could change the milestone to 1.1.3 for clarification ?
Regards

Awesome, thanks for the response.  I'm glad it was just a misunderstanding on my part.


[Presence] Get animationName consistently

Fixes https://github.com/radix-ui/primitives/issues/849
The problem was caused by some state being stuck in isAnimating and suspending the unmount. It seems that the animation name getting retrieved from style in the mount effect can sometimes return as none under certain conditions, that's why this doesn't show in the story. I was wondering if this comment was referring to this issue in the past?
Getting the name in the start event makes this behave consistently.

I removed this here ... I wonder if close animation is now broken again?

Is close animation broken again now that we've re-introduced this? As in, a close animation only.

Looked ok in my testing – https://601857eb614bae0021c9b9dd-iwpsaxggjf.chromatic.com/?path=/story/components-presence--with-unmount-animation

Sweet. I thought this was redundant given my other changes as the stories all still worked. Can we add a new story that highlights this issue so that any future changes don't re-introduce it please?

What makes this example different?

At the moment the implementation assumes that the animation won't change after mount, if the initial animation happens to be none, (in our case when a component uses popper) then that value is what is retrieved initially in the getComputedStyle(node), it doesn't have mechanism to update that value if an animation is then added after.
Here's a sandbox showing the problem
https://codesandbox.io/s/angry-wu-vis9w?file=/src/App.js
By listening on the start event we can update the previous animation value if it changes. This isn't reflected in the existing story because the animation is never updated like this.

Ahhh, thanks for the example. I seeeee 🙂 In that case, yeah just a story to help us avoid this in future would be super helpful 🙏


Unable to install environment in WSL1, Ubuntu 20.04

When running conda env create -f $FPGA_FAM/environment.yml I get the following error:
`Collecting package metadata (repodata.json): done
Solving environment: done
Downloading and Extracting Packages
Preparing transaction: done
Verifying transaction: done
Executing transaction: done
Installing pip dependencies: / Ran pip subprocess with arguments:
['/home/joris/.conda/envs/eos-s3/bin/python', '-m', 'pip', 'install', '-U', '-r', '/home/joris/Scriptie/Toolchain/F4PGA/f4pga-examples/eos-s3/condaenv.ciz9ugbc.requirements.txt', '--exists-action=b']
Pip subprocess output:
Collecting https://github.com/chipsalliance/f4pga/archive/e1cd038f06c7161b27afd0073fb507da2b8e5a9e.zip#subdirectory=f4pga (from -r /home/joris/Scriptie/Toolchain/F4PGA/f4pga-examples/eos-s3/../common/requirements.txt (line 18))
Using cached https://github.com/chipsalliance/f4pga/archive/e1cd038f06c7161b27afd0073fb507da2b8e5a9e.zip
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Preparing metadata (pyproject.toml): started
Preparing metadata (pyproject.toml): finished with status 'done'
Collecting git+https://github.com/antmicro/quicklogic-fasm.git (from -r /home/joris/Scriptie/Toolchain/F4PGA/f4pga-examples/eos-s3/requirements.txt (line 20))
Cloning https://github.com/antmicro/quicklogic-fasm.git to /tmp/pip-req-build-yrrq_zg4
Pip subprocess error:
Running command git clone --filter=blob:none --quiet https://github.com/antmicro/quicklogic-fasm.git /tmp/pip-req-build-yrrq_zg4
fatal: unable to access 'https://github.com/antmicro/quicklogic-fasm.git/': Could not resolve host: github.com
error: subprocess-exited-with-error
× git clone --filter=blob:none --quiet https://github.com/antmicro/quicklogic-fasm.git /tmp/pip-req-build-yrrq_zg4 did not run successfully.
│ exit code: 128
╰─> See above for output.
note: This error originates from a subprocess, and is likely not a problem with pip.
error: subprocess-exited-with-error
× git clone --filter=blob:none --quiet https://github.com/antmicro/quicklogic-fasm.git /tmp/pip-req-build-yrrq_zg4 did not run successfully.
│ exit code: 128
╰─> See above for output.
note: This error originates from a subprocess, and is likely not a problem with pip.
failed
CondaEnvException: Pip failed`
I have already tried changing my git global config to not use a proxy.
When ignoring the error and starting the environment, when compiling the btn_counter example, I get the error f4pga: command not found.
Thanks in advance for any help!

Maybe I am missing something in this log but "Could not resolve host: github.com" might suggest some DNS problems on your side?

However, I can ping Github just fine and download different packages. I only receive the error from the conda command.

This turned out to be a WSL1 issue, compilation works fine in WSL2


deployment_id should be defined as foreign key in resource schema [REPLACEMENT ISSUE]

The original issue
Id: 30
Title: deployment_id should be defined as foreign key in resource schema

could not be created.
This is a dummy issue, replacing the original one. It contains everything but the original issue description. In case the gitlab repository is still existing, visit the following link to show the original issue:
TODO

In GitLab by @peterdesmet on Sep 2, 2020, 15:14
This is already implemented:

media: https://gitlab.com/oscf/camtrap-package-schemas/-/blob/master/media-table-schema.json#L85-93
observations: https://gitlab.com/oscf/camtrap-package-schemas/-/blob/master/media-table-schema.json#L85-93

Note: observations.csv also has media_id and event_id as foreign keys to media.csv


Add test for stubbed class

X::Package::Stubbed should not show line number

I'm going to reject this, as it doesn't make much sense to require a language implementation to never show a line number. For example, showing the location where the stub was declared could be useful. We also tend to avoid testing exact message content, as in the past such tests proved to be too restrictive for no good reason.
If you still'd like to add a test to cover your PR, you could place it into Rakudo's test suit instead. The t/05-messages/01-errors.t file sounds like a fine candidate to place the test into. You can run the test file with make t/05-messages/01-errors.t from rakudo's checkout.

fwiw, I think we really should show the line where the stub was declared; it'd be much kinder to the user :-)


automatic row count

For a row count on a (result) table yu have to click on the count button on the bottom toolbar.
I often have large files and want to know the number of records or use the count as a check on sql command
Is it possible to calculate it by default? Perhaps add it as an option to do so on the data editor settings.

Thank you for the idea

This will be useful!

We have discussed this feature and propose the following requirements:

Row count must be calculated only once when opening the data viewer. It should not be triggered when new data is fetched.
The "data editor" preferences must have a setting to turn it on/off.

Does "only once when opening the data viewer" mean "every time an sql is executed"
and "not be triggered when new data is fetched" mean "not every time a next portion from LIMIT OFFSET is fetched"?
That would be nice.

Correct.


Fix for latest Win11 interfaces

Windows 11 has changed the virtual desktop interface again, this time between build revisions rather than builds (#51).
The actual detective work was done in https://github.com/MScholtes/VirtualDesktop/issues/67; this is just a hamfisted attempt to adapt that to VD.ah2. It may well be inaccurate and/or have bugs because I've only tested the four functions I regularly use (getNameFromDesktopNum, goToDesktopNum, MoveWindowToDesktopNum, and getCurrentDesktopNum). Still, hope this helps.

@Viqsi
hi, you have committed an update with "microsoft's latest shuffle of the IDs"
is there a version of windows in which the latest version of VD.ahk doesn't work ?

@Viqsi hi, you have committed an update with "microsoft's latest shuffle of the IDs" is there a version of windows in which the latest version of VD.ahk doesn't work ?
I've not explicitly tested what you've got in there; this was just me bringing my own fork up to date with the changes in https://github.com/FuPeiJiang/VD.ahk/pull/62 as I got burned by them just now in build 22631.3155. I've not tried to fully reconcile.

Gave that commit of yours a try and it looks to solve the problem for me, so I'ma close this PR. (I kind of wish I'd noticed your work earlier, actually... :) ). Thanks!

for buildNumber = 22621,
you could probably replace
IID_IVirtualDesktopManagerInternal_ := "{A3175F2D-239C-4BD2-8AA0-EEBA8B0B138E}"
with
IID_IVirtualDesktopManagerInternal_ := "{4970BA3D-FD4E-4647-BEA3-D89076EF4B9C}"
{A3175F2D-239C-4BD2-8AA0-EEBA8B0B138E} is IID_IVirtualDesktopManagerInternal2
{4970BA3D-FD4E-4647-BEA3-D89076EF4B9C} is IID_IVirtualDesktopManagerInternal
that's why both work
I have a repo with IID extraction:
https://github.com/FuPeiJiang/Windows-BuildNumber-VirtualDesktop/blob/main/23H2-22631.2715/IID.txt
could you test if my version works for 22631.3155 ?
I included support for Windows Server 2022, but you probably don't need it

I saw that you tested it, so this confirms that Commits with #NUM give no notification
https://github.com/FuPeiJiang/VD.ahk/issues/51
at the bottom, you can see that I added a commit, but there's no notification ?

FuPeiJiang added a commit that referenced this issue 3 weeks ago
@FuPeiJiang
"improvements"; "untested"; https://github.com/FuPeiJiang/VD.ahk/issues/51

sorry, I should type something in the comments/add a comment

Yeah, it didn't notify me. I'm not sure why; maybe because I'm using the AHKv2 branch and that commit was a AHKv1 branch. Either way, it seems all good now.


Fix Consul key path used when determining leader.

The session lock is on the full key path, not on the root path. As far as I can tell, the result of this method isn't actually used anywhere, but this fix at least makes it correct.
I discovered this issue due to my Consul ACL policy. My application has access to the full key path, but does not have access to the configured root path, so I was getting an error at startup.

@colin-mullikin thx for spotting this, is there any chance you also provide a test ?

@colin-mullikin thx for spotting this, is there any chance you also provide a test ?

Last push was just to add the Apache header to my test file.

Last push was just to add the Apache header to my test file.


move depedencies currently needed for import to work

A few deps were missing on a clean env.
Some were missing, some are meant to be dev, but are being imported from pxt. Cleaning that can be separate PR.
mamba create <>
pip install <>
python -c 'import pixeltable as pxt; cl = pxt.Client()'
Import fails without them (on clean env)

This change is

Are you sure you ran poetry lock with --no-update? There are a LOT of changes.
Also, let's create a JIRA ticket to track down why those 3 dependencies (that should only be needed for dev) are breaking the import.

solved in another PR


Add tests for @yamada-ui/pin-input

related: #74
Description
Currently, no tests in @yamada-ui/pin-input. In the future, I feel the need for testing when operating @yamada-ui/pin-input.
Problem Statement/Justification
Testing is essential to ensure quality when operating a package.

Hi @hirotomoyamada ! I'd love to work on this one

@000000armor
Hi, thanks for the comment.
Yes, please.
Good luck!


Why do I/o operations (database operations) shut down automatically every time I do them

error:  closed with exit code 1002 additional info: An unrecoverable IOException occurred so the connection was closed

No information, closing this issue.


TN-351 formatting for recur.py, reference.py, relationship.py, reporting.py

Hello @John0Randolph! Thanks for submitting the PR.

In the file portal/models/reference.py, following are the PEP8 issues :

Line 118:21: E122 continuation line missing indentation or outdented
Line 119:21: E122 continuation line missing indentation or outdented
Line 120:21: E122 continuation line missing indentation or outdented
Line 121:21: E122 continuation line missing indentation or outdented
Line 125:21: E122 continuation line missing indentation or outdented
Line 126:21: E122 continuation line missing indentation or outdented
Line 127:21: E122 continuation line missing indentation or outdented
Line 128:21: E122 continuation line missing indentation or outdented
Line 132:21: E122 continuation line missing indentation or outdented
Line 133:21: E122 continuation line missing indentation or outdented
Line 134:21: E122 continuation line missing indentation or outdented
Line 135:21: E122 continuation line missing indentation or outdented
Line 136:21: E122 continuation line missing indentation or outdented

In the file portal/models/reporting.py, following are the PEP8 issues :

Line 125:9: E128 continuation line under-indented for visual indent


Enable title on button

This feature is already partially complete in the current version. Line 3 of ActionButtonField.vue :title="name" is called, but computed as const name = computed(() => props?.field?.name || null);, and name isn't called in ActionButton::class. All it would require is adding
    public function title(string $title): self
    {
        return $this->withMeta(compact('title'));
    }

And hooking it up.

Hello
There is no need in additional title method!
You can add name in constructor of action:
ActionButtons::make('Torrent actions')

ActionButton::make('Upload')

I hope this will help you!

Ah! How could I have been so blind! Thank you, I went too deep thinking it was a partial feature, when I should have just added a string to the title :)


Concat plugin not concatenating multiple lines

Problem
Concat not working for multi line on kubernetes environment. I am using fluentd kinesis and concat plugin
I have two scenarios for which its not working

Multiline seperated by \n and starting with a time stamp - Only the first line of multiline reaches the destination. Other logs are lost.
Example: Testing line 1 \n Testing line 2\n Testing line3
The log is lost and does not reach the destination
Java exception stack trace which is multiple lines - The stack traces are reaching the destination as multiple records and in jumbled. They are not sent as single record after concatenation.

This is my fluentd configuration
# concat multiline logs if the first line starts with a date in a specific format
    <filter kubernetes.**>
      @type concat
      key message
      multiline_start_regexp /^\d{4}-\d{1,2}-\d{1,2}/
      stream_identity_key stream
      flush_interval 2
      use_first_timestamp true
      timeout_label @NORMAL
    </filter>

I am using concat plugin version 2.3.0
Also, I am not clear with the usage of stream_identity_key. What is it used for?

Hello, Anyone please suggest something.

Could you show me your logs about both scenarios?

dude what happened , how do you solve the second scenario

I am experiencing the same issue. I think is related to the timeout label.


New Theme - YouTube using Enhancer for Youtube

Hello!
I added a new theme for YouTube using an extension called Enhancer for YouTube.
Here's the link to the theme:
https://github.com/uttsav1025/enhancer-for-youtube

I appreciate your interest in creating and wanting to contribute to the project. 🥰
But from what I saw, we already have a theme for Youtube. Would you be interested in joining the organization and collaborating with this theme that we already have? 🤔

Thank you, I've been following the project and would absolutely be interested in joining the organization and collaborating.


Missing argument for parameter #1 in call: s.OnPong() in websocket.swift

In the WebSocket.swift file, lines 464 and 658 error saying

Changing this to include Void errors saying that it expected no arguments. This is on the latest Xcode and swift, and the module was installed from CocoaPods

I think this might be because there was a change at some point for OnPong that made it return data instead of just void. It should look like:
``swift
socket.onPong = { data in
//do stuff
}
The example above should work with the latest version (3.0.3).


[Feature?]: Wrangler/Miniflare dev server for Cloudflare

Duplicates

[X] I have searched the existing issues

Latest version

[X] I have tested the latest version

Summary 💡
Solid-start's dev server doesn't use wrangler or miniflare for the Cloudflare presets, so bindings aren't available etc and it isn't really usable.
There's a hacky example in vinxi of react ssr with a miniflare 2 dev server, but miniflare 2 is 3 years out-of-date and is missing a lot of things, to even get D1 to work you have to prefix the binding with __D1_BETA__ etc.
Examples 🌈
Can the dev server under Cloudflare use https://developers.cloudflare.com/workers/wrangler/api/#getplatformproxy perhaps?
Sveltekit is doing this: https://github.com/sveltejs/kit/pull/11732/files#diff-78806028d48ad47894445421562b7796c53178948c017e13d4550def4193903e
Motivation 🔦
Solid-start DX with Cloudflare is currently miserable.

It seems you can just do something like the following in middleware, but still I think this is something that should be handled by the framework so process.env works consistently in dev/prod, or at least documented.
if (import.meta.env.PROD) {
  event.locals.db = process.env.DB;
} else {
  const wrangler = await import("wrangler");
  const proxy = await wrangler.getPlatformProxy();
  event.locals.db = proxy.env.DB;
}

Yeah since we don't control the adapters/presets this is a bit more tricky then in the past (or in Sveltekit). It was one of the tradeoffs of going this way, but I hope to have a solution in the future.

There's an Access to the bindings in local env section in Nitro docs. But it doesn't seem to work with Solid Start, according to https://github.com/pi0/nitro-cloudflare-dev/issues/42

Yeah Nitro added some newer features to support this. We don't use Nitro currently in dev with Vinxi so this won't work. I'm hoping after Vite 6 core Vite(and in so Nitro) will have the features we need to change up this setup.

If it's useful to others coming here, I used bun patch to alter node_modules/vinxi/lib/nitro-dev.js to add middleware to add the result of getPlatformProxy to the event context instead. Now my application code is exactly the same in dev as well as when using wrangler/deployed on Cloudflare.


GUI: UX: Policy deletion requires "exit" of alert message

Saw a UX error in the GUI only. When deleting a rule within a policy, an alert/notification message is raised. This error must be X'ed out in order to proceed appropriately. Since it was not required, a user can continue to try to use the software but then it becomes distorted until this is resolved/unlocked. The expected behavior is that when a user clicks away from a policy deletion/edit/etc, it should clear the notification message.
Because I have a larger screen, it doesn't affect my user experience. But smaller screens will cause the editor on the right to drop below view (until deletion/confirmation alert is closed).
Was working with a recent nightly build (from within the past 3 days).

Here is an example

Same for MCO, same code :)
(maybe this notifcation is not present for some actions in MCO, added on GUI to know what I am doing..).
Anyway, a timer for notification can be added.

It's present in MCO but it's not a problem because the browser knows how to make a lil more room when the DOM is manipulated.... or maybe I have only tested on non-tiny monitors.

This have been fixed, the message is removed when user click on another policy/rule and the message do not change the height of the column.


[File Explorer] File Explorer Tabs

📝 Provide a description of the new feature
Tabs to the file explorer, adding the option to open multiple tabs in the same window.
What is the expected behavior of the proposed feature?  What is the scenario this would be used?
There should be a row of tabs, with the current one highlighted and a "+" for adding a tab and a "x" in each tab to close it. Preferably its underneath the ribbenbar, but that's not up to me. There should also be a option to open a folder in new tab in the context menu, above or underneath the option to open a folder in new window.
The feature would be toggleable from the File Explorer section of the PowerToys launcher.
I couldn't find an issue asking for this, but if there is, please let me know and sorry for opening a new one 😅

If you'd like to see this feature implemented, add a 👍 reaction to this post.

Duplicate of #10

Ah, I see. Thanks for the quick response and again, apologies for opening an issue for it.

Check out https://thewincentral.com/microsoft-planning-to-bring-windows-10-sets-feature-back-from-grave/, maybe that'll help?


Companies vs Technolgies /  Need for 2 separate maps ?

Hello,
The map may be not readable if we have a mix between companies/products and technologies.
Why not having 2 maps then ?

We'll certainly be adding a graphical way of distinguishing between
projects and companies. Let us know in the next version whether you think
it works.
On Wed, Jan 11, 2017 at 12:54 PM, XmasRock<EMAIL_ADDRESS>wrote:

Hello,
The map may be not readable if we have a mix between companies and
technologies.
Why not having 2 maps then ?
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/cncf/landscape/issues/60, or mute the thread
https://github.com/notifications/unsubscribe-auth/AC8MBl2LGP5ngw56eXcdL3kFF-lqgVR9ks5rRRdwgaJpZM4Lg4LX
.

--
Dan Kohn<EMAIL_ADDRESS>Executive Director, Cloud Native Computing Foundation https://cncf.io/
tel:+1-415-233-1000

I see some difficulties when a product is the techno in one hand and when a product is anintegrated set of technos in the other hand.
Not easy ;)

Appreciate your input @XmasRock, we added a purpose statement that hopefully helps clarify the idea of the 2-D version at the bottom of the most recent version https://github.com/cncf/landscape#current-version. In addition to that, we're currently developing a 3-D, interactive version that allows for the filtering of products vs projects, OSS, will provide Crunchbase data, GitHub stars, etc.  Stay tuned for that, hope this is the update you were hoping for and closing in the meantime.


emacs: Sync updates from auduchinok/base16-builder

Includes changes by @belak, @mkaito, and @senthilbaboo
This is a part of an effort to focus on one canonical version of the base16-builder.

This includes the following changes:

https://github.com/chriskempson/base16-builder/pull/367 (me, so you already have approval)
https://github.com/chriskempson/base16-builder/pull/347
https://github.com/chriskempson/base16-builder/pull/319
https://github.com/chriskempson/base16-builder/pull/317

Boom merged 💥!
Many thanks, @belak for lining all these up for me. About to prep a new release now.


Rename Gate to IR/OPCODE

Gate has now been renamed to Opcode and Opcode has been renamed to BlackBoxFunctions