Missing MSFT_AccountPolicy from SecurityPolicyDsc?

Trying to run the example script CIS_Microsoft_Windows_10_Enterprise_Release_2004.ps1 on a Windows Development machine:

throws the following error:
PS C:\Users\User\Downloads\SecOps-Powershell-CISDSC-main\SecOps-Powershell-CISDSC-main\src\CISDSC\Examples> .\CIS_Microsoft_Windows_10_Enterprise_Release_2004.ps1

    Directory: C:\Users\User\Downloads\SecOps-Powershell-CISDSC-main\SecOps-Powershell-CISDSC-main\src\CISDSC\Examples\LCMConfig

Mode                 LastWriteTime         Length Name
----                 -------------         ------ ----
-a----         1/21/2021  11:51 AM           1162 localhost.meta.mof
Setting up LCM config
Setting up config

    Directory: C:\Users\User\Downloads\SecOps-Powershell-CISDSC-main\SecOps-Powershell-CISDSC-main\src\CISDSC\Examples\Microsoft_Windows_10_Enterprise_2004_CIS_L1

Mode                 LastWriteTime         Length Name
----                 -------------         ------ ----
-a----         1/21/2021  11:52 AM         613594 localhost.mof
Testing DSCConfig
VERBOSE: Perform operation 'Invoke CimMethod' with following parameters, ''namespaceName' = root/Microsoft/Windows/DesiredStateConfiguration,'className' = MSFT_DSCLocalConfigurationManager,'methodName' = TestConfiguration'.
VERBOSE: An LCM method call arrived from computer WINDEV2012EVAL with user sid S-1-5-21-4279892692-2277359461-354179757-1001.
VERBOSE: [WINDEV2012EVAL]: LCM:  [ Start  Compare  ]
VERBOSE: [WINDEV2012EVAL]: LCM:  [ *FAILED*Compare  ]     Completed processing compare operation. The operation returned False.
The PowerShell DSC resource MSFT_AccountPolicy from module <SecurityPolicyDsc,<IP_ADDRESS>> does not exist at the PowerShell module path nor is it registered as a WMI DSC resource.
    + CategoryInfo          : InvalidOperation: (root/Microsoft/...gurationManager:String) [], CimException
    + FullyQualifiedErrorId : DscResourceNotFound
    + PSComputerName        : localhost

VERBOSE: Operation 'Invoke CimMethod' complete.
VERBOSE: Time taken for configuration job to complete is 1.697 seconds

(Note my modifications to the example PS1 script:
#Requires -module CISDSC
#Requires -RunAsAdministrator

<#
    .DESCRIPTION
    Applies CIS Level one benchmarks for Microsoft Windows 10 Enterprise build 2004 with no exclusions.
    Exclusion documentation can be found in the docs folder of this module.
#>

[DSCLocalConfigurationManager()]
configuration LCMConfig {
    Node 'localhost' {
        Settings {
            RefreshMode = 'Push'
            ConfigurationMode = 'ApplyOnly'
        }
    }
}
LCMConfig

Configuration Microsoft_Windows_10_Enterprise_2004_CIS_L1
{
    Import-DSCResource -ModuleName 'CISDSC' -Name 'CIS_Microsoft_Windows_10_Enterprise_Release_2004'

       CIS_Microsoft_Windows_10_Enterprise_Release_2004 'CIS Benchmarks'
        {
            '2315AccountsRenameadministratoraccount' = 'CISAdmin'
            '2316AccountsRenameguestaccount' = 'CISGuest'
            '2376LegalNoticeCaption' = 'Legal Notice'
            '2375LegalNoticeText' = @"
This is a super secure device that we don't want bad people using.
I'm even making sure to put this as a literal string so that I can cleanly
use multiple lines to tell you how super secure it is.
"@
        }
}

echo "Setting up LCM config"
Set-DscLocalConfigurationManager -Path '.\LCMConfig'
echo "Setting up config"
Microsoft_Windows_10_Enterprise_2004_CIS_L1
echo "Testing DSCConfig"
$Report = Test-DscConfiguration -Path '.\Microsoft_Windows_10_Enterprise_2004_CIS_L1' -Verbose
echo "Parsing report"
$Report.ResourcesInDesiredState | Select-Object -Property 'ResourceId','InDesiredState' | Export-CSV -Path '.\ResourcesInDesiredState.csv'
$Report.ResourcesNotInDesiredState | Select-Object -Property 'ResourceId','InDesiredState' | Export-CSV -Path '.\ResourcesNotInDesiredState.csv'

I'm unable to find references to the MSFT_AccountPolicy resource anywhere on the internet. The closest I could find was AccountPolicy in the SecurityPolicyDsc module: https://github.com/dsccommunity/SecurityPolicyDsc.

I had set up the dev environment with;
Install-Module -Name 'CISDSC'
Enable-PSRemoting -Force
Set-Item -Path 'WSMan:\localhost\MaxEnvelopeSizeKb' -Value 8192
New-CimSession -ComputerName localhost

PS C:\Users\User\Downloads\SecOps-Powershell-CISDSC-main\SecOps-Powershell-CISDSC-main\src\CISDSC\Examples> Find-DscResource -Name AccountPolicy

Name                                Version    ModuleName                          Repository
----                                -------    ----------                          ----------
AccountPolicy                       <IP_ADDRESS>   SecurityPolicyDsc                   PSGallery

PS C:\Users\User\Downloads\SecOps-Powershell-CISDSC-main\SecOps-Powershell-CISDSC-main\src\CISDSC\Examples> Find-DscResource -Name MSFT_AccountPolicy

PS C:\Users\User\Downloads\SecOps-Powershell-CISDSC-main\SecOps-Powershell-CISDSC-main\src\CISDSC\Examples>

PS C:\Users\User\Downloads\SecOps-Powershell-CISDSC-main\SecOps-Powershell-CISDSC-main\src\CISDSC\Examples> Find-DscResource -Name AccountPolicy

Name                                Version    ModuleName                          Repository
----                                -------    ----------                          ----------
AccountPolicy                       <IP_ADDRESS>   SecurityPolicyDsc                   PSGallery

PS C:\Users\User\Downloads\SecOps-Powershell-CISDSC-main\SecOps-Powershell-CISDSC-main\src\CISDSC\Examples> Find-DscResource -Name MSFT_AccountPolicy

PS C:\Users\User\Downloads\SecOps-Powershell-CISDSC-main\SecOps-Powershell-CISDSC-main\src\CISDSC\Examples>

@mdb-vzeddie Was the module installed from the PSGallery or the Repository? 'AuditPolicyDsc' and 'SecurityPolicyDsc' are both flagged dependencies in the CISDSC module manifest so a PSGallery install should of handled that for you.

@mdb-vzeddie Was the module installed from the PSGallery or the Repository? 'AuditPolicyDsc' and 'SecurityPolicyDsc' are both flagged dependencies in the CISDSC module manifest so a PSGallery install should of handled that for you.

https://www.powershellgallery.com/packages/CISDSC/2.0.1

https://www.powershellgallery.com/packages/CISDSC/2.0.1

@MKletz They were installed via the CISDSC module first. When that failed the first time, I did Install-Module -Name SecurityPolicyDsc. I'm going to try to build the machine from a fresh image and try again.

@MKletz They were installed via the CISDSC module first. When that failed the first time, I did Install-Module -Name SecurityPolicyDsc. I'm going to try to build the machine from a fresh image and try again.

I'd recommend installing it via the gallery with the bellow. Should sort it all out for you.
Install-Module -Name CISDSC -Scope 'AllUsers'

I'd recommend installing it via the gallery with the bellow. Should sort it all out for you.
Install-Module -Name CISDSC -Scope 'AllUsers'

I just did a refresh of the dev box and ran into the same error:
PS C:\Program Files (x86)\WindowsPowerShell\Modules\CISDSC\2.0.1\Examples> .\CIS_Microsoft_Windows_10_Enterprise_Release_2004.ps1

    Directory: C:\Program Files (x86)\WindowsPowerShell\Modules\CISDSC\2.0.1\Examples\LCMConfig

Mode                 LastWriteTime         Length Name
----                 -------------         ------ ----
-a----         1/21/2021   7:09 PM           1162 localhost.meta.mof
Setting up LCM config
Setting up config

    Directory: C:\Program Files (x86)\WindowsPowerShell\Modules\CISDSC\2.0.1\Examples\Microsoft_Windows_10_Enterprise_2004_CIS_L1

Mode                 LastWriteTime         Length Name
----                 -------------         ------ ----
-a----         1/21/2021   7:09 PM         613594 localhost.mof
Testing DSCConfig
VERBOSE: Perform operation 'Invoke CimMethod' with following parameters, ''namespaceName' = root/Microsoft/Windows/DesiredStateConfiguration,'className' = MSFT_DSCLocalConfigurationManager,'methodName' = TestCon
figuration'.
VERBOSE: An LCM method call arrived from computer WINDEV2012EVAL with user sid S-1-5-21-4279892692-2277359461-354179757-1001.
VERBOSE: [WINDEV2012EVAL]: LCM:  [ Start  Compare  ]
VERBOSE: [WINDEV2012EVAL]: LCM:  [ *FAILED*Compare  ]     Completed processing compare operation. The operation returned False.
The PowerShell DSC resource MSFT_AccountPolicy from module <SecurityPolicyDsc,<IP_ADDRESS>> does not exist at the PowerShell module path nor is it registered as a WMI DSC resource.
    + CategoryInfo          : InvalidOperation: (root/Microsoft/...gurationManager:String) [], CimException
    + FullyQualifiedErrorId : DscResourceNotFound
    + PSComputerName        : localhost

VERBOSE: Operation 'Invoke CimMethod' complete.
VERBOSE: Time taken for configuration job to complete is 5.723 seconds
Parsing report

PS C:\Program Files (x86)\WindowsPowerShell\Modules\CISDSC\2.0.1\Examples>

I modified the localhost.mof file and replaced all MSFT_AccountPolicy to AccountPolicy and the same error occurs but for AccountPolicy instead.
I do wonder if it's a Powershell configuration issue though (I'm not the most fluent Powershell person).

I just did a refresh of the dev box and ran into the same error:
PS C:\Program Files (x86)\WindowsPowerShell\Modules\CISDSC\2.0.1\Examples> .\CIS_Microsoft_Windows_10_Enterprise_Release_2004.ps1

    Directory: C:\Program Files (x86)\WindowsPowerShell\Modules\CISDSC\2.0.1\Examples\LCMConfig

Mode                 LastWriteTime         Length Name
----                 -------------         ------ ----
-a----         1/21/2021   7:09 PM           1162 localhost.meta.mof
Setting up LCM config
Setting up config

    Directory: C:\Program Files (x86)\WindowsPowerShell\Modules\CISDSC\2.0.1\Examples\Microsoft_Windows_10_Enterprise_2004_CIS_L1

Mode                 LastWriteTime         Length Name
----                 -------------         ------ ----
-a----         1/21/2021   7:09 PM         613594 localhost.mof
Testing DSCConfig
VERBOSE: Perform operation 'Invoke CimMethod' with following parameters, ''namespaceName' = root/Microsoft/Windows/DesiredStateConfiguration,'className' = MSFT_DSCLocalConfigurationManager,'methodName' = TestCon
figuration'.
VERBOSE: An LCM method call arrived from computer WINDEV2012EVAL with user sid S-1-5-21-4279892692-2277359461-354179757-1001.
VERBOSE: [WINDEV2012EVAL]: LCM:  [ Start  Compare  ]
VERBOSE: [WINDEV2012EVAL]: LCM:  [ *FAILED*Compare  ]     Completed processing compare operation. The operation returned False.
The PowerShell DSC resource MSFT_AccountPolicy from module <SecurityPolicyDsc,<IP_ADDRESS>> does not exist at the PowerShell module path nor is it registered as a WMI DSC resource.
    + CategoryInfo          : InvalidOperation: (root/Microsoft/...gurationManager:String) [], CimException
    + FullyQualifiedErrorId : DscResourceNotFound
    + PSComputerName        : localhost

VERBOSE: Operation 'Invoke CimMethod' complete.
VERBOSE: Time taken for configuration job to complete is 5.723 seconds
Parsing report

PS C:\Program Files (x86)\WindowsPowerShell\Modules\CISDSC\2.0.1\Examples>

I modified the localhost.mof file and replaced all MSFT_AccountPolicy to AccountPolicy and the same error occurs but for AccountPolicy instead.
I do wonder if it's a Powershell configuration issue though (I'm not the most fluent Powershell person).

I noticed you're in "Program Files (x86)" are you installing these on 32 or 64bit powershell? This has only been tested on 64 bit

I noticed you're in "Program Files (x86)" are you installing these on 32 or 64bit powershell? This has only been tested on 64 bit

Launch 64 bit PS "%SystemRoot%\system32\WindowsPowerShell\v1.0\powershell.exe"
Run Install-Module -Name CISDSC -Scope 'AllUsers'
Run the example from "C:\Program Files\WindowsPowerShell\Modules\CISDSC\Examples"

Launch 64 bit PS "%SystemRoot%\system32\WindowsPowerShell\v1.0\powershell.exe"
Run Install-Module -Name CISDSC -Scope 'AllUsers'
Run the example from "C:\Program Files\WindowsPowerShell\Modules\CISDSC\Examples"

That's the reason! I got this to work by installing it against the 64bit PS. Thank you so much!

That's the reason! I got this to work by installing it against the 64bit PS. Thank you so much!

Wonderful! Thanks for reaching out.

Wonderful! Thanks for reaching out.


geoplot

geoplot's axis color don't change.

was able to get axis ticks, lines, and labels to change color.
still not able to get axis background to change (no editable property to my knowledge).


how to resolve the cross domain because of iframe?

when I use the normal   , the browser reports errors  because of the cross domain.
But your react-iframe doesn't exit this problem. can u explain that?

It's a magic in The Code . XD


ResDiff integration: Enabling deterministic sampling

Modulus Pull Request
Description

Checklist

[x] I am familiar with the Contributing Guidelines.
[x] New or existing tests cover these changes.
[x] The documentation is up to date with these changes.
[ ] The CHANGELOG.md is up to date with these changes.
[x] An issue is linked to this pull request.

Dependencies

Verified that test.sh runs fine with both deterministic and stochastic samplers.


Warning - System::setSecurityManager deprecated in Java 17

==================== Test output for //crypto/src/test/java/com/hellowd/crypto:Sha256Test:
WARNING: A terminally deprecated method in java.lang.System has been called
WARNING: System::setSecurityManager has been called by com.github.bazel_contrib.contrib_rules_jvm.junit5.ActualRunner (file:/private/var/tmp/_bazel_chulki/f3de409d11213140d88cb4bf7c678f64/execroot/__main__/bazel-out/darwin-fastbuild/bin/external/contrib_rules_jvm/java/src/com/github/bazel_contrib/contrib_rules_jvm/junit5/junit5-runner.jar)
WARNING: Please consider reporting this to the maintainers of com.github.bazel_contrib.contrib_rules_jvm.junit5.ActualRunner
WARNING: System::setSecurityManager will be removed in a future release
Failures: 0
================================================================================

.bazelrc
build --java_language_version=17
build --java_runtime_version=17
build --tool_java_language_version=17
build --tool_java_runtime_version=17
test --test_output=all

bazel info
java-runtime: OpenJDK Runtime Environment (build 11.0.6+10-LTS) by Azul Systems, Inc.
java-vm: OpenJDK 64-Bit Server VM (build 11.0.6+10-LTS, mixed mode) by Azul Systems, Inc.
release: release 6.0.0-pre.20211215.3

The junit5 runner prevents System.exit being called, which means that one test can't prematurely cause an entire test run to finish unexpectedly.
While the SecurityManager has been deprecated, there's no replacement yet. JEP 411 has this as one of its goals:

Evaluate whether new APIs or mechanisms are needed to address specific narrow use cases for which the Security Manager has been employed, such as blocking System::exit.

Since the replacement API has not yet been developed or implemented, I'm not quite sure what to do with this issue. Did you have anything in mind, @chulkilee?

Thanks @shs96c I found that info later in other projects.
I'm wondering junit5 itself can take options not to exit (upstream change). Otherwise.. probably we can just mention this to the doc. I used 6.0.0-pre.20211215.3  but apparently it could happen recent Java version with stable Bazel release.


F-Droid can't build - not RB

ref: https://monitor.f-droid.org/builds/log/com.starry.myne/9#site-footer
/LE: fyi https://gitlab.com/fdroid/fdroiddata/-/commit/de76cb1a0c45616ec0afcea093ced38f5f1a9c4d

Also 11 https://gitlab.com/fdroid/fdroiddata/-/commit/ef553af3b3a7c7102f9ee63cdc444dab93d5df7b
verification of APK with copied signature failed
Comparing reference APK to APK with copied signature...
Unexpected diff output:
Binary files /tmp/tmp9ao0125l/unsigned_binaries_com.starry.myne_11.binary/content/assets/dexopt/baseline.prof and /tmp/tmp9ao0125l/_tmp_tmp9ao0125l_sigcp_com.starry.myne_11/content/assets/dexopt/baseline.prof differ
Binary files /tmp/tmp9ao0125l/unsigned_binaries_com.starry.myne_11.binary/content/classes.dex and /tmp/tmp9ao0125l/_tmp_tmp9ao0125l_sigcp_com.starry.myne_11/content/classes.dex differ
diff -r /tmp/tmp9ao0125l/unsigned_binaries_com.starry.myne_11.binary/content/res/GM.json /tmp/tmp9ao0125l/_tmp_tmp9ao0125l_sigcp_com.starry.myne_11/content/res/GM.json
1,3362c1,3362
< {
<   "v": "5.7.8",
<   "fr": 24,
<   "ip": 0,
<   "op": 151,
<   "w": 1080,
<   "h": 1080,
<   "nm": "EMOJI_CORACAO",
...

Thanks for notifying,

Also 11 https://gitlab.com/fdroid/fdroiddata/-/commit/ef553af3b3a7c7102f9ee63cdc444dab93d5df7b
verification of APK with copied signature failed
Comparing reference APK to APK with copied signature...
Unexpected diff output:
Binary files /tmp/tmp9ao0125l/unsigned_binaries_com.starry.myne_11.binary/content/assets/dexopt/baseline.prof and /tmp/tmp9ao0125l/_tmp_tmp9ao0125l_sigcp_com.starry.myne_11/content/assets/dexopt/baseline.prof differ
Binary files /tmp/tmp9ao0125l/unsigned_binaries_com.starry.myne_11.binary/content/classes.dex and /tmp/tmp9ao0125l/_tmp_tmp9ao0125l_sigcp_com.starry.myne_11/content/classes.dex differ
diff -r /tmp/tmp9ao0125l/unsigned_binaries_com.starry.myne_11.binary/content/res/GM.json /tmp/tmp9ao0125l/_tmp_tmp9ao0125l_sigcp_com.starry.myne_11/content/res/GM.json
1,3362c1,3362
< {
<   "v": "5.7.8",
<   "fr": 24,
<   "ip": 0,
<   "op": 151,
<   "w": 1080,
<   "h": 1080,
<   "nm": "EMOJI_CORACAO",
...

This looks like json file for some Lottie animation, I'll have to check mappings.txt file of the last build to confirm though, but I'm not sure why this would cause issues 🤔

.json aside for 11 classes.dex and baseline differ, will need to diff them locally next
ref: https://f-droid.org/docs/Reproducible_Builds/#potential-sources-of-unreproducible-builds

.json aside for 11 classes.dex and baseline differ, will need to diff them locally next

Thanks, please update me if you find something which i could change to fix it, as i don't really havs much knowledge/experience of reproducible builds 😅

Here's the diff log:
Uploading my.zip…

Here's the diff log: my.zip

Thanks, but unfortunately I've no idea how to read/understand what went wrong using these logs, as i don't really know anything about reproducible builds. Can you link me some guide which i can read to check reproducibility of builds myself using whatever tool used by f-droid to ensure reproducibility.

As linked the base prof thing can be seen here: https://f-droid.org/docs/Reproducible_Builds/#potential-sources-of-unreproducible-builds
@linsui is the rest of the diff log a know type already?

Looks like only the java part is different.

@licaon-kter I've read your linked article but wasn't able to figure out what exactly was causing it, I'm using gradle 7.4.x so gradle issue as linked in that article shouldn't be a culprit, same goes for coreLibraryDesugaring as app doesn't uses core library desugaring, about windows newlines we've talked about and fixed it in app's yml file in f-droid data repository when i opened a RFP issue for the listing and timestamp related issue was also resolved around same time in the merge request. And other reasons about NDK and buildpaths etc aren't related here as for as i understand.

fyi https://gitlab.com/fdroid/fdroiddata/-/commit/3d4883f3635f24dffd49e6e2e48df91634548e24

@starry-shivam can you build an APK from commit: https://github.com/Pool-Of-Tears/Myne/commit/6f9af6d0be7744e19c048e509497b69fac7a0367 with these two as false? https://github.com/Pool-Of-Tears/Myne/blob/main/app/build.gradle#L37-L38

@licaon-kter here you go, I've uploaded it on mediafire as i couldn't find any ways to upload it here directly.

@licaon-kter here you go, I've uploaded it on mediafire as i couldn't find any ways to upload it here directly.

https://www.mediafire.com/file/ig9wjavyyylgda6/Myne-v1.8.0.apk/file
@licaon-kter here you go, I've uploaded it on some third party site as i couldn't fine any ways to attach file here directly.

Hello, any updates on this?

The baseline issue might be fixed as explained here: https://f-droid.org/docs/Reproducible_Builds/#potential-sources-of-unreproducible-builds
The rest is still in lottie.json:
myne1.log

Maybe you can sort it before it's packaged?

Maybe you can sort it before it's packaged?

Sort it like? It's basically a json file stored in the raw resource directory.

Oh, sorry, it's not a order problem. Maybe it's about the line end. Then we can fix it on our side.

Oh, sorry, it's not a order problem. Maybe it's about the line end. Then we can fix it on our side.

Nice! Btw since we're here, can anyone check why the screenshots for both of my apps this and GreenStash are kinda mixed up with old screenshots (which I've already deleted from fastlane directory long ago) Idk why it happens but it looks pretty weird..

I thought it's a known issue. But I don't know how to fix it.

We do know but not yet fixed :)

alright, not a big deal.

Trying 2.3.0
diff log: myne230.log
local APK (Java17): com.starry.myne_17.apk.zip (remove .ZIP extenstion)
upstream APK: https://github.com/Pool-Of-Tears/Myne/releases/tag/v2.3.0
@linsui @obfusk

Looks like broken resources: https://issuetracker.google.com/issues/287967713
Also one annotation in classes.dex, and newlines in META-INF/services/.
@licaon-kter the broken resources are on your end this time, and so are the windows newlines in META-INF/services/; that's really weird. Anything change in your setup?

@obfusk

Anything change in your setup?

Not that I know, and doesn't affect any other apps either. :shrug:

Ive rebuilt in another instance and my builds are repro between them
VM images rebuilt April 20 and June 30, fyi

Any updates on this?

2.6.0 is fine https://gitlab.com/fdroid/fdroiddata/-/commit/8dbf581aae28376a5ab70e7ad5ad51cb5877c739 :)

and again https://gitlab.com/fdroid/fdroiddata/-/jobs/6201720684#L4340
will add a diff asap

I think it was probably because of different API key in the github builds see https://github.com/Pool-Of-Tears/Myne/pull/114 i did that because apparently some people were using the publicly available API key to hit rate limits resulting in metadata not being loaded from time to time.

indeed, the only difference is the API key, in clear text :smile: :shrug:

Yes, but at least it's not publicly available on GitHub. If someone wanted it, they would need to go through the hoops of decompiling and finding it out. I'm perfectly fine with F-Droid using it though if it's somehow possible to pass it via F-Droid's build process, like I'm doing in my GitHub actions..

No, everything that is used to build the APK needs to be in "the open"
Yes, we can add it to the recipe: https://gitlab.com/fdroid/fdroiddata/-/blob/master/metadata/com.starry.myne.yml#L143
but then "If someone wanted it, they would need to go through the hoops of opening the recipe on Gitlab and finding it out."

Still better than being publicly available here on GitHub for anyone take and abuse it 🤷 can you give me some email address I'll email it to you, or if you have telegram please msg me at https://t.me/starryboi

At best we can add a base64 so that it won't be scraped easily.

We can see the key by comparing the apks, right? 🤣 There are libs that decrypting the key at runtime so it would be harder to extract it.

At best we can add a base64 so that it won't be scraped easily.

It'll be nice, thanks

yeah, I've already seen it :smile: ends in ...LgY yes?
What I don't know @starry-shivam where, how to inject it during build

yeah, I've already seen it 😄 ends in ...LgY yes?

Correct

What I don't know @starry-shivam where, how to inject it during build

You just need to push it inside local.properties, like here.

:tada: https://gitlab.com/fdroid/fdroiddata/-/commit/bcc9b00d0eea654f1caf200fd0d491b36e7a34d0

https://monitor.f-droid.org/builds/log/com.starry.myne/391#site-footer
Only the zip metadata is different.

https://monitor.f-droid.org/builds/log/com.starry.myne/391#site-footer
Only the zip metadata is different.

Weird, I didn't even make many changes in the latest release. You can check for changes here: https://github.com/Pool-Of-Tears/Myne/compare/v3.9.0...v3.9.1

Please test if you can still reproduce 3.9.0 apk.

You can build and sign it and compare it with the apk in release with diff.

You can build and sign it and compare it with the apk in release with diff.

I don't know which tool you use to compare apks. Should I just try to compare the SHA-256 hashes of both files or something like that?

Yes, the hash should be the same. If the hash is different, please also check the content of the apk with diff -r. You can use diffoscope to inspect it.

@linsui The hashes are different, but I think it is most likely because the GitHub build is compiled in a Linux environment with gradle directly, while the one I built is compiled with Android Studio on Windows 11. There must be different line endings (CRLF?), and Android Studio itself might do some extra stuff when archiving the APK file, though I'm not sure about that. However, diff -r didn't show anything useful, like what exactly are the differences, other than just indicating they are different.

Please unzip them then run diff -r. :) If you want to check the apk directly you can use diffoscope but I thought it's not available on Windows.

I checked the diff with Meld and it shows these three files which are present in the GitHub build of v3.9.0 but missing in the build I compiled just now with Android Studio. They seem to be some signing-related keys, though I’ve signed this build with the same signature that I use for the GitHub builds.

They are signature files. Hmmm, that shouldn't affect our reproducible build. Can you upload the unsigned apk here?

They are signature files. Hmmm, that shouldn't affect our reproducible build. Can you upload the unsigned apk here?

Sure, but it seems GitHub doesn't support uploading APK files in comments. I'll upload it somewhere else and share the link in a moment.

You can zip it.

You can zip it.

Oh, good idea. Here you go
Myne-v3.9.0.zip

Your build has other difference. I thought they are mainly caused by CRLF.

Your build has other difference. I thought they are mainly caused by CRLF.

Hmm, maybe. Still, I'm not really sure what exactly caused v3.9.1 to become unreproducible, especially considering I didn't even make any major changes between v3.9.0 and v3.9.1 like I usually do with other releases.

Yep, we also see this problem on other apps. It seems a toolchain is changed but we don't know what it is yet.

@starry-shivam ref: https://gitlab.com/fdroid/fdroiddata/-/issues/3299#note_1985568674
so around here, I guess: https://github.com/Pool-Of-Tears/Myne/blob/v3.9.1/.github/workflows/release.yml#L55 make it do apksigner sign --alignment-preserved true  ... (you are using some other external actions so not sure how to inject that in https://github.com/r0adkll/sign-android-release/blob/f30bdd30588842ac76044ecdbd4b6d0e3e813478/lib/signing.js#L66 )
eg. others have another setup like: https://github.com/ImranR98/Obtainium/blob/v1.1.13/.github/workflows/release.yml#L75

you are using some other external actions so not sure how to inject that in https://github.com/r0adkll/sign-android-release/blob/f30bdd30588842ac76044ecdbd4b6d0e3e813478/lib/signing.js#L66 )

Looking at the code, I don't think the GitHub Actions plugin allows users to pass additional arguments. I think I'll have to run APK signer manually. I'll try and see how it goes.

I've been trying to manually sign (#192), but I keep getting a "command not found" error. The error message isn't helpful because it doesn't specify which command has failed or the correct line number in the workflow file. I suspect it doesn't find the apksigner command, but the ANDROID_HOME environment variable seems to point to the correct path: /usr/local/lib/android/sdk. It would be great if someone could look at this and see if I'm doing something wrong. I'm not particularly good with GitHub Actions, which is why I was using a third-party plugin to get the job done.

ls: cannot access 'app/build/outputs/apk/release/app-release-unsigned.apk': No such file or directory

Based on the docs here: https://github.com/obfusk/apksigcopier#what-about-signatures-made-by-apksigner-from-build-tools--3500-rc1
I've updated the recipe instead: https://gitlab.com/fdroid/fdroiddata/-/commit/be7626377555aa92f37e9310a3e7b36bc04df195
feel free to star the Google issue https://issuetracker.google.com/issues/351408623

so https://github.com/Pool-Of-Tears/Myne/pull/192 can be closed

Based on the docs here: https://github.com/obfusk/apksigcopier#what-about-signatures-made-by-apksigner-from-build-tools--3500-rc1
I've updated the recipe instead: https://gitlab.com/fdroid/fdroiddata/-/commit/be7626377555aa92f37e9310a3e7b36bc04df195
feel free to star the Google issue https://issuetracker.google.com/issues/351408623

Wow thanks! I'll close that PR now.


Initial draft of satellite health data structure file.

Close #80

I'm thinking we should resolve #87 before this PR, as it makes more sense to specify the desired use case (albeit, specified via a user story) prior to specifying a structural/compositional requirement

Need to have conversation w ADS team to confirm units used for IMU (i.e., gyros, magnetometer) & IMU temperature


Getting error while quantizing data

I downloaded Obama's speech and its transcription, and put that into the data folder.
I used this data: https://drive.google.com/drive/folders/17mHURkxigU5cbmPkBOCWaxfaoNBn9hU0?usp=share_link
When I run the command
!python -m vall_e.emb.qnt data/your_data

I am not able to generate the other files, instead it stops running and shows me this output;
0it [00:00, ?it/s]

What could be the reason behind this? Is my data not in the correct format? PLEASE HELP!

@shivam017arora what was it?


Fix example parameters names

following to this commit: https://github.com/redhat-developer/parodos/commit/de70236616c349a1b7abaac04139bb52dff92b2f

I wonder why CI was green before this changes. Are we not checking correctly the result of the tests?

Not the simple workflow and the change in yaml workflows are not in there until it got merged.


Missing info on which directory role is required to perform a validation of the rules

Would be great to see which directory roles are required to perform the "Validate Rules" in the portal, since it's not working with just "Groups Administrator" role.

Document Details
⚠ Do not edit this section. It is required for learn.microsoft.com ➟ GitHub issue linking.

ID: 16bafb84-ba6f-71f3-c674-2a1a9cba6f83
Version Independent ID: f00b8319-0e21-c357-644c-dc68bd7751c9
Content: Validate rules for dynamic group membership (preview) - Microsoft Entra
Content Source: articles/active-directory/enterprise-users/groups-dynamic-rule-validation.md
Service: active-directory
Sub-service: enterprise-users
GitHub Login: @barclayn
Microsoft Alias: barclayn

@hharsunen
Thanks for your feedback! We will investigate and update as appropriate.

@hharsunen
Thanks for your feedback! We have assigned the issue to author who will provide further updates.

The least privilege role is "User Administrator", which I found from here and verified that is enough to verify the dynamic membership rules.

@hharsunen thank you for your submission. I've created a work item to update the article. #please-close


Upgrade to v.0.2.0 (prost 1h)

Checklist

[x] My branch is up-to-date with upstream/develop branch.
[x] Everything works and tested for Python 3.8.0 and above.
[x] I ran pre-commit checks against my changes.

Change logs

Upgrade chain from Prost 1d to Prost 1h
Minor config improvements

Need to update snapshotter API url (using staging link in settings for now).


Remove maven-antrun component as dependency

Currently open-metadata-implementation/adapters includes the antrun plugin as a dependency.
This causes it to be included in the jars/assemblies we ship, which is unnecessary
It needs declaring as a plugin only

This has already been fixed as part of our pom refactoring


Getting Started

Hello everyone, I'm new here and I have a lot of questions.

First, I'm trying to run the command $ ./bootstrap.sh -c config.json -p proxies.json but I get this error

ImportError: No module named futures

I don't know why, but the others commands can run, but there is no output to say if it works or not.
Next, where the data (from the twitter) will be saved? This is my config.json file

{
"apikeys": {
"i0mf0rmer01" :{
"app_key":"xYtnU1e4bvFNxoLYVdasBsAUPjkO",
"app_secret":"hTvAgGP83R3Z23ktFnabqxiUm2vkRkRStQcpzYm9MblzwFYD0kaI",
"oauth_token":"45737364-FhIYhGKmaWcIPjJLvutonrmjlFszykdgngrmNIObH6",
"oauth_token_secret":"7PcktvTDvQU37h1jYZEYJcjYFveanBBb33SQ5IkZYhGINX"
}
},
"redis_config": {
"host": "localhost",
"port": 6379,
"db": 0
},
"verbose": "True",
"output": "./data",
"archive_output": "./data"
}

There is no 'data' folder after I run a simple command like client.sh -c config.json -cmd CRAWL_FRIENDS -d 1 -dt "ids" -uid 45737364.
Thanks in advanced.

ImportError: No module named futures
You need to resolve this first.
Install futures with
pip install futures

I already did this.

Then it's not installed correctly. Python 2.7?
Run python, post the version number; then run import futures on the interactive command line to see if you get errors. If you do, then it's something with your python installation.

Yes, Python 2.7.
Still the error on the interactive command line.

Repull, just updated, new futures package changed from
import futures
to
import concurrent.futures


Contact details do not use autocomplete attribute

The various contact details inputs do not use the autocomplete attributes we recommend when asking users for their address, email or phone number

Duplicate of #20


Investigate a good testing story for testing github workflow change

Currently, we do not have a good way to test github workflow change. We always have to merge it in order to test it. We need to investigate a good test story for this.
Some related work that we may want to look into:
https://dev.to/byteslash/how-to-test-your-github-actions-locally-3830
https://github.com/nektos/act

https://adoptium.slack.com/archives/C09NLQQAV/p1669581516908649


How to make logins persist

Any ideas how I can make logins / cookies persist or maybe fill in a login form automatically?
Example:  webview seems like a great way to create tiny standalone versions of web apps similar to what Fluid.app does on a Mac however, once I've logged into a web app I want that login to persist so I don't have to login every time I use it.

@rosstimson I went a little Google and found a few links that can help you:

https://github.com/zalando/go-keyring
https://github.com/tmc/keyring

Search in Google

@Bleser92 Thanks for that.  Apologies, I thought maybe there was a way to do this with webview itself and that I was just missing something.  I've also realised it is already persisting on Mac, just not on OpenBSD where I don't have anything like gnome-keyring running.  Will look into alernative ways to ensure login when there is no keyring like service.

@rosstimson , quick follow-up question:

Will look into alernative ways to ensure login when there is no keyring like service

Figured anything interesting out on that matter, per chance?  =)

Any plans to persist sessions from within webview itself ? It would be really helpful.


⚠ Bofrost.ch has degraded performance

In 025ff54, Bofrost.ch (https://www.bofrost.ch) experienced degraded performance:

HTTP code: 200
Response time: 2251 ms

Resolved: Bofrost.ch performance has improved in 76adde5.


Sweep: add a code style: black badge to the readme.md

The readme contains badges for various properties of the repo.  Please add a badge to readme.md that shows that this repo uses the black formatter.

Checklist

[ ] README.md

• Add a new line after line 10 to insert the badge markdown.
• Add the following markdown code to insert the badge: [![Code Style: Black](https://img.shields.io/badge/code%20style-black-000000.svg)](https://github.com/psf/black)

the plan looks correct, please proceed


latency under load iperf error

 --- google ping latency under load ---
Packet Loss Under Load: 0.0%
Average RTT Under Load: 187.713 (ms)
Minimum RTT Under Load: 111.525 (ms)
Maximum RTT Under Load: 256.142 (ms)
RTT Std Dev Under Load: 42.515 (ms)
iperf3: error - unable to send control message: Connection reset by peer

 --- google ping latency under load ---
Packet Loss Under Load: 0.0%
Average RTT Under Load: 13.847 (ms)
Minimum RTT Under Load: 11.297 (ms)
Maximum RTT Under Load: 20.74 (ms)
RTT Std Dev Under Load: 2.701 (ms)
{'speedtest_ookla_download': 578.77356, 'speedtest_ookla_upload': 16.84809, 'speedtest_ookla_jitter': 8.005, 'speedtest_ookla_latency': 15.397, 'speedtest_ookla_pktloss': 0, 'speedtest_ndt7_download':<PHONE_NUMBER>0796345, 'speedtest_ndt7_upload': 19.084749348277708, 'speedtest_ndt7_downloadretrans': 0.0, 'speedtest_ndt7_minrtt': 6.937, 'google_packet_loss_pct_under_ul': 0.0, 'google_rtt_min_ms_under_ul': 111.525, 'google_rtt_max_ms_under_ul': 256.142, 'google_rtt_avg_ms_under_ul': 187.713, 'google_rtt_mdev_ms_under_ul': 42.515, 'google_packet_loss_pct_under_dl': 0.0, 'google_rtt_min_ms_under_dl': 11.297, 'google_rtt_max_ms_under_dl': 20.74, 'google_rtt_avg_ms_under_dl': 13.847, 'google_rtt_mdev_ms_under_dl': 2.701}

--- NETWORK MEASUREMENTS ---
iperf3: error - the server is busy running a test. try again later
--- google ping latency under load ---
Packet Loss Under Load: 0.0%
Average RTT Under Load: 14.425 (ms)
Minimum RTT Under Load: 11.389 (ms)
Maximum RTT Under Load: 20.451 (ms)
RTT Std Dev Under Load: 2.54 (ms)
iperf3: error - the server is busy running a test. try again later
@JamesSaxon how can we fix this?

Hey, I saw this one too.  My "gut" here is to just parse the message and drop iperf on "busy", so it fails gracefully -- i.e., if we have other speedtests or pings, we don't want to lose those.
The usual problem is just that two people are using the system at once.  Strictly speaking, that shouldn't happen (if we manage the cron jobs right), but it is bound to, in testing.
We could also open more ports on the server, so long as we are very confident that we have the capacity.  But obviously, that doesn't work if we are testing from your or Nick's ~gigabit connections.

This will be addressed primarily through a "precise" allocation of the measurement servers for each of the devices as suggested by @JamesSaxon.  As such, this becomes a task for cms.

This is being replaced by the new LuL tool.


CentOS 6.x support

Howdy,
This connector requires a newer version of autoconf that CentOS 6.x does not provide. Are there direct requirements that would keep this connector from using CentOS 6.x?
 ~/git/ModSecurity-apache ‹master› # ./autogen.sh
configure.ac:3: error: Autoconf version 2.68 or higher is required
configure.ac:3: the top level
autom4te: /usr/bin/m4 failed with exit status: 63
aclocal: autom4te failed with exit status: 63
autoreconf: aclocal failed with exit status: 63

Closing due the lack of response from the user.


How to use and What is the difference with GUI?

Hello. I normally use SRTranslatorGUI, but I am having some problems with it. It is not working smoothly. What is the difference between yours and GUI? When something is not working with GUI, does this mean there is something wrong with DeepL or Firefox that affects your version as well? And as I am a non-technical user, I could not manage to get your version to work. I have anaconda3 on my pc, how do I use your SRTranslator? Sorry for asking a lot, I am just trying to learn. Thank you for your great work.

Hey, the GUI is a wrapper around this library -I didn't make it so don't know details about its implementation-.
Errors on traslation could be cause of proxies, firefox, deepl, changes on the deepl page or this package, etc. GUI can have an outdated version of this package and is most probably the issue. Try to open an issue in @KryptoST package to fix it.
The easy way to use this package is from the command line (windows CMD). Just need to copy this (and change the path to the file and the source and target language)
python -m srtranslator ./filepath/to/srt -i en -o es
Check here for the supported languages and docs.

Hey, the GUI is a wrapper around this library -I didn't make it so don't know details about its implementation-.
Errors on traslation could be cause of proxies, firefox, deepl, changes on the deepl page or this package, etc. GUI can have an outdated version of this package and is most probably the issue. Try to open an issue in @KryptoST package to fix it.
The easy way to use this package is from the command line (windows CMD). Just need to copy this (and change the path to the file and the source and target language)
python -m srtranslator ./filepath/to/srt -i en -o es
Check here for the supported languages and docs.

Thank you so much for quick and detailed reply, and your patience. Best wishes to you.

Try to reinstall it, I made a mistake. It is fixed by now on version 0.3.1

I did what you had told me, but now I am getting: OSError: [Errno 22] Invalid Argument
or when I try to write the line like this: python -m srtranslator C:\Users...\Masaüstü\ID1099373.srt/to/srt -i en -o tr
instead of like this: python -m srtranslator ./C:\Users...\Masaüstü\ID1099373.srt/to/srt -i en -o tr
I am getting this error: FileNotFoundError: [Errno 2] No such file or directory.
What am I doing wrong exactly?

Try to reinstall it, I made a mistake. It is fixed by now on version 0.3.1

I did what you had told me, but now I am getting: OSError: [Errno 22] Invalid Argument
or when I try to write the line like this: python -m srtranslator C:\Users...\Masaüstü\lll.srt/to/srt -i en -o tr
instead of like this: python -m srtranslator ./C:\Users...\Masaüstü\lll.srt/to/srt -i en -o tr
I am getting this error: FileNotFoundError: [Errno 2] No such file or directory.
What am I doing wrong exactly?

dont mix \ with /

I am getting this error now.

sure that file/folder exists? seems like it doesnt

sure that file/folder exists? seems like it doesnt

I am sure it exists. I tried putting it directly into C folder, but the same error again...

did you put the extension in the filepath?

did you put the extension in the filepath?

Could you please explain what this means?
This is what I am writing:
python -m srtranslator C:/Users/mutta/Masaüstü/lll.srt/to/srt -i en -o tr

srt is a file or a folder?

srt is a file or a folder?

It is a file. Like this:

I am using Aegisub to edit it. That's why it's symbol is an eye.

Here is the file type:

python -m srtranslator C:/Users/mutta/Masaüstü/lll.srt/to/srt.srt -i en -o tr
need the .srt extension

I tried this, did not work again. The same error. 😐

Can't help you more beyond that. The issue is not this package, the system won't find that file -thats a python error, not srtranslator error-.
The path must be wrong or maybe the special characters in Masaüstü break it.

Hello, it's me again. I tried writing Desktop instead of Masaüstü, and I tried all of this with another pc as well, and it did not work again. Both pcs have anaconda3, and we both try to do this from there. Could this be an anaconda issue, if so what else I can use? I've read that phyton sometimes does not see system files or something like this, and tried the fixes they recommended, but it did not work again.

Additionally, can I use this in Google Colaboratory?

Okay, thank you so much for your answers.


[Improvement] Read shuffle data fail because read index file fail

Every commit calls must success when  sendCommit now, this will casue if one shuffle server dead, then application fail

We recommend users to use StorageType MEMORY_LOCALFILE_HDFS or MEMORY_LOCALFILE. The application won't commit data.

We recommend users to use StorageType MEMORY_LOCALFILE_HDFS or MEMORY_LOCALFILE. The application won't commit data.

So, should we remove LOCALFILE?

We recommend users to use StorageType MEMORY_LOCALFILE_HDFS or MEMORY_LOCALFILE. The application won't commit data.

So, should we remove LOCALFILE?

It's useful for test code. And if we want to reduce our shuffle server state, it's a good way to commit data although the LOCALFILE storageType don't have a good practice.  So I think we shouldn't remove it currently.

I found if use MEMORY_LOCALFILE, finishShuffle will not be called,  and buffer in server side may not flush in time, and than reader will fail because read index file fail. as follows
Error happened when get shuffle index for appId[application_xxx], shuffleId[3], partitionId[1], Can't find folder /HDATA/2/rssdata/application_xxx/3/1-1

I found if use MEMORY_LOCALFILE, finishShuffle will not be called, and buffer in server side may not flush in time, and than reader will fail because read index file fail. as follows Error happened when get shuffle index for appId[application_xxx], shuffleId[3], partitionId[1], Can't find folder /HDATA/2/rssdata/application_xxx/3/1-1

@xianjingfeng With current implementation, write shuffle data to N shuffle server can handle the situation about shuffle server failed. But it will cost N times storage.  User can make such choice.

We had set spark.rss.data.replica.write=2 and spark.rss.data.replica=3.But we found all shuffle server of a partition have not flush in time today and we have found in two applications. It may be easy to encounter when our cluster is not in high load.

We had set spark.rss.data.replica.write=2 and spark.rss.data.replica=3.But we found all shuffle server of a partition have not flush in time today and we have found in two applications. It may be easy to encounter when our cluster is not in high load.

what kind of storage type used in your case?

what kind of storage type used in your case?

MEMORY_LOCALFILE

@frankliee can you do more clarification about how to config  spark.rss.data.replica.write & spark.rss.data.replica.read ?

These configs are come from quorum protocol.
rss.data.replica is default replica number of partition.
rss.data.replica.write is the minimum replica that writer should write metadata and data successfully.
rss.data.replica.read is the minimum replica that reader should read metadata successfully (data can read from only one replica).
So the recommended values are (1,1,1) and (3,2,2).
These are client-side configs,  and will not change server-side state.
The flush is controlled by server configs, such as memory capacity and watermarks.

So, Is there a problem?

Fix by #213


Closes #626 | Create dataset loader for UniSent #626

Closes #626
Checkbox

[x] Confirm that this PR is linked to the dataset issue.
[x] Create the dataloader script seacrowd/sea_datasets/{my_dataset}/{my_dataset}.py (please use only lowercase and underscore for dataset folder naming, as mentioned in dataset issue) and its __init__.py within {my_dataset} folder.
[x] Provide values for the _CITATION, _DATASETNAME, _DESCRIPTION, _HOMEPAGE, _LICENSE, _LOCAL, _URLs, _SUPPORTED_TASKS, _SOURCE_VERSION, and _SEACROWD_VERSION variables.
[x] Implement _info(), _split_generators() and _generate_examples() in dataloader script.
[x] Make sure that the BUILDER_CONFIGS class attribute is a list with at least one SEACrowdConfig for the source schema and one for a seacrowd schema.
[x] Confirm dataloader script works with datasets.load_dataset function.
[x] Confirm that your dataloader script passes the test suite run with python -m tests.test_seacrowd seacrowd/sea_datasets/<my_dataset>/<my_dataset>.py or python -m tests.test_seacrowd seacrowd/sea_datasets/<my_dataset>/<my_dataset>.py --subset_id {subset_name_without_source_or_seacrowd_suffix}.
[ ] If my dataset is local, I have provided an output of the unit-tests in the PR (please copy paste). This is OPTIONAL for public datasets, as we can test these without access to the data files.

Hi @Gyyz, I would like to let you know that we plan to finalize the calculation of the open contributions (e.g., dataloader implementations) by 30 May, so it'd be great if we could wrap up the reviewing and merge this PR before then.

And also, I still get the errors for testing these subset_id: agt, bru, bth, bzq, bzi, ium, ivb, jra, khm, ksw, kxm, lao, lhu, wmm, mya, ntx, pww, sml, sxn, tha, urk, vie, zlm

Please make sure that you are using my original code with modifying the below, I didn't pass the split args to my function:
    name=datasets.Split.TRAIN,
    gen_kwargs={
        "filepath": os.path.join(data_dir),
        "split": "train",
    },)

And also, I still get the errors for testing these subset_id: agt, bru, bth, bzq, bzi, ium, ivb, jra, khm, ksw, kxm, lao, lhu, wmm, mya, ntx, pww, sml, sxn, tha, urk, vie, zlm

Please make sure that you are using my original code without modifying the below, I didn't pass the split args to my function as I didn't use this args:
    name=datasets.Split.TRAIN,
    gen_kwargs={
        "filepath": os.path.join(data_dir),
        "split": "train",
    },)

Sure, I don't modify your code at all before testing the code. How about in your end @holylovenia, can you pass the test with these subset_id?
python -m tests.test_seacrowd seacrowd/sea_datasets/unisent/unisent.py --subset_id unisent_agt
python -m tests.test_seacrowd seacrowd/sea_datasets/unisent/unisent.py --subset_id unisent_agt
python -m tests.test_seacrowd seacrowd/sea_datasets/unisent/unisent.py --subset_id unisent_agt
python -m tests.test_seacrowd seacrowd/sea_datasets/unisent/unisent.py --subset_id unisent_agt
python -m tests.test_seacrowd seacrowd/sea_datasets/unisent/unisent.py --subset_id unisent_agt
python -m tests.test_seacrowd seacrowd/sea_datasets/unisent/unisent.py --subset_id unisent_agt
python -m tests.test_seacrowd seacrowd/sea_datasets/unisent/unisent.py --subset_id unisent_agt

hi @holylovenia, may I know if you could handle this PR review (since all your prev comments have been addressed)? I'll help with this one if you won't be able to do that

I guess you should modify the encoding parameter in the open function to:
with open(filepath, "r", encoding="utf-8") as filein:

Using this, I get an OK response from tests.seacrowd and can load the dataset perfectly with the .load_dataset() method.
The issue is that when I run this data loader implementation on my Windows laptop, it doesn't always default to utf-8 encoding; whereas on Linux and MacOS, the default is utf-8.
To prevent future-encoding-error, I suggest adding an encoding parameter to the open method, @Gyyz.
This exact same error is similar to the issue I mentioned in my comment here.

After adding encoding parameter, still for these subsets --bzq, wmm, ntx, zlm it throws these errors:
FileNotFoundError: Couldn't find file at https://raw.githubusercontent.com/ehsanasgari/UniSent/master/unisent_lexica_v1/bzq_unisent_lexicon.txt
FileNotFoundError: Couldn't find file at https://raw.githubusercontent.com/ehsanasgari/UniSent/master/unisent_lexica_v1/wmm_unisent_lexicon.txt
FileNotFoundError: Couldn't find file at https://raw.githubusercontent.com/ehsanasgari/UniSent/master/unisent_lexica_v1/ntx_unisent_lexicon.txt
FileNotFoundError: Couldn't find file at https://raw.githubusercontent.com/ehsanasgari/UniSent/master/unisent_lexica_v1/zlm_unisent_lexicon.txt

I guess the _LANGUAGE naming for those subsets is still unaligned, you need to find the right subset for those particular language.

hi @holylovenia, may I know if you could handle this PR review (since all your prev comments have been addressed)? I'll help with this one if you won't be able to do that

Hi @sabilmakbar, thanks for offering! It'll be great if you can take over.

Hi @Gyyz, I would like to let you know that we plan to finalize the calculation of the open contributions (e.g., dataloader implementations) in 31 hours, so it'd be great if we could wrap up the reviewing and merge this PR before then.
cc: @muhammadravi251001 @sabilmakbar

After adding encoding parameter, still for these subsets --bzq, wmm, ntx, zlm it throws these errors:
FileNotFoundError: Couldn't find file at https://raw.githubusercontent.com/ehsanasgari/UniSent/master/unisent_lexica_v1/bzq_unisent_lexicon.txt
FileNotFoundError: Couldn't find file at https://raw.githubusercontent.com/ehsanasgari/UniSent/master/unisent_lexica_v1/wmm_unisent_lexicon.txt
FileNotFoundError: Couldn't find file at https://raw.githubusercontent.com/ehsanasgari/UniSent/master/unisent_lexica_v1/ntx_unisent_lexicon.txt
FileNotFoundError: Couldn't find file at https://raw.githubusercontent.com/ehsanasgari/UniSent/master/unisent_lexica_v1/zlm_unisent_lexicon.txt

I guess the _LANGUAGE naming for those subsets is still unaligned, you need to find the right subset for those particular languages. Find the language name on here.

Yes, not sure about the language name list, I got the list from #626, this is a list focus on South-east Asia Language, I think. I will make an intersect on both language name list and make another commit.

After adding encoding parameter, still for these subsets --bzq, wmm, ntx, zlm it throws these errors:
FileNotFoundError: Couldn't find file at https://raw.githubusercontent.com/ehsanasgari/UniSent/master/unisent_lexica_v1/bzq_unisent_lexicon.txt
FileNotFoundError: Couldn't find file at https://raw.githubusercontent.com/ehsanasgari/UniSent/master/unisent_lexica_v1/wmm_unisent_lexicon.txt
FileNotFoundError: Couldn't find file at https://raw.githubusercontent.com/ehsanasgari/UniSent/master/unisent_lexica_v1/ntx_unisent_lexicon.txt
FileNotFoundError: Couldn't find file at https://raw.githubusercontent.com/ehsanasgari/UniSent/master/unisent_lexica_v1/zlm_unisent_lexicon.txt

I guess the _LANGUAGE naming for those subsets is still unaligned, you need to find the right subset for those particular languages. Find the language name on here.

Yes, not sure about the language name list, I got the list from #626, this is a list focus on South-east Asia Language, I think. I will make an intersect on both  language name list and make another commit.

Yes, #626 has extra four language name.

After adding encoding parameter, still for these subsets --bzq, wmm, ntx, zlm it throws these errors:
FileNotFoundError: Couldn't find file at https://raw.githubusercontent.com/ehsanasgari/UniSent/master/unisent_lexica_v1/bzq_unisent_lexicon.txt
FileNotFoundError: Couldn't find file at https://raw.githubusercontent.com/ehsanasgari/UniSent/master/unisent_lexica_v1/wmm_unisent_lexicon.txt
FileNotFoundError: Couldn't find file at https://raw.githubusercontent.com/ehsanasgari/UniSent/master/unisent_lexica_v1/ntx_unisent_lexicon.txt
FileNotFoundError: Couldn't find file at https://raw.githubusercontent.com/ehsanasgari/UniSent/master/unisent_lexica_v1/zlm_unisent_lexicon.txt

I guess the _LANGUAGE naming for those subsets is still unaligned, you need to find the right subset for those particular languages. Find the language name on here.

@muhammadravi251001 @sabilmakbar @holylovenia problem fixed. Please check the latest commit.🎇🎇🎇

Is there any other feedback from you kak @sabilmakbar?


Running plotter locks up server

System specification:  2xE5-2690v1, 64G, plotting to RAID0 array SAS drives, Ubuntu Desktop 20.0.4
How to reproduce:  run plotter  with any number of threads specified(1-32)
Outcome:  Plotter runs and completes Table 1.   Shortly following this, all disk IO stops and the GUI freezes.  Server requires a hard power reboot.

do you use a ramdisk? if yes you probably running out of RAM

I do not.  I only have 64G.  I am plotting on 2 10k SAS drives.  one for temp1 and destination 1 for temp2

after table 1, cpu load will spike, maybe unstable RAM, power supply, CPU issue?

This appears to have been caused by a faulty RAID0 array.


fix(session): typo in switchGameAsync args

Task linked: CU-85ztvp2ap switchGameAsync has typo in arg list


expose SDL_UpperBlitScaled as blit_scaled

This matches the SDL header behavior. blit_scaled is a copy of upper_blit_scaled (users shouldn't incur any penalty if currently using upper_blit_scaled.)
resolves #328

Grand! Thanks for bumping the version, too.


Backscatterer has an expired certificate

The link to the backscatterer.org website results in a warning, because the certificate of the site has expired in 2018, which leads me to believe that the backscatterer.org website is dead.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 955d52db-5da8-5845-28ea-f78b2a85b688
Version Independent ID: 6dacde19-dfbf-4305-27b7-b0ecd3bcb9ac
Content: Backscatter messages and EOP
Content Source: microsoft-365/security/office-365-security/backscatter-messages-and-eop.md
Service: o365-seccomp
GitHub Login: @chrisda
Microsoft Alias: chrisda

@ildjarnisdead, the issue is nothing more than a global sweep through our content to replace 'http' links with 'https'. The backscatterer.org website is alive and well; they just appear to use http instead of https.
I also took the opportunity to edit the topic a bit (a lot, but it was short).
Thank for the feedback.


Follow naming convention

Feature request

What is the expected behavior?
This proposed change concerns only the naming convention and its standardization.
https://github.com/webpack/webpack/blob/master/lib/util/memoize.js#L24
It is proposed to shorten the comment and make it more clear
What is motivation or use case for adding/changing the behavior?
Follow standardized naming conventions
How should this be implemented in your opinion?
Something like avoid loitering would suffice
Are you willing to work on this yourself?
yes

No need issues for this, if you want change comment on something other just send a PR, no bugs/features here, thanks

No need issues for this, if you want change comment on something other just send a PR, no bugs/features here, thanks


#1093 Update GPG key for JAR signing

Type of Change

[x] Chore (changes to the build process or auxiliary tools)

Description
Up until this point all JAR releases were signed with my personal GPG key (see below). However, going forward this should be done with a GPG key specific to Hartshorn releases outside of my personal management.
This PR adds a SECURITY.md to explain the security policy around JAR signing. An important notice is that releases up to and including 0.5.0 are signed with the old key, and any releases after this point are released with a project-specific key.
Previous key
Key ID<EMAIL_ADDRESS>Fingerprint: CCC8 A24E D300 4EF6 22DE 752E F180 83C0 F99D 2EFB
Key size: RSA 4096
Date: 2021-11-11T18:13:20Z

Verification: https://keyserver.ubuntu.com/pks/lookup?search=CCC8A24ED3004EF622DE752EF18083C0F99D2EFB&fingerprint=on&op=index
Updated key
Key ID<EMAIL_ADDRESS>Fingerprint: 6F34 6237 5920 3A7C 0E97 1D9E 979A 72D9 DFAB F6A2
Key size: RSA 4096
Date: 2024-07-30T16:53:39Z

Verification: https://keyserver.ubuntu.com/pks/lookup?search=6F34623759203A7C0E971D9E979A72D9DFABF6A2&fingerprint=on&op=index
For additional verification, the updated key has also been signed with my personal key (previous active key)
Checklist

[x] I have performed a self-review of my own code
[x] Related issue number is linked in pull request title
[x] I have added documentation that describes my changes

Related Issue
Closes #1093

Dependency check failure accepted, caused by outage of remote service.


Feature/#18 implement dark mode

The following two issues have been improved

Session titles and participant names in the top bar are unreadable.
The notification "Please copy this link to the participant" is difficult to read.

Also, the background color when hovering the mouse cursor over a participant's name has been adjusted.
Sorry. I may have made a mistake in my pull request etiquette.

Thank you for the update! Since you updated the branch for your previous PR (that'd be PR #18 ) that PR was updated and your changes were merged along with it already, so everything is good to go 👍🏻
I'll close this PR as a duplicate


utilities.py: metadata bug in make_figs()

When calling make_figs(), an unrecognized argument error occurs at:
plt.savefig(
            os.path.join(target_dir, f"{figure_name}.jpg"),
            metadata={"CreationDate": None},
)

The matplotlib.pyplot.savefig documentation says metadata is currently not supported for .jpeg files. Commenting out the metadata argument stops the error and the figure is produced as expected.
Should metadata={"CreationDate": None} be removed from the JPEG savefig call until support is added in a later version of the package?

The reason for suppressing the CreationDate was that when the code gets run, even if the image part of a regenerated figure is bit-by-bit identical to the corresponding part of the former figure, if each of them is stamped with a different CreationDate git will declare that the files have changed.
Omitting the CreationDate from the metadata therefore enormously reduced the number of files that git identified as different.
If matplotlib has been modified to exclude the creation date and other metadata by default, this workaround to prevent it from including CreationDate should be no longer needed.
From: kennetheva @.>
Date: Monday, January 29, 2024 at 15:50
To: econ-ark/HARK @.>
Cc: Subscribed @.***>
Subject: [econ-ark/HARK] utilities.py: metadata bug in make_figs() (Issue #1375)
When calling make_figs(), an unrecognized argument error occurs at:
plt.savefig(
        os.path.join(target_dir, f"{figure_name}.jpg"),

        metadata={"CreationDate": None},

)
The matplotlib.pyplot.savefig documentationhttps://matplotlib.org/stable/api/_as_gen/matplotlib.pyplot.savefig.html says metadata is currently not supported for .jpeg files. Commenting out the metadata argument stops the error and the figure is produced as expected.
Should metadata={"CreationDate": None} be removed from the JPEG savefig call until support is added in a later version of the package?
—
Reply to this email directly, view it on GitHubhttps://github.com/econ-ark/HARK/issues/1375, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AAKCK74X7ZEOV766IUAMVHLYRADQ3AVCNFSM6AAAAABCQDEK5GVHI2DSMVQWIX3LMV43ASLTON2WKOZSGEYDMMZZGY3DQNA.
You are receiving this because you are subscribed to this thread.Message ID: @.***>

It might be better to use .gitignore to suppress version control over the jpegs entirely.

Matt,
As the original author of savefig, can you look into this?  I'm puzzled that a lot more examples have not cropped up.
Also, my preference would be that whenever a figure is saved, it gets saved in jpg, pdf, svg, and png forms.

Sure, but I don't actually remember writing it. Maybe it was just a very,
very long time ago?
On Fri, Feb 2, 2024 at 10:12 AM Christopher Llorracc Carroll <
@.***> wrote:

Matt,
As the original author of savefig, can you look into this? I'm puzzled
that a lot more examples have not cropped up.
Also, my preference would be that whenever a figure is saved, it gets
saved in jpg, pdf, svg, and png forms.
—
Reply to this email directly, view it on GitHub
https://github.com/econ-ark/HARK/issues/1375#issuecomment-1924075074,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ADKRAFNZGSCFSYCES7L6MGDYRT65TAVCNFSM6AAAAABCQDEK5GVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTSMRUGA3TKMBXGQ
.
You are receiving this because you are subscribed to this thread.Message
ID: @.***>

Well, I don't remember writing it either but as you say it was in a galaxy far far away so maybe I did.
I do remember adding some code to suppress metadata, but I think that that was in a version that saved all four kinds of figures automatically (jpg, svg, pdf, png) and I worked out how to suppress the metadata for all of them (because there would be no point in suppressing it for just one).
In any case, I'm puzzled that the problem has not cropped up for any of our REMARKs or other tests, so maybe none of them uses savefig.  Actually, @edmundcrawley, can you point Matt to the place in the HAFiscal-Latest code where the savefig command is invoked, so he can see the content (I've just invited him as a collaborator on HAFiscal-Latest; please let Matt know the name of the branch you've been testing against HARK 0.13 on.)

@mnwhite here is a minimal working example that shows the problem - that is probably easier than pointing you to the code in HAFiscal-Latest. Let me know if this doesn't work for you.
from HARK.utilities import make_figs
import matplotlib.pyplot as plt
import numpy as np
plt.figure()
plt.plot(np.linspace(1,5,40),np.linspace(4,8,40) )
make_figs('test', True , False, target_dir="C:/Downloads")
plt.show()
I get the error:
TypeError: print_jpg() got an unexpected keyword argument 'metadata'

Thanks @edmundcrawley , that was a perfect example. I've made a PR that fixes this in #1386 and will merge ASAP, then try to do a minor release.


Typescript error when extending from another base component

Bug report
Describe the bug
I have a component that extends from a base component, example:
const BaseText = styled("div", {
  fontSize: "$1",
  variants: {
    variant: {
      blueberry: {
        color: "$purple"
      }
    }
  }
});

const Text = styled(BaseText, {
  variants: {
    variant: {
      tomato: {
        color: "$tomato"
      }
    }
  }
});

<Text variant="tomato">tomato</Text> // ok
<Text variant="blueberry">blueberry</Text> // typescript error

But when using the Text component with the variant in the BaseText, it returns the following Typescript error:
No overload matches this call.

Shouldn't variants from the base component be inherited? It seems to be a Typescript error because it gets rendered correctly.
To Reproduce

Go to https://codesandbox.io/s/crazy-mcnulty-kjjri
Hover over variant in `blueberry
See error

Expected behavior
Don't display any Typescript error.
System information

Version of Stitches: 1.2.5

Additional context
One workaround that made the error go away was adding an empty variant with the same name of the base component into the composed component:
const Text = styled(BaseText, {
  variants: {
    variant: {
      blueberry: {}, // <----- variant from base component but empty
      tomato: {
        color: "$tomato"
      }
    }
  }
});

Is there another solution without having to replicate all the base variants like so?

This is a duplicate of #749 which is now fixed under a canary release.
could you please upgrade to the latest canary1.2.7-0 and test again?

Hi @hadihallak, just tested it with the 1.2.7-0 and also 1.2.7 version but still not working. Check out the same codesandbox at: https://codesandbox.io/s/crazy-mcnulty-kjjri


New release?

Hi @MaximBalaganskiy  would you please be able to run a new release to npm with the updates?

I’m on leave till 21st. Will release when get back

Published v2 with upgraded gridstack

A week early! A new release on your holiday, thank you!


Support naming contexts

This PR adds support for naming contexts, which uses TC_CLASSDESC instead of TC_PROXYCLASSDESC.
If a context is created without a specific context factory (eg: com.sun.jndi.ldap.LdapCtxFactory for LDAP), providing the rmi:// protocol will make the context to use the vulnerable [ub|re]bind... methods that you explain in the README.
You can quickly test using:
InitialDirContext ctx = new InitialDirContext();
ctx.bind("rmi://ermir", new Reference(""));

Thanks for your research and creating ermir!

Hi @jorgectf,
Thank you for the improvements, i will merge these changes once i get a chance to test them.

Hi @jorgectf,
I have completed the tests, i am merging these changes now, i will introduce a new commit to handle TC_CLASSDESC as it differs from TC_PROXYCLASSDESC, and also revert back the error message printing, currently all handle_OP method will just return the error string and the caller method will take care of it and bind should not differ. this is probably not the end of it, there might be other binds that cause other CLASSDESC, TC_REFERNCE maybe, I will try to add support for that later on.
Thank you again for the valuable contribution to Ermir!


kernel: work: check handler when submit to queue

Assert that the handler of a work item is not NULL when submitting it to the queue. This allows early detection when somewhere is submitting a non-NULL work with NULL handler to the work queue (where it happens), rather than right before the work item get executed in the queue (when it happens).
This will make sure that a work is initialized with k_work_init before getting submitted, as mentioned in the k_work_init API.
https://github.com/zephyrproject-rtos/zephyr/blob/db8855aaa3f32d3ba1f4e4e9066eb953c4406e25/include/zephyr/kernel.h#L3259-L3273
k_work_init will make sure that the work item has a valid handler:
https://github.com/zephyrproject-rtos/zephyr/blob/db8855aaa3f32d3ba1f4e4e9066eb953c4406e25/kernel/work.c#L134-L143
Fixes #63559

test_1cpu_drain_wait fails because the work item of test_drain_wait_ctx isn't intialized:
https://github.com/zephyrproject-rtos/zephyr/blob/d489ec087ed5a0b4a8c104e2f5fb9a302419d96b/tests/kernel/workq/work/src/main.c#L877
See:
https://github.com/zephyrproject-rtos/zephyr/blob/d489ec087ed5a0b4a8c104e2f5fb9a302419d96b/tests/kernel/workq/work/src/main.c#L858-L915
Haven't got time to look into what the test does, pulling back to draft for now

@fabiobaltieri, @jhedberg - kind of a subtle bug


Arbitrary values are not applied when using the @md:/@xs:/etc. container size classes

What version of @tailwindcss/container-queries are you using?
0.1.1
What version of Node.js are you using?
19.3.0
What browser are you using?
Microsoft Edge 112.0.1722.34
What operating system are you using?
Windows
Reproduction repository
https://github.com/revosw/tailwindcss-container-query-arbitrary-repro/tree/main
Describe your issue
Arbitrary values are not applied when using the @md:/@xs:/etc. container size classes.
StackBlitz repro link (Be sure to click "open in new tab" in the top right, or else images won't load and the example doesn't properly show the problem)
Expected:

Actual:

Hey! It's generating the CSS properly, the issue is you are using @container on the same element as @md:grid-cols-[300px_1fr]. Elements using container queries have to be descendants of a container.
Here's a version where it works, just by adding another element and hoisting @container up to that element:
https://play.tailwindcss.com/kBBag9d8Bd


Serializable SysOutputInfo

Overview
Makes SysOutputInfo serializable.
Details
By applying this change, we can serialize almost everything that the ExplainaBoard generates.
Following code is also deleted because it is no longer necessary:

Methods in SysOutputInfo to convert it to dict.
explainaboard/serialization/legacy.py

References

#446

Blocked by

NA

@neubig @pfliu-nlp It looks there is some failing tests (due to assertion around t-test), which is unexpected and may be a potential bug around the code, but it is somewhat hard to figure out the reason. Could you take a look at the errors?

@neubig @pfliu-nlp Fixed bugs. Please take a look at the changes.


Prevent throwing PHPStan internal error when analysing dynamic query with query plans

When using analyzeQueryPlans with dynamic query, I get a PHPStan inernal error

Internal error: Internal error: Incorrect table name '' in file foo.php

/** @var string $tableExpression */
$snapshotRows = $this->dbal->fetchAllAssociative("SELECT * FROM `$tableExpression`");

thx for reporting.
the problem is that the query-inference cannot work with queries which don't contain a table-reference (or a variable table-reference) in FROM.
we should make sure this doesn't error.. but we cannot do type inference/error checking for those cases.

Yes of course, I did not expect the type checking to work on this case, just not to fatal error

do you have a full stacktrace for me?

I was able to isolate and repro the error on mysqli.
next time please provide a proper backtrace and information about used reflector and phpstandba-bootstrap settings.
at best a reproducing repository or unit test would.
thanks for reporting

To be honest, I thought the error would be easier to deal with. I could have dug deeper and provided more specific information, but you solved the problem too quickly to give me time to react after your last message.
Thank you for your work :heart:

no worries. I was kind of suprised, that it was so hard to reproduce ;)

@staabm After updating to v0.2.50 I get a query error even without enabling the debug mode.

Query error: Incorrect table name '' (1103).

$rows = $this->dbal->fetchAllAssociative("SELECT * FROM `$tableExpression`");

@noemi-salaun thx for reporting. fixed with https://github.com/staabm/phpstan-dba/pull/456


Is it possible to run a driver/drivers in headless mode?

Hey @stevepryde,
It seems to me like a good library/crate/binary.
It is possible to pass any capabilities/settings to the webdrivers or at least have a custom default settings such as --headless arg for geckodrver or chromedriver?
I've played with the code in order to have it done but haven't succeeded :(
I was experimenting with the data here.
https://github.com/stevepryde/xenon/blob/91fef580287c438b43d3aacf545d5282e95f346f/src/server.rs#L248-L249
https://github.com/stevepryde/xenon/blob/91fef580287c438b43d3aacf545d5282e95f346f/src/session.rs#L113-L118
Thanks

I've had a look into this and confirmed that the headless flag is not working.
After some investigation I discovered that the goog:chromeOptions JSON is indeed sent with the alwaysMatch capabilities, so I'll need to update Xenon to pass those through.
The reason it strips some capabilities out there is because if we do the filtering ourselves in Xenon, we don't want chromedriver also doing its own filtering and deciding not to run the session we send to it.
It's easy enough to just pick out the goog:chromeOptions and moz:firefoxOptions keys and pass those through specifically, or alternatively I can try just passing through the alwaysMatch JSON verbatim and let it fail if the client does something wrong. The latter is probably the better option.

And confirmed that works if I pass through all of the capabilities verbatim.
I've pushed the fix to latest main branch so if you pull that and try again it should hopefully work. Let me know how it goes.
I have not tested the impact this has on filtering. We can address that later if there is an issue (perhaps we can strip out the browserName, browserVersion and platformName if we need to).

Also consider running via xvfb instead (see instructions at the bottom of the README) which allows you to vnc in and view the session if you need to.
Either way you would still need the above fix in order to pass through any other chrome/firefox options

I can confirm that after https://github.com/stevepryde/xenon/commit/3b106ec15d21448b9198f7a2e474e21c45e5b0cd headless works :+1:


Integrate SCARS into E2E tests

is this one done now?

revisit later - most likely we will move to whiteblock testing service and ditch the current e2e tests


Cannot set producer properties when initiating a producer

In RapidPlugin, we use 'fasten' package to build the python plugin. When we need to produce a larger message (> 1M), it always fails due to the default value of 'max_request_size=1048576' . To allow larger message, it would be good to be able to change producer properties when set up a producer.

Sorry for the late response. I missed out on this issue. Could you please open a PR with a fix?


No data in formatted log file

Hello,
My log file is full of formatted but empty lines like these :

[19/Mar/2023:13:20:06 +0000] "- - -" - - "-" "-"

[19/Mar/2023:13:20:28 +0000] "- - -" - - "-" "-"

[19/Mar/2023:13:20:44 +0000] "- - -" - - "-" "-"

[19/Mar/2023:13:20:44 +0000] "- - -" - - "-" "-"

Here is my log config in /etc/caddy/Caddyfile (in the global config block) :
log {
format formatted {request>remote_addr} - {request>user_id} [{ts}] "{request>method} {request>uri} {request>proto}" {status} {size} "{request>headers>Referer>[0]}" "{request>headers>User -Agent>[0]}" {
time_format "02/Jan/2006:15:04:05 -0700"
}
Is there something wrong with my config ?
Thank you!

It's format transform. See the README.

You're configuring non-access logs with an access-logger. Put the configuration within a site block so Caddy known to associate this logger with the access logs of the defined site. From the docs:

The differs from the log directive, which only configures HTTP request logging (also known as access logs).


chore(main): release 0.31.0

:robot: I have created a release beep boop
0.31.0 (2024-12-11)
Features

improve tera autocompletion (6c4f572)
show task description in sidebar (afc7e8b)

This PR was generated with Release Please. See documentation.

:robot: Created releases:

v0.31.0
:sunflower:


ffmpeg misdetection in Boot Logo tool

Version 3.11.3 Beta MacOS Arm Version installed from Releases dmg.
ffmpeg needs an additional lib that is not packaged in the dmg:
dyld[35865]: Library not loaded: /opt/homebrew/opt/sdl2/lib/libSDL2-2.0.0.dylib
  Referenced from: <C86404EB-DFC9-31A1-8E95-3F036091FC12> /Applications/DemonEditor.app/Contents/Frameworks/ffmpeg
  Reason: tried: '/opt/homebrew/opt/sdl2/lib/libSDL2-2.0.0.dylib' (no such file), '/System/Volumes/Preboot/Cryptexes/OS/opt/homebrew/opt/sdl2/lib/libSDL2-2.0.0.dylib' (no such file), '/opt/homebrew/opt/sdl2/lib/libSDL2-2.0.0.dylib' (no such file)
Abort trap: 6

This error is not detected because ui.BootLogoManager.init only checks for FileNotFoundError. I'd probably also check the output of ffmpeg -version for a plausible response.

Yes, I can confirm this.
Apparently last PyInstaller version does not collect this library to the package. Needs additional testing.

Replaced the binary from here and updated the ARM build. Please test.

That binary does the job.


Supervisor restart should allow for exponential backoff on retry

Is your feature request related to a problem? Please describe.
For some failure models, such as a client trying to connect to a server which is offline, the current supervision model will effectively loop { connect(); } over and over again, with no "safe" backoff on retrying the child.
Describe the solution you'd like
Ideally, I would like to specify an ExponentialBackOff strategy for my supervisor, such that when children hit failures, the process will not simply consume 100% CPU trying to retry the child.
backoff is an example implementation that works on arbitrary closures, which may be worth borrowing code or ideas from.
Describe alternatives you've considered
Me manually putting a thread sleep into the child doesn't seem like a good idea :smile_cat:

My temporary workaround is to add a map_err to my workers where I invoke connect (a predictable source of errors):
                let (mut socket, response) =
                    connect(Url::parse("ws://localhost:8000/ws/").unwrap())
                    .map_err(|e| {
                        error!("Failed to connect!");
                        sleep(Duration::from_secs(1));
                    }).expect("Can't connect");


Add tray options

Hi,
This is my first contribution to this project. if you allow, I would like to contribute with new improvements and features to this application.
I have added an option to keep the app running as a tray icon, so if the user wants to re-open the application to add new taskbar icons, it can be done more easily.
Let me know if you have any suggestions, you would like me to help with.
Happy new year ;-)!

I had taken a look at it and I am curious, for frmClient.resx, is there any way to use the resource files already in the project instead of using the base64 encoded version? I thought it most likely would make it a bit cleaner.

I had taken a look at it and I am curious, for frmClient.resx, is there any way to use the resource files already in the project instead of using the base64 encoded version? I thought it most likely would make it a bit cleaner.

Hi!
I'm glad you want to help with the project. The general idea seems great, but that .resx file is really an eyesore. So I'll second Pike's question above!
Happy new year!

Hi!
I'm glad you want to help with the project. The general idea seems great, but that .resx file is really an eyesore. So I'll second Pike's question above!
Happy new year!

Hi!
You are right, I have update my branch, by removing all those changes to the .resx file and maintaining the tray icon.
Glad to contribute :-D!

Hi!
You are right, I have update my branch, by removing all those changes to the .resx file and maintaining the tray icon.
Glad to contribute :-D!

Hello! I had recently built and tested it. I think it would be good to not add any more buttons/controls but rather use the native close function and cancel the input from that to close the window. It avoids hacky create parameter solutions to remove the existing exit buttons and simplifies the process.
private void frmClient_FormClosing(object sender, FormClosingEventArgs e) {
      Hide();
      trayIcon.Visible = true;
}

On top of that I think you should add a event to the tray icon so when its clicked, it can bring up the window automatically.
That is about it and this is a great idea! In the future I may look to support settings for the entire client to say turn off this feature but I am not sure currently how to handle such thing yet. Want to get a proper format going before adding any settings.

Hello! I had recently built and tested it. I think it would be good to not add any more buttons/controls but rather use the native close function and cancel the input from that to close the window. It avoids hacky create parameter solutions to remove the existing exit buttons and simplifies the process.
private void frmClient_FormClosing(object sender, FormClosingEventArgs e) {
      Hide();
      trayIcon.Visible = true;
}

On top of that I think you should add a event to the tray icon so when its clicked, it can bring up the window automatically.
That is about it and this is a great idea! In the future I may look to support settings for the entire client to say turn off this feature but I am not sure currently how to handle such thing yet. Want to get a proper format going before adding any settings.

Hi,
I have made a new approach of the "close to tray" feature.

Hi,
I have made a new approach of the "close to tray" feature.

Looks good but I have two concerns/suggestions currently that I can think of.
First the tray options seem to appear at the top left of my screen for some reason instead of above the application as the expected behavior is.
Second, I think the application should be launched when first ran instead of only opening in the tray. It takes more steps to open it which may hinder user experience.
Great work thusfar!

Looks good but I have two concerns/suggestions currently that I can think of.
First the tray options seem to appear at the top left of my screen for some reason instead of above the application as the expected behavior is.
Second, I think the application should be launched when first ran instead of only opening in the tray. It takes more steps to open it which may hinder user experience.
Great work thusfar!

Hi @PikeNote, thanks you,
Well pointed 👍. Fixed the top left screen tray menu.
For some reason in my machine was working fine, but when tested on a clean machine (without any previous installation), the issue was there.
Implemented the launch order you suggested, opening the app on first initialization and then on close put it in tray.
Next commit, I will implement the option to display/expand the window, when tray icon is double clicked.

Hi @PikeNote, thanks you,
Well pointed 👍. Fixed the top left screen tray menu.
For some reason in my machine was working fine, but when tested on a clean machine (without any previous installation), the issue was there.
Implemented the launch order you suggested, opening the app on first initialization and then on close put it in tray.
Next commit, I will implement the option to display/expand the window, when tray icon is double clicked.

Hi @PikeNote and @tjackenpacken.
Added some new commits, fixing some previous tray issues and adding the launch on tray click.

Hi @PikeNote and @tjackenpacken.
Added some new commits, fixing some previous tray issues and adding the launch on tray click.

Hi @PikeNote and @tjackenpacken.
Added some new commits, fixing some previous tray issues and adding the launch on tray click.

Hi!
I have been busy with some school assignments the past couple of weeks, but will have some more time now. Will try to look into your pull later today. Is your forked repository the latest release + your pull?

Hi @PikeNote and @tjackenpacken.
Added some new commits, fixing some previous tray issues and adding the launch on tray click.

Hi!
I have been busy with some school assignments the past couple of weeks, but will have some more time now. Will try to look into your pull later today. Is your forked repository the latest release + your pull?

Hi @tjackenpacken, no worries.
Yes the fork repo is update with you master branch and synced with my branch add-tray-options

Hi @tjackenpacken, no worries.
Yes the fork repo is update with you master branch and synced with my branch add-tray-options


Lint secrets case

Follow up https://github.com/woodpecker-ci/woodpecker/issues/3960#issuecomment-2395470285
Lints

Removed uppercasing all secret env vars, instead, the value of the secrets property is used

it might not work properly = you have to access it with the lower case name or change secret name in pipeline
Fixed message in b5cf0d0

?!? did we not move to case sensitive iand depricate the secret key as a whole ?!?

move to case sensitive

Yes, therefore the PR.

depricate the secret key as a whole

No, there was empty deprecation section in the code on main and of course no warnings in UI (when I tested and made the PR).

I don't think this is needed as we already will have warning in 3.0 about deprecated secrets section as whole


Use programming languages for primary color

Description
Make it possible to adjust a primary color of a tile to match a programming language of the block.
No matter how we determine the primary programming language, when it is picked, corresponding color should be used.
 The benefit is that files don't need to be specially prepared, just need to use a unique colors for the color that needs to be replaced
option 2: annotate all elements that need to be colorized using a class in SVG and create custom classes that style fill color for specific DOM nodes. Requires to use SVGs inline in HTML rather than as external file references.

Annotate all tile sets/tiles with which specific components need to be re-colored
Make use of language data to assign color to each individual block

Additional requirements
Figure out the mapping for most programming languages supported by SCC. Most likely use brand primary colors, maybe also record a secondary color as well.
In play-testing interviews players suggested using GitHub colors, it also seems that GitLab uses some language color maps as well.

Done in version 1.1


[bugfix] default channels should be appended not prepended

Consider the input config:
environments:
  defaults:
    steps:
      - conda:
          channels:
              - conda-forge
              - bioconda
              - defaults
  myenv:
    steps:
      - conda:
        channels:
          - r
          - conda-forge
          - bioconda
          - defaults

The previous implementation would prepend the default channels.  So conda requirements yaml for myenv would be:
name: myenv
channels:
          - conda-forge
          - bioconda
          - defaults
          - r

The bugfix keeps the order from the environment, and appends the default channels:
name: myenv
channels:
          - r
          - conda-forge
          - bioconda
          - defaults

Codecov Report

Merging #17 (956c616) into master (17ef593) will not change coverage.
The diff coverage is 50.0%.


Hella concise, hella impressive

I just tried building a very explicit clean store and this seems much more elegant!   Think I am going to build around this.  Hoping it's glitch free and doesn't simply not fire for some difficult to track reason which has happened on every single other lib I have tried.   So this is working well in practice?

I use it in a few production projects.
Even if you will find an issue, we hope to fix them as soon as possible.

Awesome.
Is it possible/easy to walk the dependency tree created between stores, computeds and subscribers?

Also your code and docs are so beautiful.  Great organization.


Clang-format command not found

I builded and got this error

Ow my bad,I was always running a clang-format for each build


Cache release/stemcell information

We should retrieve/cache stemcell information from the director in one-shot, and then parse the cached copy out via jq to determine if releases/stemcells are present.

Fixed in d5a6cb030


Website with mdbook

The mdbook is really good! I think it's perfect for the language reference.
As suggested by @aljazerzen , it would be great to get this onto GitHub Pages (or something similar). I can have a look at doing this at the weekend unless anyone is more familiar with it.
I'm also going to do some work to improve the content, which I haven't touched in too long! And some small things like links don't work any longer, which I can fix.

Yeah links need to be fixed.
Mdbook is real simple, because you just write markdown and add sidebar into SUMMARY.md. So the main thing here is the content. We have to document the language, how read function calls, that by in aggregate by is a named parameter. Essentially this: https://www.postgresql.org/docs/14/sql.html
(I'm always leaning on postgres for references and how they do things. It's just the database I know best)

Closed by https://github.com/max-sixty/prql/pull/282


Possibly false-positive UB in std::ptr::from_raw_parts for DST Types

Hello,
first and foremost: I'm not actually sure if this is a false-positive, intended behavior, or a Rust compiler bug. But I couldn't find any information otherwise, which is why I am opening an issue here.
Code example:
#![feature(ptr_metadata)]
#![feature(pointer_is_aligned_to)]

#[cfg(test)]
mod tests {
    #[repr(C)]
    struct DST {
        data: u32,
        dst: [u8],
    }

    struct AlignedData {
        _align: [u32; 0],
        data: [u8; 6],
    }

    #[test]
    fn wrong_dst_size() {
        let ptr = {
            static DATA: AlignedData = AlignedData {
                _align: [],
                // First 4 bytes for a single u32 value
                // Then 2 bytes for the dst
                data: [1, 2, 3, 4, 1, 2],
            };
            DATA.data.as_ptr()
        };
        assert!(ptr.is_aligned_to(4));
        let _dst = unsafe { &*std::ptr::from_raw_parts::<DST>(ptr, 2) };
    }
}

In this example, a reference to a dynamically sized type is created by using the std::ptr::from_raw_parts function to create a fat-pointer.
Miri is complaining in the following way when executing cargo miri test:
test tests::wrong_dst_size ... error: Undefined Behavior: trying to retag from <263939> for SharedReadOnly permission at alloc12[0x6], but that tag does not exist in the borrow stack for this location
  --> src/lib.rs:29:29
   |
29 |         let _dst = unsafe { &*std::ptr::from_raw_parts::<DST>(ptr, 2) };
   |                             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
   |                             |
   |                             trying to retag from <263939> for SharedReadOnly permission at alloc12[0x6], but that tag does not exist in the borrow stack for this location
   |                             this error occurs as part of retag at alloc12[0x0..0x8]

If I ignore the alignment and directly specify the data as an &[u8], I can get an even preciser error message:
test tests::wrong_dst_size ... error: Undefined Behavior: out-of-bounds pointer use: expected a pointer to 8 bytes of memory, but got alloc13 which is only 6 bytes from the end of the allocation
  --> src/lib.rs:31:29
   |
31 |         let _dst = unsafe { &*std::ptr::from_raw_parts::<DST>(ptr, 2) };
   |                             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ out-of-bounds pointer use: expected a pointer to 8 bytes of memory, but got alloc13 which is only 6 bytes from the end of the allocation

In my understanding, the size of the DST should be 6 bytes and not 8 bytes, right?
When reading about the type layout of repr(C) on https://doc.rust-lang.org/reference/type-layout.html#the-c-representation it states
"Finally, the size of the struct is the current offset rounded up to the nearest multiple of the struct’s alignment.".
I guess this is exactly what happens here, but is that the right behavior?
Just to give you an idea why I need this: I'm writing a device tree parser for a device tree which is put by QEMU in memory. I've defined the device tree similar to the DST struct in the example above (first fixed size header fields and then dynamically sized data at the end). However, the size of the data in memory is not a multiple of 4 which is why Miri complains about the error I got above.
I know I could solve that differently, however I feel like a DST Type is very neat and perfect for that use case.
In case this is really a bug, I would be glad to help provide a fix. But first, I want to clarify if this is a real bug or just intended behavior and I'm missing something.
Thank you for your time in advance!

DST is 4 byte aligned due to the u32 field. The size of a type is always a whole multiple of the alignment, so DST would be 4, 8, 12, ... bytes. Never 6 bytes as that is not a whole multiple of 4.

"Finally, the size of the struct is the current offset rounded up to the nearest multiple of the struct’s alignment.".
I guess this is exactly what happens here, but is that the right behavior?

If it's the documented behaviour then it is right that miri checks it. If you want to change documented behaviour then you'll need to do so on the rust repository. But that would need a lot of discussion first, which usually happens on https://rust-lang.zulipchat.com/
Though tbh I'm sceptical that this would be changed.

Alright, thank you for the clarification!


invalid memory address

Which version of the AzCopy was used?
10.6.0
Note: The version is visible when running AzCopy without any argument
Which platform are you using? (ex: Windows, Mac, Linux)
Windows10
What command did you run?
Note: Please remove the SAS to avoid exposing your credentials. If you cannot remember the exact command, please retrieve it from the beginning of the log file.
D:\LargeData\azcopy_10.6.0\azcopy_windows_amd64 list https://sameranalyticsg2prodncus.dfs.core.windows.net/Folder/2020-10-01_09-04-45 --machine-readable
What problem was encountered?
Other folders are able to list the file contents fine but one throws the following error:
panic: runtime error: invalid memory address or nil pointer dereference
[signal 0xc0000005 code=0x0 addr=0x0 pc=0xa8bf9a]
goroutine 1 [running]:
github.com/Azure/azure-storage-azcopy/cmd.(*blobFSTraverser).traverse(0xc000230080, 0x0, 0xc000004fe0, 0x0, 0x0, 0x0, 0x5, 0xc000067550)
/home/vsts/work/1/s/cmd/zc_traverser_blobfs.go:172 +0x98a
github.com/Azure/azure-storage-azcopy/cmd.HandleListContainerCommand(0xc0000b0100, 0x74, 0xd67605, 0xb18a00, 0xc000067540)
/home/vsts/work/1/s/cmd/list.go:159 +0x455
github.com/Azure/azure-storage-azcopy/cmd.init.11.func2(0xc0001fd180, 0xc000004160, 0x1, 0x2)
/home/vsts/work/1/s/cmd/list.go:65 +0x79
github.com/spf13/cobra.(*Command).execute(0xc0001fd180, 0xc0000040c0, 0x2, 0x2, 0xc0001fd180, 0xc0000040c0)
/home/vsts/go/pkg/mod/github.com/spf13/cobra@v0.0.3/command.go:766 +0x2b1
github.com/spf13/cobra.(*Command).ExecuteC(0x128f800, 0xc0000948c0, 0xc000149dc8, 0x40d06f)
/home/vsts/go/pkg/mod/github.com/spf13/cobra@v0.0.3/command.go:852 +0x2f1
github.com/spf13/cobra.(*Command).Execute(...)
/home/vsts/go/pkg/mod/github.com/spf13/cobra@v0.0.3/command.go:800
github.com/Azure/azure-storage-azcopy/cmd.Execute(0xc00007cf60, 0x19, 0xc00007cf60, 0x19, 0xc00007cfa0, 0x1f, 0x7fffffff)
/home/vsts/work/1/s/cmd/root.go:140 +0xd6
main.main()
/home/vsts/work/1/s/main.go:82 +0x3cb
I have been able to download the entire contents of the folder without problem but am unable to list the contents.
How can we reproduce the problem in the simplest way?
Unknown.  It is being run against a folder with proprietary data that can not be shared.
Have you found a mitigation/solution?  No

Also seeing this...
Using Ubuntu 20 on Windows 11 with WSL.

Seems like the encoding in my URLs is upsetting something...

Hi @fdlsnyder2 sorry for the late response. Are you still experiencing this issue?
If so, are the other dirs named similar to the one that's not listing correctly?

Hi @fdlsnyder2 I was not able to repro this in the latest releases. I will proceed to close this issue. Feel free to reopen if you're still experiencing the problem.


⚠ Samsung has degraded performance

In 1c9a0fb, Samsung (https://samsung.com) experienced degraded performance:

HTTP code: 200
Response time: 1881 ms

Resolved: Samsung performance has improved in 4a84c2a.