Adds ScheduledExecutorService for Polling the RSS feed

Description

This draft PR adds the Java ScheduledExecutorService to schedule reading the RSS Feed URL every 5 minutes. It is a draft to gather any feedback about using the Executor service.
Currently, the unit test is reading from a real RSS feed URL because storing the URL in local files under test/resources directory resulted in Invalid URI scheme file errors. Finding the fix for this is still underway.
DCO is failing, working on amending the commit messages.

Issues Resolved
#2081
Check List

[ ] New functionality includes testing.
[ ] New functionality has been documented.

[ ] New functionality has javadoc added

[ ] Commits are signed with a real name per the DCO

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

Codecov Report

Merging #2140 (1396509) into main (ce2e7af) will not change coverage.
The diff coverage is n/a.

:exclamation: Current head 1396509 differs from pull request most recent head 131aea3. Consider uploading reports for the commit 131aea3 to get more accurate results

@@            Coverage Diff            @@
##               main    #2140   +/-   ##
=========================================
  Coverage     93.95%   93.95%
- Complexity     1632     1633    +1
=========================================
  Files           204      204
  Lines          4729     4729
  Branches        378      378
=========================================
  Hits           4443     4443
  Misses          196      196
  Partials         90       90

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.


Temporarily pin azure-mgmt-loganalytics to 0.2.0

Python CI tests are failing because SkuNameEnum in the Azure SDK for Python, which is imported in log_analytics_workspace.py in the Azure CLI, no longer exists as of azure-mgmt-loganalytics 0.3.0.
To temporarily resolve this version conflict, I suggest we temporarily pin azure-mgmt-loganalytics to 0.2.0 so our CI tests will pass. Once the Azure CLI is updated to account for the changes made in azure-mgmt-loganalytics, we can unpin this.

Excellent!
Any idea why it chose to download 0.3.0 and not 0.2.0?  Is there a systematic fix we can apply?
what is it that causes azure-mgmt-loganalytics to be downloaded in the first place?  requirements.txt for the azure cli doesn't list it; https://github.com/Azure/azure-sdk-for-python/blob/master/shared_requirements.txt says azure-mgmt-loganalytics~=0.2.0, don't know what that means or how that file is used.

/azp refresh


Non-fatal: Null check operator used on a null value [SelectionOverlay._buildToolbar]

Steps to Reproduce
Unable to reproduce. Crash reported from firebase.
Expected results:
Should not crash.
Actual results:
Non-fatal Exception: io.flutter.plugins.firebase.crashlytics.FlutterError: Null check operator used on a null value. Error thrown Instance of 'Ria'.
#00 pc 0x4e0d8b com.agendaboa.app (SelectionOverlay._buildToolbar [text_selection.dart:984])
#01 pc 0x4e09bb com.agendaboa.app (SelectionOverlay._buildToolbar [text_selection.dart:979])
#02 pc 0x7df2bf com.agendaboa.app (_OverlayEntryWidgetState.build [overlay.dart:256])
#03 pc 0x916233 com.agendaboa.app (StatefulElement.build [framework.dart:4992])
#04 pc 0xbce33b com.agendaboa.app (ComponentElement.performRebuild [framework.dart:4878])
#05 pc 0x45778b com.agendaboa.app (StatefulElement.performRebuild [framework.dart:5050])
#06 pc 0xc5eb23 com.agendaboa.app (StatefulElement.update [framework.dart:4604])
#07 pc 0x807327 com.agendaboa.app (RenderObjectElement.updateChildren [framework.dart:3570])
#08 pc 0x8087db com.agendaboa.app (MultiChildRenderObjectElement.update [framework.dart:6460])
#09 pc 0xbce5cf com.agendaboa.app (ComponentElement.performRebuild [framework.dart:3570])
#10 pc 0x45778b com.agendaboa.app (StatefulElement.performRebuild [framework.dart:5050])
#11 pc 0xbbfdcf com.agendaboa.app (BuildOwner.buildScope [framework.dart:4604])
#12 pc 0x4fa18f com.agendaboa.app (WidgetsBinding.drawFrame [binding.dart:882])
#13 pc 0x4f99c3 com.agendaboa.app (RendererBinding._handlePersistentFrameCallback [binding.dart:378])
#14 pc 0x4f998b com.agendaboa.app (RendererBinding._handlePersistentFrameCallback [binding.dart:377])
#15 pc 0xbb99d3 com.agendaboa.app (SchedulerBinding._invokeFrameCallback [binding.dart:1175])
#16 pc 0xbb9927 com.agendaboa.app (SchedulerBinding.handleDrawFrame [binding.dart:1104])
#17 pc 0x33c107 com.agendaboa.app (SchedulerBinding._handleDrawFrame [binding.dart:1015])
#18 pc 0x33bfb7 com.agendaboa.app (SchedulerBinding._handleDrawFrame [binding.dart:997])
#19 pc 0x31370b com.agendaboa.app (_invoke [hooks.dart:148])
#20 pc 0x313da7 com.agendaboa.app (PlatformDispatcher._drawFrame [platform_dispatcher.dart:318])
#21 pc 0x313d5b com.agendaboa.app (_drawFrame [hooks.dart:115])
#22 pc 0x313ddb com.agendaboa.app (_drawFrame [hooks.dart:113])

Device details:
Brand:samsung
Model:Galaxy A20
Orientation: Portrait
RAM free: 471.73 MB
Disk free: 1.99 GB
Operating System
Version:Android 11
Orientation: Portrait
Rooted:No
Crash
Date:Feb 24, 2023, 3:30:12 AM
App version:3.7.3 (176)

Flutter doctor
Doctor summary (to see all details, run flutter doctor -v):
[✓] Flutter (Channel stable, 3.3.8, on macOS 12.6.3 21G419 darwin-x64, locale en-US)
[✓] Android toolchain - develop for Android devices (Android SDK version 33.0.0)
[✓] Xcode - develop for iOS and macOS (Xcode 14.2)
[✓] Chrome - develop for the web
[✓] Android Studio (version 2022.1)
[✓] VS Code (version 1.75.1)
[✓] Connected device (3 available)
[✓] HTTP Host Availability

• No issues found!

@rohansohonee1 Is this issue reproducible locally? If so, can you please share the output of flutter run -v?
And does it happen on other devices? Please also provide the percentage occurrence of the crash if any. Thanks!

@huycozy
I don't know the steps to reproduce this. For now it has crashed 3 times for 1 user using a Samsung.

Labeling the issue for the team's attention.

Same issue here and occurs on Android only.
Android 10~14, devices varies from Sony Xperia 1 III, IV, Samsung Galaxy Note10+, Xiaomi
Mi 11 Lite 5G, Google Pixel 7a etc.
Both Overlay.of(context) and Overlay.maybeOf will cause this problem.
I'm using flutter 3.16.5. Here is the crash report log.
Non-fatal Exception: io.flutter.plugins.firebase.crashlytics.FlutterError: Null check operator used on a null value
       at Element.widget(framework.dart:3474)
       at LookupBoundary.findAncestorStateOfType.<fn>(lookup_boundary.dart:171)
       at Element.visitAncestorElements(framework.dart:4857)
       at LookupBoundary.findAncestorStateOfType(lookup_boundary.dart:166)
       at Overlay.maybeOf(overlay.dart:520)
       at .showOverlay(overlay.dart:5)
       at startLiveHandsOn.<fn>(tutorial.dart:112)
       at TutorialCoachMarkWidgetState.build.<fn>(tutorial_coach_mark_widget.dart:106)
       at AnimatedFocusLightState._tapHandler(animated_focus_light.dart:130)
       at AnimatedPulseFocusLightState.build.<fn>(animated_focus_light.dart:385)
       at _InkResponseState.handleTap(ink_well.dart:1183)
       at GestureRecognizer.invokeCallback(recognizer.dart:275)
       at TapGestureRecognizer.handleTapUp(tap.dart:652)
       at BaseTapGestureRecognizer._checkUp(tap.dart:309)
       at BaseTapGestureRecognizer.handlePrimaryPointer(tap.dart:242)
       at PrimaryPointerGestureRecognizer.handleEvent(recognizer.dart:630)
       at PointerRouter._dispatch(pointer_router.dart:98)
       at PointerRouter._dispatchEventToRoutes.<fn>(pointer_router.dart:143)
       at _LinkedHashMapMixin.forEach(dart:collection)
       at PointerRouter._dispatchEventToRoutes(pointer_router.dart:141)
       at PointerRouter.route(pointer_router.dart:127)
       at GestureBinding.handleEvent(binding.dart:488)
       at GestureBinding.dispatchEvent(binding.dart:468)
       at RendererBinding.dispatchEvent(binding.dart:439)
       at GestureBinding._handlePointerEventImmediately(binding.dart:413)
       at GestureBinding.handlePointerEvent(binding.dart:376)
       at GestureBinding._flushPointerEventQueue(binding.dart:323)
       at GestureBinding._handlePointerDataPacket(binding.dart:292)


Buttons Not Showing in >6.0.8

Describe the bug
Buttons are not showing in >6.0.8.  When you click them they show...  They're transparent or white on white...
Initial view:

But can be clicked, and then show:

This was introduced in 6.0.9.  6.0.8 did not exhibit this behavior.  Validated the bug/behavior is in 6.0.10 also
Smartphone (please complete the following information):

iOS Version 14.4
SPPermissions version 6.0.10
Installed via Cocoapods

Fixed in 6.1.1.

ty!


open_mfdataset consumes significant memory with remote files

open_mfdataset consumes a large amount of memory when opening remote files. The following is a working example showing how loading five remote netcdf/hdf5 files that total about 2.3 GB consumes a total of about 1 GB of local machine memory. When the files are downloaded, the operation on these files locally consumes essentially no memory. Is this expected behavior?
import xarray as xr
url =<EMAIL_ADDRESS>files = ['deployment0001_RS03CCAL-MJ03F-05-BOTPTA301-streamed-botpt_nano_sample_20171201T180000-20171207T161702.750000.nc',
 'deployment0001_RS03CCAL-MJ03F-05-BOTPTA301-streamed-botpt_nano_sample_20171124T060000-20171201T175959.950000.nc',
 'deployment0001_RS03CCAL-MJ03F-05-BOTPTA301-streamed-botpt_nano_sample_20171116T180000-20171124T055959.950000.nc',
 'deployment0001_RS03CCAL-MJ03F-05-BOTPTA301-streamed-botpt_nano_sample_20171108T060000-20171116T175959.950000.nc',
 'deployment0001_RS03CCAL-MJ03F-05-BOTPTA301-streamed-botpt_nano_sample_20171031T180000-20171108T055959.950000.nc']
remote_files = [url + file for file in files]
ds = xr.open_mfdataset(remote_files, decode_times=False, decode_cf=False, chunks={'obs': 10000})

Output of xr.show_versions()

INSTALLED VERSIONS
commit: None
python: 3.6.4.final.0
python-bits: 64
OS: Linux
OS-release: 4.4.111+
machine: x86_64
processor: x86_64
byteorder: little
LC_ALL: en_US.UTF-8
LANG: en_US.UTF-8
LOCALE: en_US.UTF-8
xarray: 0.10.7
pandas: 0.23.1
numpy: 1.14.5
scipy: 1.1.0
netCDF4: 1.4.0
h5netcdf: 0.6.1
h5py: 2.8.0
Nio: None
zarr: 2.2.1.dev14
bottleneck: 1.2.1
cyordereddict: None
dask: 0.17.2
distributed: 1.21.4
matplotlib: 2.2.2
cartopy: None
seaborn: None
setuptools: 38.4.0
pip: 10.0.1
conda: 4.5.4
pytest: 3.6.2
IPython: 6.3.1
sphinx: None

The more I investigate this issue the less I understand about what is going on. I am going to close for now and reopen when I can provide more information about how this memory is getting consumed.


test: add full coverage

Full Coverage
This PR aims to bring a full-covered code by tests.
To do this I've made some changes to make the code more testable like: error handling and edge cases.
This PR is labeled as:
Choose only one and remember to select the label even on the right.

[ ] Feature
[ ] Bug
[x] Other

---------------|---------|----------|---------|---------|-------------------
File           | % Stmts | % Branch | % Funcs | % Lines | Uncovered Line #s
---------------|---------|----------|---------|---------|-------------------
All files      |     100 |      100 |     100 |     100 |
 constants.js  |     100 |      100 |     100 |     100 |
 dictionary.js |     100 |      100 |     100 |     100 |
 stdlib.js     |     100 |      100 |     100 |     100 |
 utils.js      |     100 |      100 |     100 |     100 |
---------------|---------|----------|---------|---------|-------------------

Thank you so much for your contribute @mateonunez!
I've made some edits in order to not bother you with them.
I've removed one of the tests, since it exposes a flaw that I've seen inside stringify function. I'll try to fix it in another PR.
Aside of this, I've added one more test for the compile function and started testing utils.
For this last one, I think it's needed a spy function for the process.exit()'s one...and this was the reason on why I've avoided the try/catch system on the cli's root file.
Hope you had fun with this and hopefully even a smile for this project. Thank you kindly!


remove username and password support

Based on #381 , must be merged after that merges
Now that we have private key authentication, there isn't much point in having username & password. Removing it simplifies a lot of stuff and makes the server not require a database anymore and be stateless.

I'm admin-merging this since it's blocking all other PRs. We can do an overall review/testing pass when we finish the current scope.


Authenticating using an AccessToken

Thanks for making such a great module!
Now that GDAP is used for accessing tenants, using the Secure Application Module, authenticating using a AccessToken directly would be very useful, I think. Any thoughts on that forward?

This feels like news to me, could you expand a bit on what you mean?

Sure :-)
I am thinking something similar to the Mg-module (Connect-MgGraph), where you can authenticate using the param -AccessToken
Having an AccessToken parameter, you can create the accessToken first, and then use that to connect directly, without the need for the Get-MsalToken used in the module. This gives the module more flexible ways to authenticating, f ex using the Get-AzAccessToken, or in my case, using a clientId, secret, tenantId and refreshToken to create an accesstoken. The last one is used when you have a multi-tenant app, and are a partner. I.e, I can connect to all tenants where I have permission (GDAP) without a login-prompt for every tenant I want to update an application for.
I tried quickly by adding two new functions described below, and it looks like it is working. I'll see if I can add this into the Connect-MSIntuneGraph.
Function Connect-MSIntuneGraphAccessToken {
[CmdletBinding()]
param (
[Parameter(Mandatory=$true)]
[string]
$AccessToken,
[Parameter(Mandatory = $true)]
[string]$TenantID,
[Parameter(Mandatory = $true)]
$ExpiresOn
)
$Global:AccessToken = $AccessToken
$Global:AccessTokenTenantID = $TenantID
Write-Verbose -Message "Successfully retrieved access token"

try {
    # Construct the required authentication header
    $Global:AuthenticationHeader = New-AuthenticationHeaderAccessToken -AccessToken $Global:AccessToken -ExpiresOn $ExpiresOn
    Write-Verbose -Message "Successfully constructed authentication header"

    # Handle return value
    return $Global:AuthenticationHeader
} catch [System.Exception] {
    Write-Warning -Message "An error occurred while attempting to construct authentication header. Error message: $($PSItem.Exception.Message)"
}

}
function New-AuthenticationHeaderAccessToken {
param(
    [parameter(Mandatory = $true, HelpMessage = "Pass the AuthenticationResult object returned from Get-AccessToken cmdlet.")]
    [ValidateNotNullOrEmpty()]
    [string]$AccessToken,
    [parameter(Mandatory = $true, HelpMessage = "Datetime when token expires")]
    [ValidateNotNullOrEmpty()]
    $ExpiresOn
)
Process {
    # Construct default header parameters
    $AuthenticationHeader = @{
        "Content-Type"  = "application/json"
        "Authorization" = $AccessToken
        "ExpiresOn"     = $ExpiresOn
    }

    # Handle return value
    return $AuthenticationHeader
}

}

If I'm understanding correctly, I second this.
Right now I have to authenticate separately in AzureAD in order to retrieve and assign groups to the apps - I'm thinking having an access token that can authorize all together without separate login prompts would be much better.

Have you tested with creating your own app registration, providing it with the required Graph API permissions to read e.g. groups/users etc from Entra ID, but also giving it the required Intune permissions to create Win32 apps? If you do that, you can authenticate this way:
Connect-MSIntuneGraph -TenantID  -ClientID  [-ClientSecret ]
For the multi-tenant purpose, I can see where that makes sense. Let me think about this a bit to see how I can modify the connect function.

If I'm understanding correctly, I second this.
Right now I have to authenticate separately in AzureAD in order to retrieve and assign groups to the apps - I'm thinking having an access token that can authorize all together without separate login prompts would be much better.

Yes, you can use the same AccessToken in e.g. the Mg-module to all the stuff the application have permissions to do.

thank you so much @jdarre for pointing this, i'm currently trying to find a solution for this, I'm currently working on an application that will publish Intune application on behalf of the user, and prompting user for login credentials not in the table and temporary token would be great in my case. I hope this will be implemented.
Tank you @NickolajA for this amazing module, i'm having a blast with it.


http_client_req() sometimes hangs when peer disconnects

Describe the bug
We have a multi-node system with some inter-node communication performed over https on ethernet.
In our system tests, we restart nodes and/or node software to test resilience and robustness.
Once in a blue moon when the http server node (or server software) restarts, the http client call to http_client_req() never returns. It hangs forever and blocks the thread.
To Reproduce
Reproduction is difficult. We run 10-hour system tests over night with thousands of http requests and hundreds of server restarts and the problem typically occurs only once or twice for each nightly run.
I have done some attemps at isolating the scenario and force it to occur more frequently but have so far not had great success.
Expected behavior
I expect http_client_req() to always return, at most timeout ms after being called.
Impact
Impact is pretty severe since all execution in the calling thread is stalled permanently.
Environment (please complete the following information):

The http client os is Zephyr 3.1.0 on STM32.
The http server os is Linux 5.4.84 on Freescale i.MX6.

We first hit this issue on Zephyr 2.7, updated to 3.1 to see if it was fixed, but alas, no.
Context
I know this can look like a hopeless ticket. I don't expect anyone to be able to read this and say "eureka, here's the fix". What I'm hoping for is input from people who know the networking code better than me and can discuss possible causes and point at where to dig deeper.

It sounds like a locking problem i.e., some part of the code is waiting a lock to release but it cannot be released as the thread cannot continue because of lock so a deadlock is seen. There is not much locking or anything else related to that in the http_client_req() API. I suspect that there might be still some tcp issue present.
Is your application doing anything related to locking when the http callback is called?
Are you able to attach a debugger to the stalled thread?

Once in a blue moon when the http server node (or server software) restarts, the http client call to http_client_req() never returns. It hangs forever and blocks the thread.

Can you try to get a stack trace when that happens?

@jukkar We have a mutex protecting data used in the call, but I fail to see how that could affect http_client_req(). We use the .response callback but it doesn't touch that mutex. I'll add logging to the response callback to see if that reveals any clues.
I am not currently able to attach a debugger to these systems.

Can you try to get a stack trace when that happens?

If we can think of a way to detect the hang and log the stack trace from another thread, then yes.
I am unfortunately currently unable to reproduce the issue under conditions where I have a debugger connected.

I added logging to the response callback, and it shows that the hang occurs prior to it.
Do we have any code for printing an arm stack trace in zephyr? I searched but didn't find anything other than the https://github.com/zephyrproject-rtos/zephyr/issues/4416  feature request. And CONFIG_EXCEPTION_STACK_TRACE seems to be x86 only.

Do we have any code for printing an arm stack trace in zephyr?

No, we don't. But if you are running with a debugger connected or attach a debugger once the hang happens you should be able to get the stack trace from any of the threads as long as your debugger has support for Zephyr (most do)
Can you try to produce a minimal reproducible sample and environment so that @rlubos can try and reproduce it locally?

Downgrading to low priority since we are currently unable to reproduce.

Closing due to inactivity. Please reopen if you can provide a simple reproducible setup.

I now have a scenario where I can repeat this problem and have been able to pinpoint the issue.
I connect a persistent TCP socket to a server on another physical machine and request http url /ping over it every 5 seconds. I then cut power to the server machine, thus leaving the socket up but in a peer-disconnected state. The next attempt to request /ping blocks longer than the timeout.
Specifically, at the end of http_client_req() it calls http_wait_data() which in turn calls zsock_recv(). This call blocks for a very long time if the socket peer is dead.
http_client_req() has a delayed worker that calls zsock_shutdown() on the socket when the timeout expires, but it doesn't work. zsock_recvfrom() already holds the socket mutex shutdown needs and so zsock_shutdown() can do nothing but block forever on k_mutex_lock.
Here is a log excerpt showing the sequence of mutex interactions after a call to http_client_req() with a 3000 ms timeout:
[00:00:27.694,000] <inf> http_request: > http_client_req /ping
[00:00:27.694,000] <inf> net_sock: lock 0x20007010 z_impl_zsock_sendto
[00:00:27.695,000] <inf> net_sock: lock 0x20007030 z_impl_zsock_sendto
[00:00:27.695,000] <inf> net_sock: unlock 0x20007030 z_impl_zsock_sendto
[00:00:27.695,000] <inf> net_sock: unlock 0x20007010 z_impl_zsock_sendto
[00:00:27.695,000] <inf> net_sock: lock 0x20007010 z_impl_zsock_sendto
[00:00:27.695,000] <inf> net_sock: lock 0x20007030 z_impl_zsock_sendto
[00:00:27.695,000] <inf> net_sock: unlock 0x20007030 z_impl_zsock_sendto
[00:00:27.695,000] <inf> net_sock: unlock 0x20007010 z_impl_zsock_sendto
[00:00:27.695,000] <inf> net_sock: lock 0x20007010 z_impl_zsock_recvfrom
[00:00:27.695,000] <inf> net_sock: lock 0x20007030 z_impl_zsock_recvfrom
[00:00:30.695,000] <inf> net_sock: lock 0x20007010 z_impl_zsock_shutdown

I have in my application implemented a workaround to this problem by setting sockopt SO_RCVTIMEO on the socket to the same as the timeout I pass to http_client_req().

I don't have permission to reopen the issue so I'll leave that to someone who does.

Ah, I forgot an important detail: The socket is a TLS socket.
This means each call goes through the vtable twice, and locks two mutexes. But the k_condvar_wait() in zsock_wait_for_data only releases the innermost mutex:
[00:03:12.438,000] <inf> http_request: > http_client_req /ping
[00:03:12.438,000] <inf> net_sock: mutex_lock 0x20007010 z_impl_zsock_sendto
[00:03:12.439,000] <inf> net_sock: mutex_lock 0x20007030 z_impl_zsock_sendto
[00:03:12.439,000] <inf> net_sock: mutex_unlock 0x20007030 z_impl_zsock_sendto
[00:03:12.439,000] <inf> net_sock: mutex_unlock 0x20007010 z_impl_zsock_sendto
[00:03:12.439,000] <inf> net_sock: mutex_lock 0x20007010 z_impl_zsock_sendto
[00:03:12.439,000] <inf> net_sock: mutex_lock 0x20007030 z_impl_zsock_sendto
[00:03:12.439,000] <inf> net_sock: mutex_unlock 0x20007030 z_impl_zsock_sendto
[00:03:12.439,000] <inf> net_sock: mutex_unlock 0x20007010 z_impl_zsock_sendto
[00:03:12.439,000] <inf> net_sock: mutex_lock 0x20007010 z_impl_zsock_recvfrom
[00:03:12.439,000] <inf> net_sock: mutex_lock 0x20007030 z_impl_zsock_recvfrom
[00:03:12.439,000] <inf> net_sock: condvar_wait 0x20007030 zsock_wait_data
[00:03:15.439,000] <inf> net_sock: mutex_lock 0x20007010 z_impl_zsock_shutdown

I'm glad to hear this is fixed in 3.3.

Ah, I forgot an important detail: The socket is a TLS socket.

Indeed, that would explain it then:
https://github.com/zephyrproject-rtos/zephyr/issues/54275
This one is not fixed yet, but I have it on my radar.

I'm not sure if anyone will see this on a closed ticked, but we just updated to Zephyr 3.3 and unfortunately this bug is still present.

I'm not sure if anyone will see this on a closed ticked, but we just updated to Zephyr 3.3 and unfortunately this bug is still present.

I was mistaken. My problem was #73580.


Delay generation for specific VpnScope(d) sub-components

Task/Issue URL: https://app.asana.com/0/488551667048375/1205997010028981/f
Description
Delay the sub-component generation only for the sub-components that need it. Not all of them
Steps to test this PR
Builds and smoke test the VPN/AppTP

Current dependencies on/for this PR:

develop

PR #3909   👈

This stack of pull requests is managed by Graphite.


Improved Handling of Shard Loss Scenario

What kind an issue is this?

[x] Feature Request.

Issue description
We use ES-Hadoop library in batch spark jobs which are scheduled every quarter hour to ingest data into ElasticSearch. The jobs are continually scheduled so that ingestion stream keeps coming in.
We've seen several cases where the cluster goes Red and then ingestion completely stops. Here is my understanding of this failure mode:

ES-Hadoop job sends a bulk request t, write to primary shard p1 of index i_20190923-13 is successful, but write to replica r1.1 and r1.2 haven't happened yet
ES detects the hardware issue, where p1 resides. And it tries to recover p1 from r1.1 and r1.2. ES can't find r1.1 and r.1.2 because replica writes haven't completed. Cluster marks this index index i_20190923-13 as red.
ES-Hadoop job sends next bulk request t+1, but cannot continue, because p1 got lost.
ES-Hadoop job hangs, until we execute reroute API call to p1 with accept_data_loss=true
No more Spark can get scheduled due to limited compute resource because these hung ES-Hadoop jobs are holding onto them

Feature description
So the key theme of my query to continue ingestion even when cluster is red.
Few ideas:

Set timeouts on Spark job, so next job in schedule gets started and creates new hourly indices (i_20190923-14) on a good hardware. We can make this as either built-in to ES-Hadoop library or as an outside watcher of Spark job.
Get acknowledge of replica write on bulk API calls to prevent problems of writes to active primary shard gets lost. There will be performance degradation.
ES-Hadoop job keeps track of bulk API calls that haven't completed replica writes. So that in this scenario when we lose primary shard p1 and have no replica r1.1 and r1.2, it creates a new empty primary shard p1 on a good hardware, then replay that bulk API  request t.

ES-Hadoop job hangs, until we execute reroute API call to p1 with accept_data_loss=true

This seems like a considerable bug. While the job is hanging, can you include a thread dump to help us debug this? We definitely should ensure that cluster resources on Hadoop/Spark aren't blocked up waiting on a failing write operation.

Few ideas:

I agree that we should always be looking for ways to improve our handling of failure scenarios, but a key thing to remember here is that these sorts of changes have ripple effects. Assume that ES adds the ability you suggest of waiting on at least some replication to complete before returning. Not only is this a performance degradation due to response time from the cluster for the original bulk request, but it is also now adding the expectation that ES-Hadoop does something with this information. As you suggest, we could hold on to the bulk request and retry it at a later time, but bulk requests from ES-Hadoop could be fairly large in size, and keeping them around to retry them later would be expensive.
Additionally, having ES-Hadoop perform administrative operations like allocating missing shards directly feels like the wrong direction here. accept_data_loss is one of those options that is meant to only be performed by an administrator of the system after very careful thought and understanding the ramifications of the action. Generally, Elasticsearch can be trusted to perform the recovery of missing shards on its own because it is aware of the full cluster state. If Elasticsearch does not see a way to perform a successful recovery of a missing primary (because of missing writes in the replica), then it is unlikely that ES-Hadoop would be able to do better, even if it has managed to keep track of write operations that it sees were not replicated.
The ES-Hadoop project has followed the mantra of retry where possible, allow for intervention where reasonable, but fail fast otherwise. I'd love to hear your thoughts on the matter (and to hopefully get some more info about the hanging jobs because that's no good).

Yes, I agree that spark job should fail fast. This failure is some what challenging to reproduce because it was caused by hard drive issue. I'll share the information as I gather more.

@danielyahn since there isn't much that is actionable in this issue, I'm going to go ahead and close it out. If you are able to send along any information about ES-Hadoop becoming unresponsive when trying to read from a red cluster, please open a new issue on here with that info and reference this issue in the new one for context. Thanks!


Unable to load ts-language-service plugin - RangeError

Trying to get a custom TS language service plugin up and running.

Related issue: https://github.com/Microsoft/vscode/issues/34276
But I need to use the workspace version of typescript.

VSCode Version: 1.23.1
OS Version: macOS 10.13.4

Steps to Reproduce:

Run git clone git@github.com:divyenduz/ts-vscode-graphql-plugin.git
Run cd ts-vscode-graphql-plugin, npm install, npm link, npm run build, cd ..
Run git clone git@github.com:divyenduz/ts-base.git
Run cd ts-base, npm install, npm link ts-vscode-graphql-plugin, npm run build
Run code ., go to src/index.ts,and use the typescript workspace version from ts-base as suggested here

The output logs for "TypeScript" yields the following error:-
RangeError: out of range index
    at ProtocolBuffer.tryReadContent (/Applications/Visual Studio Code.app/Contents/Resources/app/extensions/typescript-language-features/out/utils/wireProtocol.js:74:21)
    at Reader.onLengthData (/Applications/Visual Studio Code.app/Contents/Resources/app/extensions/typescript-language-features/out/utils/wireProtocol.js:100:41)
    at Socket.Reader.readable.on (/Applications/Visual Studio Code.app/Contents/Resources/app/extensions/typescript-language-features/out/utils/wireProtocol.js:87:18)
    at emitOne (events.js:96:13)
    at Socket.emit (events.js:191:7)
    at readableAddChunk (_stream_readable.js:178:18)
    at Socket.Readable.push (_stream_readable.js:136:10)
    at Pipe.onread (net.js:560:20)

Notice that this error does not occur if I misspell the name of the plugin in tsconfig.json.

Does this issue occur when all extensions are disabled?: NA

I already also tried the "relative path" way to load the plugin as documented here but nothing happens and the plugin is not loaded.

P.S. I am also able to replicate this on the insiders version of VSCode: 1.24.0-insider

Here is my tsserver.log which states that the extension loaded properly:-
https://pastebin.com/vEf21re8

This is because you are writing to stdout (console.log). This is how the tsserver talks to vscode.
Instead, use the TS server logging methods for logging


fix: Prevented the app from crashing when a non-implemented character is entered.

Fixes #97
Changes: The app does not crash when a non-implemented character is previewed and a toast is shown.
GIF for the change:

@iamareebjamal @adityastic please review.

@liveHarshit is it alright now?

@iamareebjamal please review.

You know the types, there are objects in Java, why would you return List of ANy type

@iamareebjamal please review.

@iamareebjamal changes made. Please review.

Please merge the pr if it is alright @iamareebjamal

Resolve conflicts

@iamareebjamal we cannot break here. If the string is like "^efjjih" and "^" is the unimplemented character, rest of the characters also won't be displayed if break is placed in the else section. We have to allow the loop to run through the whole string such that the implemented characters can at least be displayed.
I have resolved conflicts.


Better numerical testing

This branch starts off by refactoring the overall testing logic, and moves to specific testing improvements.

The last commit will drop the code coverage to the correct value.


Local custom tool-calling support

Enabled support for local custom tool-calling by:

Realizing that for remote the response from the model is something like: [createCalendarEvent(title='Dental Appointment', description='Follow up for dental appointment', startDate='2024-12-10', endDate='2024-12-10', startTime='17:00', endTime='17:00')]"
Based on this, parsing the toolName (createCalendarEvent) and the remaining arguments and constructing a ToolCall that is passed into the CompletionMessage
Separating the inferenceChatCompletionResponse creation into a separateResponseUtil.kt file.

Test:
https://github.com/user-attachments/assets/d6b2fc51-8cd9-47f1-84e1-2fe0d3b57f71

@cmodi-meta For the testing, I would suggest you build another custom function and see if the model output format is rather consistent.

@cmodi-meta For the testing, I would suggest you build another custom function and see if the model output format is rather consistent.

I did test this with multiple custom tool calling and it worked well so I think this should be ok
(example: create a calendar event for 5pm today for a dr appointment and another calendar event at 7pm today for a dinner)


typo / global leak

cleaned is set to null instead of the intended cleared
https://github.com/aguirrel/ng-currency/blob/master/src/ng-currency.js#L46

Hi! you are right! it's even a useless piece of code becouse it was already defined at https://github.com/aguirrel/ng-currency/blob/master/src/ng-currency.js#L32
Thanks a lot!

Agreed, which is probably why it not being set to null -- because of the typo -- was never an issue. Glad I could help!

clicked wrong button :wink:

Please, update to version 0.7.14 or 0.8.4 depending on you angular version. Thank you!


[10.x] QueriesRelationships new method withCountWhereHas added

Description:
This pull request introduces a new method, withCountWhereHas, to the Builder class. The method allows for subselect queries to count relations when they are not null, eliminating the need to duplicate the callback for whereHas and withCount when used together.
Changes Made

Added the withCountWhereHas method to the Builder class.
The method combines the functionality of whereHas and withCount in a single method call.
The provided callback is automatically applied to the subquery for count constraints.

$condition=function($query){
    $query->where('name','like','%a%');
};
\App\Models\Post::query()
    ->whereHas('tags',$condition=function($query){
        $query->where('name','like','%a%');
    })
    ->withCount('tags',$condition)
    ->get();

if this PR is merged then we can write like this
//with callback
$callback=function($query){
    $query->where('name','like','%a%');
};
\App\Models\Post::query()
    ->withCountWhereHas('tags',$callback)
    ->get();

//without callback
\App\Models\Post::query()
    ->withCountWhereHas('tags')
    ->get();

Benefits:

Reduces code duplication and improves code readability.
Provides a more streamlined and concise syntax for querying relationships with count constraints.

Thanks for your pull request to Laravel!
Unfortunately, I'm going to delay merging this code for now. To preserve our ability to adequately maintain the framework, we need to be very careful regarding the amount of code we include.
If possible, please consider releasing your code as a package so that the community can still take advantage of your contributions!
If you feel absolutely certain that this code corrects a bug in the framework, please "@" mention me in a follow-up comment with further explanation so that GitHub will send me a notification of your response.


page not working

Challenge Name

Issue Description

Browser Information

Browser Name, Version:
Operating System:
Mobile, Desktop, or Tablet:

Your Code

Screenshot

hi @anookeen kindly provide details of the issue you have been facing. I am closing this issue for now, Feel free to re-open it with more details (or just comment below with details of your issue; yes, you have to type down what exactly is not working for you).


deploy prometheus in dev/test space for tests

This is needed to aggregate metrics from all global services being tested to standardize the metrics ingestion, and provide api functionality for tests relying on metrics comparison for validation.
example:
https://github.com/wmo-im/wis2-gdc/blob/main/docker-compose.yml#L63-L70

@antje-s

gm.wis2dev.io exists and is already fetching all metrics from Global Services.


chore(.NET): deps

Issue #, if available:
Description of changes:
Squash/merge commit message, if applicable:
By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

Late to the party, but +1 as well.


DOC: update documentation to reflect v0.1.0 functionality

Documentation: the current documentation is out of sync with the code base, since it was not updated simultaneously. But with a new release, the docs should ideally be correct and up-to-date.
Many new illustrations relevant for the docs are available here: https://github.com/jsheunis/ohbm-2022. And a set of tutorials/primers is also available here: https://github.com/datalad/tutorials/tree/master/notebooks/catalog_tutorials
There are also missing content in the docs: the full API should be added to the docs, and a few new items should be included/expanded (Examples, Design, Contributing).
TODO:

Bring sections in line with latest functioning of datalad catalog (drawing from the ):

[x] Overview
[x] Installation
[x] Pipeline description

Add content to sections:

[x] Usage
[ ] Examples
[ ] Design
[x] Contributing
[x] Example pipeline: publishing and updating

[x] Create autogenerated API reference
[x] Create autogenerated command line reference

I noticed that the datalad catalog also doesn't have examples, maybe we find time to add those, too.

I would propose that we get rid of the "Examples" page of the docs. I think between what is included in the "Usage" page (#143)  as well as the examples provided in the command line reference, that this is enough. Thoughts @jsheunis?

Pages removed in https://github.com/datalad/datalad-catalog/pull/230. Closing here.


Fix handling of resource management

By default if resource limits are not set they will be set to zero:
https://github.com/kubernetes/kubernetes/blob/master/pkg/kubelet/api/v1alpha1/runtime/api.pb.go#L1118
what causes a try to create VM with zero vcpu set:
libvirt_1  | 2016-10-05 08:47:48.169+0000: 5905: error : virDomainDefParseXML:15299 : internal error: CPU IDs in <numa> exceed the <vcpu> count

Very good catch and the cause why my branch is failing after rebase :)
For dev purpose will hardcode some values there until You will provide PR with correct resolution.

Committed fix is temporary workaround

@jellonek @nhlfr
Want to share my considerations re cpu resource management:
So for resource management k8s have

optional settings for CFS (Completely Fair Scheduler):
- quotaPeriod
- cpuPeriod
These put limits for i/o bandwidth limits, not cpu resource usage itself.

and sharesPerCPU - relative value to set weighted share of available cpu resources for VM
which is set by defualt to default=2 (1 cpu = 1024)

So, then, for example nova has cpu overcommitment ratio set as 16:1 => VMsPerHost = numCPUs*16
But for virtlet wihout setting sharesPerCPU directly it would be as 512:1, which is obviously is not acceptable at all.
There could be added limits per namespace, then default will be set to limit if there is no request for pod, but we can't rely on that. Such low default is probably unexpectable for us, to have the same ratio
we need to have 64. Probably, we need to try to propose having kubelet option for that, WDYT?
So for now I'm going to prepare patch which will set all available vCPUs for each VM with defined CPU Tuning tag eith specified shares. As long as nothing is set, cpu time will be, obviously, spreaded equally among VMs, there will be problems if we start to set "requests" for cpu for some of VMs and use defaults for others, and ofcource if we overload the host by amount of created VMs, but for now it's POC, right? :) Do you agree with that?

Sorry for not answering earlier - idea looks great and I like your implementation of it :)

As it's already merged - closing.


Replaced cglib with ByteBuddy

Removed cglib dependency and added ByteBuddy in killbill-jdbi module.
Removed MethodProxy from Handler interface and updated all the classes that have implemented this interface.
Updated SqlObject methods to make use of ByteBuddy instead of cglib for objects creation.
Deleted CGLIBDispatchBuilder and its unit test class as it is not in use anymore.

@vnandwana Could you merge master into your branch to pick-up https://github.com/killbill/killbill-commons/commit/4b8d8e647b8028076b5e74cdc27170bda50ca029? That way, CI will run.
Thanks!


UI Improvements

Description
The VEDA team has conducted user interviews and gathered some feedback on the initial prototype of STAC admin: https://github.com/NASA-IMPACT/veda-backend/issues/304. Although this feedback is fairly high level, we could use it to guide certain features for an upcoming STAC-admin release.
Some features requests include:

Ability to create a new collection with required fields (mandatory) + additional fields. Identify which are required field and which are optional.
Edit all the fields that are present in a collection/item (not just a subset)
Ability to apply a change to all collections/all items in a collection or a select list of collections. For example for things like stac-extensions or license or renders.colormap_name
License field should be a dropdown of all the valid values
Validation of fields (ex - url provided is valid and returns a 2XX response; if stac-extensions is provided, check the schema validity)

PI Objective
Objective DS-2: STAC Admin NASA-IMPACT/veda-architecture#454
Acceptance Criteria

[ ] UI improvements are available in updated release of STAC Admin

@smohiudd Hi, my search query on Google "UI STAC catalog creation" was leading me to this repository.
I am also looking for a way to create catalogs, collections and items using the web UI.
Your project seems to be pursuing this goal.
I am just curious why not just extending the https://github.com/radiantearth/stac-browser?
Furthermore, I guess you are reimplementing every field from the JSON schema into your UI. That means custom metadata fields will never be part of your UI, or am I wrong?
I was thinking why not just using JSON forms to build the UI out of the official JSON schema.
What do you think about this?

Great to hear about your interest. We are currently moving this project forward in the context of the NASA VEDA and the ESA EOEPCA+ projects. Some details about our plans and ongoing work are in project-related repositories and docs here: https://eoepca.readthedocs.io/projects/resource-discovery/en/latest/design/resource-admin-ui/design/
I will try to cross-link relevant issues into this repo, so our ongoing work is easier to discover for people who stumble over this project, like you did.

I guess you are reimplementing every field from the JSON schema into your UI

We decided against implementing JSON schema. Here are some details about that decision:

https://github.com/EOEPCA/data-access/issues/57#issuecomment-2268146806

That means custom metadata fields will never be part of your UI, or am I wrong?

We are planning to implement a lightweight plugin system for STAC Admin that can be used to enable support for non-required fields such as custom properties or STAC extensions. See details about that here:

https://github.com/EOEPCA/data-access/issues/73

I am also looking for a way to create catalogs, collections and items using the web UI.

We do not currently have plans to support Catalog creation, only Collection and Item CRUD.

Thanks for reaching out @tjaeuth! And thanks for the info @j08lue.
To answer this question:

I am just curious why not just extending the https://github.com/radiantearth/stac-browser?

STAC browser serves a powerful use case for searching catalogs and may not be the best interface for editing granular metadata without changes to that UI. It may not be appropriate to conflate STAC viewing and editing in this case.


Strange line in test_summary.csv

In test_summary.csv we have cranelift/zkasm_data/spectest/i32 and cranelift/zkasm_data/spectest/i32/ lines with different results. Is it a bug?

@akashin, can you take a look please

Yes, this should fix it: https://github.com/near/wasmtime/pull/123


fix: change bg color

Исправлен цвет инпута в соответсвии с актуальной версией компонента

Pull Request Test Coverage Report for Build<PHONE_NUMBER>2
Details

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage decreased (-0.006%) to 82.595%

Totals

Change from base Build<PHONE_NUMBER>9:
-0.006%

Covered Lines:
10358

Relevant Lines:
11470

💛  - Coveralls


Add an action to lint shell scripts and Dockerfiles

Added an action to run linters for shell scripts and Dockerfiles.  It will run on any PR.  If there's a lint issue in one of the files being modified, it will add a review pointing out the specific line and error. If it finds errors in files not in the PR, those will get noted under the "Checks" tab.  None of this blocks merging the PR anyway, but it should make it much easier to spot potential problems.

Note that I have not yet gone through and fixed all the existing lint issues; my plan is to do that after merging #76, since there's changes to pretty much all the files that would be affected by this.

While we're at it...
https://github.com/dotenv-linter/action-dotenv-linter
https://github.com/marketplace/actions/yaml-lint

While we're at it...
https://github.com/dotenv-linter/action-dotenv-linter
https://github.com/marketplace/actions/yaml-lint

Good idea! I've added them.

Lgtm


GET /indexes does not filter by keyspace

In IndexesResource:
           BoundQuery query =
                restDB
                    .queryBuilder()
                    .select()
                    .column(columns)
                    .from(SYSTEM_SCHEMA, INDEXES_TABLE)
                    .where("table_name", Predicate.EQ, tableName)
                    .allowFiltering(true)

is wrong. If two tables with the same name exist in different keyspaces, all of their indexes will be returned.
It should be instead:
           BoundQuery query =
                restDB
                    .queryBuilder()
                    .select()
                    .column(columns)
                    .from(SYSTEM_SCHEMA, INDEXES_TABLE)
                    .where("keyspace_name", Predicate.EQ, keyspaceName)
                    .where("table_name", Predicate.EQ, tableName)

Waiting for completion of #1600 before adding test for this (almost there).


resvg_get_node_bbox works for path, but not for line

afaik line is like path, but simpler.
so why can't i get bounding box of it?

Is it a horizontal/vertical line? If so, then yes, it doesn't have a bbox in SVG terms.


can't find a function that changes the color of the entire room.

I would like to change the color according to the temperature in each room unit, as presented in the following URL.
https://aps.autodesk.com/en/docs/dataviz/v1/developers_guide/examples/heatmap/create_heatmap_for_rooms/
However, the code provided does not reflect the color change.(As of February 26, 2023)
Please let me know how I can make it reflect.

Did you change the objectId of the sensors in the config.js?
It represents the room dbids. Revit rooms are not visible in Revit 3D views, Model Derivative generates it by user-specified generated Master view option, so rooms’ dbids would be inconsistent in each SVF/SVF2 translation.

Thank you very much, I have not changed the value of the objectId in services/iot.mocked.js.
One thing I am wondering is what method can I use to get the value of APS_MODEL_VIEW that I need to specify in aps-iot-extensions-demo/public/config.js? Maybe I am not specifying the value correctly.

It's the Revit master view's viewableID. You can find it in the manifest response.


PLAT-75396: Signage Enact -  Sampler allows zoom

Checklist

[x] I have read and understand the contribution guide

[ ] A CHANGELOG entry is included

[ ] At least one test case is included for this feature or bug fix

[x] Documentation was added or is not needed

[ ] This is an API breaking change

Issue Resolved / Feature Added
Added platform name classes for the moonstone environment to enable platform-specific styling.
Resolution
Multi-touch actions (i.e. pinch-zoom) are disabled on webOS platforms in moonstone samples.
Additional Considerations
Since this is only applied for the moonstone panels, it is still possible to pinch zoom Sampler app itself from the story list section or the knobs section.
Links
PLAT-75396
Comments

@webOS101 - tested the opened branch. Can zoom the components/stories menu list but not the viewport, as you described. Is it possible to stop the zoom also on the menu list? I think it would be best to turn off the zoom there too if possible?
What would be the use case of keeping the zoom only on the menu list?

This was fixed at the platform level.


Improve for cyrillic alphabet and spaces

remove 188 key pres confirm because in cyrillic alphabet is a letter, add model.trim for removing spaces in start abd end of tag

#45 already fixes this. Thanks :)


[SE-0376] Rename @_backDeploy(before:) to @backDeployed(before:)

Update the spelling of the @_backDeploy(before:) attribute to @backDeployed(before:) in accordance with the resolution of SE-0376.
For now, swiftinterfaces will continue to print the attribute as @_backDeploy(before:) since the older compilers cannot parse the new spelling.
The corresponding swift-syntax PR is: https://github.com/apple/swift-syntax/pull/1304
Resolves rdar://102792909

https://github.com/apple/swift-syntax/pull/1304
@swift-ci please test

@swift-ci please test

CHANGELOG.md

The example code could use syntax highlighting.
It may also need an @available above the extension.
The degreesCelcius should be degreesCelsius.
A reference (at the end of the file) is needed.

Thanks, I fixed all of these except for the omission of availability on the extension which was intentional. It is common in SDK modules for extensions to be declared without availability and to instead annotate each member individually, which I want to do in the example for clarity.

https://github.com/apple/swift-syntax/pull/1304
@swift-ci please test


Explain how to use a list with discriminated unions

Change Summary
There's quite a few issues similar to https://github.com/pydantic/pydantic/issues/10330. Currently docs don't cover this fairly common use case.
Related issue number

Checklist

[x] The pull request title is a good summary of the changes - it will be used in the changelog
[x] Unit tests for the changes exist
[x] Tests pass on CI
[x] Documentation reflects the changes where applicable
[x] My PR is ready to review, please add a comment including the phrase "please review" to assign reviewers

Thanks, but I'd rather just improve the error message, as done in https://github.com/pydantic/pydantic/pull/11161.


[BUG] local deployment cannot be accessed via web login

Bug Description
The latest program installed via Docker cannot log in after registration. The web console shows a 401 error.
Expected Behavior
The expected result is that the account should be able to log in normally.
Actual Behavior
Unable to log in to the account.
Steps To Reproduce
Provide an unambiguous set of steps to reproduce this bug. Include code or configuration to reproduce, if relevant.

clone the latest code and install the related files using docker compose

git clone --depth 1 --branch latest https://github.com/juspay/hyperswitch
cd hyperswitch
docker compose --profile scheduler --profile olap --profile monitoring up -d

check the health port to ensure the program is running normally

❯ curl --head --request GET 'http://localhost:8080/health'
HTTP/1.1 200 OK
Content-Length: 14
Connection: keep-alive
Date: Sun, 22 Dec 2024 11:06:42 GMT
Keep-Alive: timeout=4
Proxy-Connection: keep-alive
Strict-Transport-Security: max-age=31536000
Vary: Origin, Access-Control-Request-Method, Access-Control-Request-Headers
Via: HyperSwitch
X-Hyperswitch-Version: v1.112.1-dirty
X-Request-Id: 0193ee0c-4919-7382-8c8f-798f741597c1

❯ curl http://localhost:8080/health/ready
{"database":true,"redis":true,"analytics":true,"opensearch":true,"outgoing_request":true,"grpc_health_check":{}}

open the dashboard to register an account and log in

Context For The Bug
No response
Environment
If not (or if building/running locally), please provide the following details:

Linux distribution:

❯ neofetch
                   -`                    aka@laptop
                  .o+`                   -----------
                 `ooo/                   OS: Arch Linux x86_64
                `+oooo:                  Host: ZhongYan U4 Version 1.0
               `+oooooo:                 Kernel: 6.12.4-arch1-1
               -+oooooo+:                Uptime: 6 hours, 9 mins
             `/:-:++oooo+:               Packages: 1570 (pacman)
            `/++++/+++++++:              Shell: fish 3.7.1
           `/++++++++++++++:             Resolution: 3840x2160
          `/+++ooooooooooooo/`           WM: sway
         ./ooosssso++osssssso+`          Theme: Adwaita [GTK2/3]
        .oossssso-````/ossssss+`         Icons: Adwaita [GTK2/3]
       -osssssso.      :ssssssso.        Terminal: foot
      :osssssss/        osssso+++.       CPU: AMD Ryzen 7 7735HS with Radeon Graphics (16) @ 4.829GHz
     /ossssssss/        +ssssooo/-       GPU: AMD ATI Radeon 680M
   `/ossssso+/:-        -:/+osssso+-     Memory: 20382MiB / 27797MiB
  `+sso+:-`                 `.-/+oso:    Disk (/): 586G / 934G (63%)
 `++:.                           `-/+/
 .`                                 `/

Rust version (output of rustc --version): docker rust:latest
App version (output of cargo r --features vergen -- --version): docker rust:latest

Have you spent some time checking if this bug has been raised before?

[X] I checked and didn't find a similar issue

Have you read the Contributing Guidelines?

[X] I have read the Contributing Guidelines

Are you willing to submit a PR?
None

Hey @knysfh
It looks like the issue is related to the cookie feature that was recently enabled. To resolve it temporarily, please open config/docker_compose.toml and set force_cookies = false (which is currently set to true). After making this change, restart the hyperswitch_server_1 container. This should help until the issue is fully fixed.

@apoorvdixit88 Thank you, this solved my problem.


also run for TABL objects

ref https://github.com/abaplint/abaplint/issues/1524
@ed-holland can you try this?

I ran it with some of my repos and have not seen any issues related to it.


Fix misuse of unbuffered os.Signal channel

Proposed changes
This PR fixes misuse of unbuffered os.Signal channel in testing tools.
sigchanyzer: misuse of unbuffered os.Signal channel as argument to signal.Notify (govet)

Types of changes
What types of changes does your code introduce to the project: Put an x in the boxes that apply

[X] Bugfix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)
[ ] Update only documentation, not any source code.

Checklist
Put an x in the boxes that apply. You can also fill these out after creating the PR. If you're unsure about any of
them, don't hesitate to ask. We're here to help! This is simply a reminder of what we are going to look for before
merging your code.

[X] I have read the CONTRIBUTING doc
[ ] I have signed the CLA
[ ] I have added tests that prove my fix is effective or that my feature works
[ ] I have added necessary documentation (if appropriate)
[ ] Any dependent changes have been merged and published in downstream modules

Further comments
N/A

Coverage remained the same at 100.0% when pulling 52173b5b93f4e796521e1a39cce774b99a3a98b3 on fisuda:fix/signal_channel into 7b9f05d209d8efdb05eca6ec7e97a2ad14e3f5ec on lets-fiware:main.


KAFKA-10173: Use SmokeTest for upgrade system tests (#8938)

Replaces the previous upgrade test's trivial Streams app
with the commonly used SmokeTest, exercising many more
features. Also adjust the test matrix to test upgrading
from each released version since 2.0 to the current branch.
Committer Checklist (excluded from commit message)

[ ] Verify design and implementation
[ ] Verify test coverage and CI build status
[ ] Verify documentation (including upgrade notes)

Started the new test: https://jenkins.confluent.io/job/system-test-kafka-branch-builder/4015/
And all streams tests: https://jenkins.confluent.io/job/system-test-kafka-branch-builder/4016/

Looks like there was a spurious failure of the new test:
test_id:    kafkatest.tests.streams.streams_application_upgrade_test.StreamsUpgradeTest.test_app_upgrade.to_version=2.5.0-SNAPSHOT.from_version=2.0.1.bounce_type=full
status:     FAIL
run time:   1 minute 43.164 seconds

    Server connection dropped:
Traceback (most recent call last):
  File "/home/jenkins/workspace/system-test-kafka-branch-builder/kafka/venv/lib/python2.7/site-packages/ducktape-0.7.8-py2.7.egg/ducktape/tests/runner_client.py", line 134, in run
    data = self.run_test()
  File "/home/jenkins/workspace/system-test-kafka-branch-builder/kafka/venv/lib/python2.7/site-packages/ducktape-0.7.8-py2.7.egg/ducktape/tests/runner_client.py", line 192, in run_test
    return self.test_context.function(self.test)
  File "/home/jenkins/workspace/system-test-kafka-branch-builder/kafka/venv/lib/python2.7/site-packages/ducktape-0.7.8-py2.7.egg/ducktape/mark/_mark.py", line 429, in wrapper
    return functools.partial(f, *args, **kwargs)(*w_args, **w_kwargs)
  File "/home/jenkins/workspace/system-test-kafka-branch-builder/kafka/tests/kafkatest/tests/streams/streams_application_upgrade_test.py", line 108, in test_app_upgrade
    self.restart_all_nodes_with(to_version)
  File "/home/jenkins/workspace/system-test-kafka-branch-builder/kafka/tests/kafkatest/tests/streams/streams_application_upgrade_test.py", line 173, in restart_all_nodes_with
    self.processor2.start_node(self.processor2.node)
  File "/home/jenkins/workspace/system-test-kafka-branch-builder/kafka/tests/kafkatest/services/streams.py", line 305, in start_node
    node.account.create_file(self.CONFIG_FILE, prop_file)
  File "/home/jenkins/workspace/system-test-kafka-branch-builder/kafka/venv/lib/python2.7/site-packages/ducktape-0.7.8-py2.7.egg/ducktape/cluster/remoteaccount.py", line 588, in create_file
    with self.sftp_client.open(path, "w") as f:
  File "/home/jenkins/workspace/system-test-kafka-branch-builder/kafka/venv/lib/python2.7/site-packages/paramiko-2.6.0-py2.7.egg/paramiko/sftp_client.py", line 372, in open
    t, msg = self._request(CMD_OPEN, filename, imode, attrblock)
  File "/home/jenkins/workspace/system-test-kafka-branch-builder/kafka/venv/lib/python2.7/site-packages/paramiko-2.6.0-py2.7.egg/paramiko/sftp_client.py", line 813, in _request
    return self._read_response(num)
  File "/home/jenkins/workspace/system-test-kafka-branch-builder/kafka/venv/lib/python2.7/site-packages/paramiko-2.6.0-py2.7.egg/paramiko/sftp_client.py", line 845, in _read_response
    raise SSHException("Server connection dropped: {}".format(e))
SSHException: Server connection dropped:

I'll re-run it.

Ah, and the other smoke test usages are messed up:
test_id:    kafkatest.tests.streams.streams_eos_test.StreamsEosTest.test_rebalance_simple
status:     FAIL
run time:   1 minute 28.121 seconds

    __init__() takes exactly 4 arguments (3 given)
Traceback (most recent call last):
  File "/home/jenkins/workspace/system-test-kafka-branch-builder/kafka/venv/lib/python2.7/site-packages/ducktape-0.7.8-py2.7.egg/ducktape/tests/runner_client.py", line 134, in run
    data = self.run_test()
  File "/home/jenkins/workspace/system-test-kafka-branch-builder/kafka/venv/lib/python2.7/site-packages/ducktape-0.7.8-py2.7.egg/ducktape/tests/runner_client.py", line 192, in run_test
    return self.test_context.function(self.test)
  File "/home/jenkins/workspace/system-test-kafka-branch-builder/kafka/tests/kafkatest/tests/streams/streams_eos_test.py", line 41, in test_rebalance_simple
    self.run_rebalance(StreamsEosTestJobRunnerService(self.test_context, self.kafka),
TypeError: __init__() takes exactly 4 arguments (3 given)

Testing again:
the new test: https://jenkins.confluent.io/job/system-test-kafka-branch-builder/4018/
all streams tests: https://jenkins.confluent.io/job/system-test-kafka-branch-builder/4019/

Just a note that this is the backport of https://github.com/apache/kafka/pull/8938

The new test passed: http://confluent-kafka-branch-builder-system-test-results.s3-us-west-2.amazonaws.com/2020-07-09--001.1594322852--vvcephei--kafka-10173-upgrade-smoke-system-test-2-5--91174c3b2/report.html
The all-streams tests failed because of the Jenkins restart. Kicked it off again: https://jenkins.confluent.io/job/system-test-kafka-branch-builder/4021/

Rebased, resolved conflict, and re-ran all Streams tests: https://jenkins.confluent.io/job/system-test-kafka-branch-builder/4023/console

Thanks, @guozhangwang . No, sadly, it's still used by the MetadataUpgradeTests.

Sorry for the long delay @vvcephei , the PR lgtm!

Thanks @guozhangwang ! I've merged to 2.5. If we do an 2.5.1RC1, it'll be included. Otherwise, it'll go into 2.5.2. Either way, it will run as part of nightly branch tests.


Right clicking table rows in Query does multi-select

Select a row then right click on a different row.
It keeps the original selected row selected.

Fixed in > v7.2-beta.79


Feat: support for skipping the default generated namespace resource

What would you like to be added?
Please add support for skipping the default generated Namespace resource.
Why is this needed?
Currently, Kusion defaults to generate a Namespace resource, which may cause difficulties for users who are migrating the existing applications or only applying the raw Kubernetes manifest YAML files.

Since Namespace is a necessary resource for an application, and re-applying the same Namespace has no impact on the resources in the Kubernetes cluster, users can import existing application resources with the customized Namespace without having to skip the default generated Namespace resource. Thus this issue will also be closed.


Fix duplicate headings on pages

Some pages such as https://docs.openservicemesh.io/docs/ha/ have the title displayed twice. Address this.

Some of these issues were fixed in https://github.com/openservicemesh/osm-docs/pull/25 - we need to verify if more remain.

related: https://github.com/openservicemesh/osm-docs/issues/7

Found this one also
https://docs.openservicemesh.io/docs/tasks_usage/observability/

Fixes in https://github.com/openservicemesh/osm-docs/pull/41


Removed a lot of lint warnings

#859

I would suggest running the command: yarn tsc && yarn lint --fix on your local and fix it before if you'd get some erros/warning

Hey @ADK0010 are you still working on this?

No

Closing it, as author is no longer working on this.


How to reset the page to the first page after generate a new table

Vue.js version: 1.0.21
consumed using: webpack
relevant code:
steps for reproducing the issue: If you go to page 2, then generate a new table, the current page will stay on page 2 instead of going to its first page

If by "generating a new table" you mean  programmatically inserting a new data set to an EXISTING table, then use this.$refs.myTable.setPage(1)

correct. What's the better way to do this? If I have some new data and an EXISTING table, and I want to replace the old data

Already answered in my prev comment


Fix Cartesian interpolation

Fixes #3651

:warning: Please install the  to ensure uploads and comments are reliably processed by Codecov.
Codecov Report
Attention: Patch coverage is 55.55556% with 4 lines in your changes missing coverage. Please review.

Project coverage is 47.23%. Comparing base (c174715) to head (454280a).
Report is 41 commits behind head on master.

Files with missing lines
Patch %
Lines

...it_core/robot_state/src/cartesian_interpolator.cpp
55.56%
4 Missing :warning:

:exclamation: Your organization needs to install the Codecov GitHub app to enable full functionality.
Additional details and impacted files
@@            Coverage Diff             @@
##           master    #3652      +/-   ##
==========================================
+ Coverage   47.15%   47.23%   +0.08%
==========================================
  Files         603      604       +1
  Lines       58999    59255     +256
  Branches     6969     7034      +65
==========================================
+ Hits        27814    27982     +168
- Misses      30773    30855      +82
- Partials      412      418       +6

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

How can I use this fixed version?

How can I use this fixed version?

We have cut a new release for this, but it is not yet synced. Consider using the debian packages from the ROS testing repo instead or build from source.


Invalid / Damaged PNG

I managed to get it working the first time, but now, the second time I try to run sprite task, it generates an invalid PNG. I don't know what / if any thing I have changed.
I have tried removing all images inside the sprite folder, to determine if it could be a single PNG, but even the old images, that worked before, no longer works.
This is my code:
gulp.task('sprite', function () {
    var spriteData = gulp.src('assets/sprites/*.png')
        .pipe(spritesmith({
            /* this whole image path is used in css background declarations */
            imgName: '../dist/images/sprite.png',
            cssName: 'sprite.css'
        }));
    spriteData.img.pipe(gulp.dest('img'));
    spriteData.css.pipe(gulp.dest('../dist/styles'));

    return spriteData.pipe(gulp.dest('assets/styles/'));
});

The error:
The file “sprite.png” could not be opened.
It may be damaged or use a file format that Preview doesn’t recognise.

Thanks in advance.

This code fixed it:
gulp.task('sprite', function () {
  var spriteData = gulp.src('assets/sprites/*.png').pipe(spritesmith({
    imgName: '../images/sprite.png',
    cssName: '../styles/sprite.css'
  }));
  return spriteData.pipe(gulp.dest('assets/styles/'));
});

Yes, the issue was we were writing 2 separate images but only letting gulp know about the final state for the second one via return spriteData.pipe
We had 2 ways to fix this:

Use a merge-stream for the separate image and CSS streams (https://github.com/twolfson/gulp.spritesmith/issues/150#issuecomment-553613707)
Use a common stream for both (current fix, https://github.com/twolfson/gulp.spritesmith/issues/151#issuecomment-553458496)


Update ProductsController.php

Added arg $sku to sku queries

Thanks for this - these functions were obviously not tested well!


Allow more CLI options to override config file.

This PR allows more config items to be specified on the command line and override an existing config file on an adhoc basis to allow for per run or per environment overrides.
In particular, it adds support for overriding the following options:

Target directory for Rust builds, for example if a CI build needs to output to a specific cached location.
Output directory for Tarpaulin output, for the same reason
Coveralls related config items (coveralls, ci_tool and report_uri). Primarily the coveralls flag was desired, to allow use in environments other than Travis which require access to a secret API key that you may not wish to include in repo, but I included all three options for consistency.
Crate root, to allow for a run to target only a single crate in a workspace.

Previous discussion: #414

Sorry about all the extra pushes here, there was a test issue as the order of configs from the toml parsing function was not guaranteed, then I updated the commit messages to fit in github's UI better.

Looks good to me, just pop an entry in the changelog and we're good to go :smile:

Changelog has been updated.

:+1:


QUESTION: Discontinued Legacy Firebase Cloud Messaging APIs and SDKs

Please excuse my ignorance.  I was made aware that Google is discontinuing their legacy Firebase Cloud Messaging (FCM) APIs on June 20, 2024.  I was able to take their docs and find that our back-end needs to change for how we are SENDING messages.  I'm not sure how to assess if there are any impacts on the front-end for RECEIVING messages.
Can someone explain how I'd go about assessing if this change would impact apps that use this firebasex plugin?  The discontinuation message is below, for reference.

The decommissioning of the legacy APIs has no effect on this plugin:
This plugin is a thin(ish) wrapper around the native Firebase SDK components. FCM messages are sent by the Firebase Cloud servers to the device and received/processed by the FCM SDK component.
While this plugin pins fairly recent versions of Firebase SDK components, it's always possible to override this to include the very latest Firebase SDK component versions if so desired. However this should not be necessary as I'm not aware of any breaking changes to the Firebase FCM SDK component.

Thank you for confirming that, @dpa99c !

Hi @dpa99c, thanks for above clarification. just double checking, if I'm using 13.0.1, will it be impacted by this? thank you


Xcode shows an error message when importing a module that declares a typealias to a protocol with a primary associated type

Describe the bug
Xcode 14beta5 shows a message stating that "An internal error occurred. Source editor functionality is limited. Attempting to restore..." when importing a module that declare a typealias to a protocol with a primary associated type (and where the alias specifies the primary associated type, generically or not).
Steps To Reproduce
Steps to reproduce the behavior:

In the module A of a package, declare

public protocol Foo<Bar> {
  associatedtype Bar
}
public typealias Problem = Foo<String>

In a module B, import A, and then start to type struct Hello {}
It builds after completing the declaration, but it shows an error message at the top of the editor.

Expected behavior
Nothing happens.
Screenshots

Environment (please fill out the following information)

macOS 13.0 beta 5 (22A5321d)
Xcode 4.0 beta 5 (14A5294e)

Additional context
Here is a package where the issue can be reproduced by starting editing the EditThis.swift file: XcodeIssue.zip.
This is likely related to https://github.com/pointfreeco/swift-composable-architecture/discussions/1264
Associated Feedback: FB11244375
The issue started to occur in Xcode 14.0 beta 4. There is no issue when using Xcode 14.0 beta 3.

Sorry for getting to this bug report so late.
The problem should be fixed by https://github.com/apple/swift/pull/60801, which is included in the Xcode 14.1 betas. Could you check if you are still seeing the issue with these betas? If this continues to be an issue, feel free to re-open the issue and I’ll take another look.

It indeed appeared to be fixed in 14.1b3, but I wasn't sure it was not coincidental so I planned to wait for the RC to confirm and eventually close it. Thanks for the update!

Thanks for checking.


Function to rescale a Demes model

This could be in the DemesUtil set of functions. It would take some factor Q and rescale all population sizes, model times, migration rates, by this factor to maintain consistent population-genetic parameters.

Should this be implemented as part of moments, or as part of demes itself? Seems like the stdpopsim and slim people would also want to use this...

Ideally in a more general package, and not just moments, but I'm not sure how likely it is to be implemented within demes itself. For now, I was thinking of placing it in moments (like we have demes model slicing functions to take upper or lower portions of the demography), and if these functions get integrated into demes later we can remove them from moments?

Closed by #159


DocsArchive-<IP_ADDRESS>Auto archive content

Please don't merge this PR until target archive repo PR https://github.com/OPS-E2E-PPE/docs-archive-test-target_87e0ffb6-05c4-4788-8481-ed15ac2399b1/pull/1 is merged into live branch.
Auto archive content to https://github.com/opstest2/docs-archive-test-target_87e0ffb6-05c4-4788-8481-ed15ac2399b1.git

Docs Build status updates of commit 9674418:
:x: Validation status: errors
Please follow instructions here which may help to resolve issue.

File
Status
Preview URL
Details

:x:Error

Details

[Error: RepositoryUnauthorizedWithSourceCommit] Git data access to 'https://github.com/opstest2/docs-archive-test-source' (branch: Release_Archive_main_2022-01-10-04-34-07) is not authorized.. It looks like this might be the first time user: v-alji submitted a pull request to this repo. Before user can run builds in a pull request, he/she can enable 'v-alji' GitHub account in Docs by visiting Docs Portal (https://ops.microsoft.com). After enabling his/her account (v-alji), close and then reopen this pull request to start another build.

For more details, please refer to the build report.
If you see build warnings/errors with permission issues, it might be due to single sign-on (SSO) enabled on Microsoft's GitHub organizations. Please follow instructions here to re-authorize your GitHub account to Docs Build.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
Note: Your PR may contain errors or warnings unrelated to the files you changed. This happens when external dependencies like GitHub alias, Microsoft alias, cross repo links are updated. Please use these instructions to resolve them.
For any questions, please:Try searching the docs.microsoft.com contributor guidesPost your question in the Docs support channel


Ubuntu Runtime error | Chrome process stopped before startup completed. Additional info: sh: 1: exec: /opt/google/chrome: Permission denied

Type: RuntimeException
Message: Chrome process stopped before startup completed. Additional info: sh: 1: exec: /opt/google/chrome: Permission denied
PHP 7.2.34 | Ubuntu 20.04.2 LTS
getting this error
$browserFactory = new BrowserFactory("/opt/google/chrome");
i tried
"google-chrome"
"/usr/bin/google-chrome"
"/opt/google/chrome/chrome"

Your php process doesn't have the necessary permissions to execute chrome. Check the user executing the php script or the permissions of the /opt/google/chrome file.

php is running as daemon
google chrome is located in /opt/google/chrome but user and group are root :(
theres a .config folder in the home dir
how to do this

This may be related to your issue: https://superuser.com/questions/505870/installing-software-to-usr-opt-needs-permission-to-run-the-software


feat: add screen view event after session start

[x] PR title and description conform to Pull Request guidelines.

Description of changes:

add screen view event after session start

How did you test these changes?
added the test case testSessionTimeoutAfterReopenTheApp
Documentation update required?

[ ] No
[ ] Yes (Please include a PR link for the documentation update)

General Checklist

[ ] Added Unit Tests

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 87.42%. Comparing base (a828261) to head (c0efd26).

Additional details and impacted files
@@             Coverage Diff              @@
##               main      #67      +/-   ##
============================================
+ Coverage     87.26%   87.42%   +0.15%
- Complexity      455      458       +3
============================================
  Files            42       42
  Lines          1665     1686      +21
  Branches        152      152
============================================
+ Hits           1453     1474      +21
  Misses          135      135
  Partials         77       77

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


[NETBEANS-851] Updating About box text on release90 with Incubation message.

Updating About box text on release90 with Incubation message.

I don't believe this is controversial, :-), simply redoing the earlier merge of the updated About box text from main to release90. So, merging.


Locale-independent functionality of PropelDateTime::createHighPrecision

See https://github.com/propelorm/Propel2/pull/1242

Looks like already ported. Could be closed probably?

Indeed :)

@marcj #18 could be also closed is related to the same stuff :)


update rtd configuration

We are waiting until https://github.com/ROCm/rocm-docs-core/pull/660 has been merged and a new version has been released for that package before updating the RTD config to Python 3.10


Missing very comon name.

Add "root" to /usr/share/seclists/Usernames/Names/names.txt

Feel free to open a PR

@unKn0wnUser453, I've made a PR for you.
CC: @g0tmi1k

Cheers @CoccodrillooXDS
Closing


InstanceID missing from logs

Evtx'es have a property "InstanceID" which is related to EventID:

InstanceID is not EventID, but can be:

The InstanceId property uniquely identifies an event entry for a configured event source. The InstanceId for an event log entry represents the full 32-bit resource identifier for the event in the message resource file for the event source. The EventID property equals the InstanceId with the top two bits masked off. Two event log entries from the same source can have matching EventID values, but have different InstanceId values due to differences in the top two bits of the resource identifier. If the application wrote the event entry using one of the WriteEntry methods, the InstanceId property matches the optional eventId parameter. If the application wrote the event using WriteEvent, the InstanceId property matches the resource identifier specified in the InstanceId of the instance parameter. If the application wrote the event using the Win32 API ReportEvent, the InstanceId property matches the resource identifier specified in the dwEventID parameter.

Taken from here: https://evotec.xyz/powershell-everything-you-wanted-to-know-about-event-logs/
I would very much like to have InstanceID read in. It isn't in the XML data; XML data contains EventID
I don't know enough about evtx structure to offer a patch.
Cross post with pyevtx-rs/issues/9

I looked at this and see that the actually record's event id does no bit masking in this library:
https://github.com/omerbenamram/evtx/blob/master/src/evtx_record.rs#L50
Thus, this should maintain the instance id (as no bit mask is applied). Use the event record's event_record_id attribute rather than the serialized value. I believe the python bindings also preserves this value. Let me know if you find this is not the case.
While InstanceID is not documented in Metz' documentation of EVTX structure, this is the only other value from timestamp, size, and signature outside of the XML data: https://github.com/libyal/libevtx/blob/master/documentation/Windows XML Event Log (EVTX).asciidoc#32-event-record


Change position of deleted/suspended/archived resources in table of resources

Versions
22.9.7 and 23.3
Description
When testing different resources, I noticed that the position of deleted/suspended/archived resources in some tables is different.  In users, roles, apps, wfs, msg queue, auth clients tables the resources are positioned at the top of the list (before resources that are not deleted/suspended/archived). Whereas in api, conns, sens lvls tables, it's the other way around
Expected behaviour
"Special" resources should appear at the top of the table

For today: write down plan and  complete half of the work

The plan:

If 'special' resources can be in the same row as search, do it like so
otherwise:  like it's done in the workflow application

Prioritizing TestFest bugs over this task

For today: start implementing the solution


Steps in cumulative quantities. (open api)

Describe the bug
Weird steps in many cumulative properties such as total current year energy

.
This affects many quantities and seem to happen daily at a consistent time of day. Maybe when battery is out of power.
** Debug information **
Answer the questions below before submitting a new issue.

Are you using the latest version of Home Assistant?

yes

Are you using the latest version of this integration?

yes

Have you looked into the closed issues and did not find a similar issue. Yes

Are you using Kiosk or Northbound / OpenAPI mode?
Api

Have you checked the logs for any info?

2024-04-04 23:05:10.108 WARNING (Recorder) [homeassistant.components.sensor.recorder] Entity sensor.tofthojvej_8_total_current_year_energy from integration fusion_solar has state class (https://github.com/tijsverkoyen/HomeAssistant-FusionSolar/assets/2535390/de705ef6-850f-4f30-99af-4e53f8b1da01)
total_increasing, but its state is not strictly increasing. Triggered by state<PHONE_NUMBER>99999 (712.5) with last_updated set to 2024-04-04T21:03:01.755868+00:00. Please create a bug report at https://github.com/tijsverkoyen/HomeAssistant-FusionSolar/issues

Yeah, this is a Huawei issue. I will not invest any time to fix this.


Migrate to async-service library

What was wrong?
I've worked with it enough that I'm confident enough in the new service abstraction to go ahead and pull it out into a stand alone library.
How was it fixed?
Created the async-service library and migrated the existing code that uses the trio one to use the new library.
To-Do

[ ] Clean up commit history

[ ] Add entry to the release notes

Cute Animal Picture

Weird stuff going on with mypy....

A little confused why/how this is still installing mypy==0.740 which is causing the strange assertion error.

I found a way around the odd mypy errors which was to run the individual modules separately...


#2 Gracefully handle permission denied error during signin

Towards #1691
Current behavior
If the user isn't in the allowlist, then the app would directly finish with a toast message. One needs to manually clear to app data in order to reset the app and attempt login again.
Proposed behavior
A dialog is shown with 2 options : Sign out and Close app
Other details
Note that this PR also changes the behavior of sign out action by clearing all local tables as well.
Please review this PR once https://github.com/google/ground-android/pull/1808 is submitted as it is branched off of it.

@gino-m  PTAL?

Please review this PR once https://github.com/google/ground-android/pull/1808 is submitted as it is branched off of it.

Will do! Could you kindly ping once that's in so I don't forget?

/gcbrun

@gino-m This is now ready for a review!

/gcbrun

/gcbrun


PWA Notification Endpoint(s)

I need an endpoint that can be used for sending the user specific notifications.
@mircealungu and I discussed the possibility for a secondary endpoint that only fetches if the user actually clicks on the notification which could log data such as notificationId, user session ID and timestamp.
Here is my current PR:
https://github.com/zeeguu/web/pull/601
I currently use my own mock data via. a json file:
[
{
"message": "Mock data notification: Remember to complete your daily exercises!",
"notificationId": "123",
"url": "/exercises"
},
{
"message": "Mock data notification: Find today's interesting article!",
"notificationId": "123",
"url": "/articles"
},
{
"message": "Mock data notification: Remember to practice your recently learned words!",
"notificationId": "123",
"url": "/words"
},
{
"message": "Mock data notification: Take a look at your history with Zeeguu!",
"notificationId": "123",
"url": "/history"
}
]

Would this be best to implement via a new table @mircealungu ?

Note: The application should send a notification id with the message and the url it should take, the sw makes sure you can send the notification before asking.

This has been implemented in: https://github.com/zeeguu/api/pull/311


Mismatch between byte count of data

Followed all instructions but I get this error when I build for my mac in xcode:
assert(data.count == expectedCount, "Mismatch between byte count of data \(data.count) and expected size \(expectedCount) for \(numels) els in \(fileUrl)")
if I expand the error I see this:
Thread 2: Assertion failed: Mismatch between byte count of data 51840 and expected size 23040 for 11520 els in file:///Users/ryancossette/Library/Developer/Xcode/DerivedData/maple-diffusion-ezlrowjenuiuddbvzedttsyyclbg/Build/Products/Debug/maple-diffusion.app/Contents/Resources/bins/model.diffusion_model.input_blocks.0.0.weight.bin

Looks like this was coming from the model I converted. I used the runwayml 1.5 inpainting model. I switched to the 1.4 and it works.


Unmet Dependency when running as Twilio-cli plugin

XXXXX % twilio plugins:update
warning "@twilio-labs/plugin-rtc ><EMAIL_ADDRESS>has unmet peer dependency "@oclif/plugin-help@^2".
Node Version 14.2

Try this:
upgrade the Twilio CLI plugin: twilio plugins:update
then
twilio rtc:apps:video:delete
then
npm run deploy:twilio-cli

thank you it's working now.


Whole Lotta Updates

create the mask from a microflow.
removed the buggy placeholder.

Addresses #2

New Features:

Dynamic Mask (from microflow)
Validations display
Label Rendering
Intelligent Label Width
Editable Property


Fixes Exit Errors

fixes error upon exiting
closes the rigol instrument before attempting to close the resource manager

Many thanks!!


(do not merge) test commit

This is a test PR to verify the PR build functionality is working as expected. Do not merge this PR.

PR branch was picked up and successfully ran through the build process 🎉


WIP - CCAP-32 - Add all One-to-One-fields

🔗 Jira ticket

✍ Description

📷 Design reference

✅ Completion tasks

[ ] Added relevant tests
[ ] Meets acceptance criteria

@stabai Worked on the same Story.  We pushed his pull request to github


Pull Request: Mono building & Continuous Integration

https://github.com/jbtule/google-api-dotnet-client/pull/1

Original issue reported on code.google.com by<EMAIL_ADDRESS>on 20 Apr 2014 at 7:27

This issue was unclear to me, so I closed it.


FileUpload component issues - remove single file and "no files" template

In the demo (https://www.primefaces.org/sigma-vue/#/misc) and when integrating the component into an app, uploading a file and removing it via the X button triggers a javascript error (TypeError: Cannot read property 'files' of undefined).
Also, the component seems not to support the "<template #empty>" markup to specify the text to display when no file has been uploaded yet.

I have solved the 'removing issue' moving the module FileUpload code to my components folder and modifying the remove method for this one:
    remove(index) {
        this.clearInputElement();
        this.files.splice(index, 1);
    },

About the "<template #empty>" feature I suppose it was added in a newest primevue version. Anyway, if you need it, you can try to add the last FileUpload code to your components folder.
Hope it helps
Ernest

Checked your suggestion on the removal, it works fine.
I'll try to update the whole component too. Thanks!


Removal of Broker List breaks dependancies

BrokerList has been deprecated in uber-go/kafka-client, breaking dependancies in uber/cadence (kafkaClient.go)

Per the rules of semver, "Major version zero (0.y.z) is for initial development. Anything may change at any time. The public API should not be considered stable." We make an additional guarantee that during development phase (0.MINOR.PATCH), API stability is guaranteed at the PATCH level but not the MINOR level. Cadence should pin ~0.1.7 instead of ^0.1.7.


why am i getting 502 response can anyone help me pls?

I'm trying something for hobby purposes but I'm getting an error.
vote system for https://minecraftbestservers.com/server-complex-gaming.77/vote
I am getting token but when i try the api always happen the 502 response, main request method is send_vote method.
import random
import time
import cloudscraper
from itertools import cycle
from random_user_agent.user_agent import UserAgent
from random_user_agent.params import SoftwareName, OperatingSystem
import urllib.parse

# Load proxies from a file
def load_proxies(filepath):
    with open(filepath, 'r') as file:
        return [line.strip() for line in file.readlines()]

# Constants
PROXY_FILE = 'proxies.txt'  # Adjust this to your proxy file's path
proxies = load_proxies(PROXY_FILE)
proxy_pool = cycle(proxies)

def case_variations(text):
    if not text:
        yield ""
    else:
        first, rest = text[0], text[1:]
        for variant in case_variations(rest):
            yield first.lower() + variant
            yield first.upper() + variant

class SessionManager:
    def __init__(self):
        # Initialize cloudscraper to handle Cloudflare's challenges
        self.scraper = cloudscraper.create_scraper()
        # Initialize user agent rotator specifically for Windows Chrome browsers
        self.user_agent_rotator = UserAgent(software_names=[SoftwareName.CHROME.value],
                                            operating_systems=[OperatingSystem.WINDOWS.value])
        self.update_session()  # Initialize session with first proxy and user agent

    def get_next_proxy(self):
        # Cycle through the proxy pool and return the next available proxy
        return next(proxy_pool)

    def parse_proxy(self, proxy):
        # Parse the proxy string to extract HTTP proxy settings only
        ip_port, username, password = proxy.rsplit(':', 2)
        ip, port = ip_port.rsplit(':', 1)
        return {
            'http': f'http://{username}:{password}@{ip}:{port}',
            # Comment out the HTTPS part if proxy only supports HTTP
            # 'https': f'https://{username}:{password}@{ip}:{port}'
        }

    def renew_session(self):
        # Reset the existing session and update it with new settings
        self.scraper = cloudscraper.create_scraper()
        self.update_session()

    def update_session(self):
        # Update session with a new proxy and user agent
        proxy_settings = self.parse_proxy(self.get_next_proxy())
        self.scraper.proxies.update(proxy_settings)
        new_user_agent = self.user_agent_rotator.get_random_user_agent()
        self.scraper.headers.update({'User-Agent': new_user_agent})
        print(f"Using proxy: {proxy_settings} and User-Agent: {new_user_agent}")

    def fetch_captcha_token(self, err_count=0):
        if err_count >= 10:
            return "Max retries reached."

        try:
            # Get the current proxy details from the session
            current_proxy = self.scraper.proxies.get('http')  # Adjusted to use 'http'
            parsed_proxy = urllib.parse.urlparse(current_proxy)
            proxy_auth, proxy_host = parsed_proxy.netloc.split('@')
            username, password = proxy_auth.split(':')
            host, port = proxy_host.split(':')

            # Prepare the payload with proxy details
            payload = {
                'key': 'MY_KEY',
                'type': 'hcaptcha',
                'sitekey': 'f7581d18-8739-40a0-90ff-2983225aa9a0',
                'url': 'https://minecraftbestservers.com/server-complex-gaming.77/vote',
                'proxy': {
                    'scheme': parsed_proxy.scheme,
                    'host': host,
                    'port': port,
                    'username': username,
                    'password': password
                }
            }

            # Use cloudscraper to send the request to the CAPTCHA solving service
            response = self.scraper.post('https://api.nopecha.com/token/', json=payload)
            response.raise_for_status()  # Raise an exception for HTTP errors

            return response.json().get('data')

        except Exception as e:
            print(f"Error fetching CAPTCHA token: {e}")
            time.sleep(random.uniform(0, 1))
            return self.fetch_captcha_token(err_count + 1)

    def send_vote(self, username):
        # Renew session for each vote to use a new proxy and user agent
        self.renew_session()
        vote_url = "https://minecraftbestservers.com/server-complex-gaming.77/vote"
        self.scraper.get(vote_url)
        captcha_token = self.fetch_captcha_token()

        headers = {
            'Accept': 'text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.7',
            'Accept-Encoding': 'gzip, deflate, br, zstd',
            'Accept-Language': 'tr-TR,tr;q=0.9,en-US;q=0.8,en;q=0.7,la;q=0.6',
            'Cache-Control': 'max-age=0',
            'Content-Type': 'multipart/form-data; boundary=----WebKitFormBoundaryNGYzOdh0nG6SAUGF',
            'Origin': 'https://minecraftbestservers.com',
            'Priority': 'u=0, i',
            'Referer': vote_url,
            'Sec-Ch-Ua': '"Not/A)Brand";v="8", "Chromium";v="126", "Google Chrome";v="126"',
            'Sec-Ch-Ua-Mobile': '?0',
            'Sec-Ch-Ua-Platform': '"Windows"',
            'Sec-Fetch-Dest': 'document',
            'Sec-Fetch-Mode': 'navigate',
            'Sec-Fetch-Site': 'same-origin',
            'Sec-Fetch-User': '?1',
            'Sec-Gpc': '1',
            'Upgrade-Insecure-Requests': '1',
            'User-Agent': self.scraper.headers['User-Agent']
        }
        data = {
            'username': username,
            'g-recaptcha-response': captcha_token,
            'h-captcha-response': captcha_token
        }

        response = self.scraper.post(vote_url, headers=headers, data=data)
        return response.status_code

    def send_votes(self, base_username):
        results = []
        # Generate case variations of the username
        for username in case_variations(base_username):
            result = self.send_vote(username)
            results.append((username, result))
            print(f"Vote sent for {username}: {result}")
        return results

def main():
    manager = SessionManager()
    results = manager.send_votes("myusername")
    for username, status in results:
        print(f"Username: {username}, Status Code: {status}")

if __name__ == '__main__':
    main()

It looks like you are submitting a token job but never retrieving the token solution. Our inference engine is asynchronous, and you must poll for the solution until it is ready. Read more here: https://developers.nopecha.com/token/turnstile/

Also the site has cloudflare it should be for this i think

If the issue persists, you should open a ticket on Discord.
Navigate to the channel #create-ticket and choose the following options:

Customer Support -> API Issues -> No

Please provide your IP address or API key in the ticket so we can try to identify the cause of your issue.


support for etcd authentication

any plans for support this feature:
https://github.com/coreos/etcd/blob/master/Documentation/authentication.md

@nebelpfade this is just an experimental feature, also from the etcd source code this feature is still not so complete.

Google Kubernetes team are working on support already:
https://github.com/kubernetes/kubernetes/issues/11962
Also there is new etcd client:
github.com/coreos/etcd/client
which supports it already.

@nebelpfade yeah, I know this, if so we can do this.

@AdoHe @nebelpfade Any timelines yet for supporting auth feature?

@raoofm I will do this as soon as I can.

:+1:

Just for your information, kubernetes team completed etcd auth:

@nebelpfade I will do this during this week.

[ Quoting<EMAIL_ADDRESS>in "Re: [skydns] support for etcd authe..." ]

@nebelpfade I will do this during this week.

Cool! SkyDNS also still uses the old (legacy) etcd api, I am assuming you port
it to the new one as well? (think this is a necessity for auth).
/Miek
--
Miek Gieben

@miekg yeap, I will port it to the new one. And I will open a PR during this week.

@AdoHe is this issued fixed with new etcd client?  @miekg we still don't flag/config to make it work with skydns

[ Quoting<EMAIL_ADDRESS>in "Re: [skydns] support for etcd authe..." ]

@AdoHe is this issued fixed with new etcd client?

Nope.

@miekg we still don't flag/config to make it work with skydns

Nope.
PRs welcome about this though.
/Miek
--
Miek Gieben

@miekg @ysh7 I will send a PR to fix this.

@AdoHe ping!

@ysh7 I think the new etcd client now support secured etcd cluster. I will add test later.

I think I have already fixed this on my local, I just forget to push this to github.

@AdoHe any chance we could get you to submit a PR with that authentication code?

I have opened a PR #289 to fix this, @DerekTBrown @nebelpfade @miekg ptal.

:)