BigQuery DataTransfer: Error in scheduling runs

I'm trying to use Python's API for BigQuery DataTransfer, but I'm getting RPC errors. I'm not sure if there's a problem with the API or a general configuration problem with the script.
google-cloud-python version:

Name: google-cloud
Version: 0.32.0
Summary: API Client library for Google Cloud
Home-page: https://github.com/GoogleCloudPlatform/google-cloud-python
Author: Google Cloud Platform
Author-email<EMAIL_ADDRESS>License: Apache 2.0
Location: /home/ubuntu/python3_virtualenv/python3_env/lib/python3.6/site-packages
Requires: google-cloud-resource-manager, google-cloud-language, google-cloud-storage, google-cloud-trace, google-cloud-datastore, google-cloud-pubsub, google-cloud-core, google-cloud-speech, google-cloud-spanner, google-cloud-translate, google-cloud-vision, google-cloud-videointelligence, google-cloud-error-reporting, google-cloud-bigquery, google-cloud-firestore, google-cloud-bigquery-datatransfer, google-cloud-dns, google-cloud-bigtable, google-cloud-container, google-cloud-monitoring, google-cloud-logging, google-api-core, google-cloud-runtimeconfig

Example Code:
client = bigquery_datatransfer.DataTransferServiceClient()

timestamp_start = timestamp_pb2.Timestamp()
timestamp_start.FromSeconds(1524022447)

timestamp_end = timestamp_pb2.Timestamp()
timestamp_end.FromSeconds(1524133447)

client.schedule_transfer_runs(client.get_transfer_config("projects/<PROJECT_ID>/locations/us/transferConfigs/<TRANSFER_ID>").name,
                              start_time=timestamp_start,
                              end_time=timestamp_end)

Example Error:
---------------------------------------------------------------------------
_Rendezvous                               Traceback (most recent call last)
~/python3_virtualenv/python3_env/lib/python3.6/site-packages/google/api_core/grpc_helpers.py in error_remapped_callable(*args, **kwargs)
     53         try:
---> 54             return callable_(*args, **kwargs)
     55         except grpc.RpcError as exc:

~/python3_virtualenv/python3_env/lib/python3.6/site-packages/grpc/_channel.py in __call__(self, request, timeout, metadata, credentials)
    499         state, call, = self._blocking(request, timeout, metadata, credentials)
--> 500         return _end_unary_response_blocking(state, call, False, None)
    501

~/python3_virtualenv/python3_env/lib/python3.6/site-packages/grpc/_channel.py in _end_unary_response_blocking(state, call, with_call, deadline)
    433     else:
--> 434         raise _Rendezvous(state, None, None, deadline)
    435

_Rendezvous: <_Rendezvous of RPC that terminated with (StatusCode.INVALID_ARGUMENT, Request contains an invalid argument.)>

The above exception was the direct cause of the following exception:

InvalidArgument                           Traceback (most recent call last)
<ipython-input-40-13d74c5cc600> in <module>()
      7 client.schedule_transfer_runs(client.get_transfer_config("projects/967176960612/locations/us/transferConfigs/5aa1c6a1-0000-252e-b3b7-f403043605f4").name,
      8                               start_time=timestamp_start,
----> 9                               end_time=timestamp_end)

~/python3_virtualenv/python3_env/lib/python3.6/site-packages/google/cloud/bigquery_datatransfer_v1/gapic/data_transfer_service_client.py in schedule_transfer_runs(self, parent, start_time, end_time, retry, timeout)
    711             parent=parent, start_time=start_time, end_time=end_time)
    712         return self._schedule_transfer_runs(
--> 713             request, retry=retry, timeout=timeout)
    714
    715     def get_transfer_run(self,

~/python3_virtualenv/python3_env/lib/python3.6/site-packages/google/api_core/gapic_v1/method.py in __call__(self, *args, **kwargs)
    137             kwargs['metadata'] = metadata
    138
--> 139         return wrapped_func(*args, **kwargs)
    140
    141

~/python3_virtualenv/python3_env/lib/python3.6/site-packages/google/api_core/retry.py in retry_wrapped_func(*args, **kwargs)
    258                 sleep_generator,
    259                 self._deadline,
--> 260                 on_error=on_error,
    261             )
    262

~/python3_virtualenv/python3_env/lib/python3.6/site-packages/google/api_core/retry.py in retry_target(target, predicate, sleep_generator, deadline, on_error)
    175     for sleep in sleep_generator:
    176         try:
--> 177             return target()
    178
    179         # pylint: disable=broad-except

~/python3_virtualenv/python3_env/lib/python3.6/site-packages/google/api_core/timeout.py in func_with_timeout(*args, **kwargs)
    204             """Wrapped function that adds timeout."""
    205             kwargs['timeout'] = next(timeouts)
--> 206             return func(*args, **kwargs)
    207
    208         return func_with_timeout

~/python3_virtualenv/python3_env/lib/python3.6/site-packages/google/api_core/grpc_helpers.py in error_remapped_callable(*args, **kwargs)
     54             return callable_(*args, **kwargs)
     55         except grpc.RpcError as exc:
---> 56             six.raise_from(exceptions.from_grpc_error(exc), exc)
     57
     58     return error_remapped_callable

~/python3_virtualenv/python3_env/lib/python3.6/site-packages/six.py in raise_from(value, from_value)

InvalidArgument: 400 Request contains an invalid argument.

@tswast ISTM that error message should at least contain the name (if not the value) of the invalid argument.  I'm not sure who the back-end PoC is for BQDT:  can you loop the right person in?

@mtai Can you forward this feedback to the right folks? The error messages for this BQ-DTS error don't contain enough info to debug.

@tswast It looks like many people are having the same issue with the APIs.
https://stackoverflow.com/questions/49538321/bigquery-transfer-api-updating-the-adwords-transfer-config-is-not-working-throu
https://stackoverflow.com/questions/45697757/bigquery-data-transfer-service-for-adwords
https://stackoverflow.com/questions/45153370/bigquery-data-transfer-services-php-client-library-and-check-backfill-the-b
https://stackoverflow.com/questions/46188701/invalid-argument-projects-locations-transferconfig-create
I'm primarily using this to get adwords data. But I guess I'll use the adwords API and store the data in redshift instead.

Are you able to create a transfer in the UI?

@tswast I was able to create the transfer in the UI.
But actually I figured out it was not the API's issue, but authentication wise.
Here I'll post my solution if anyone has the same issue with data transfer.

I created a service account for all my google APIs.
The service account does not have authentication to access adwords, because in order to gain access, the service account needs to at least be a read-only.
But you cannot add the service account to adwords, since if you added the service account to adwords account then adwords send out an email to the service account, which I don't think you have access to.
The permissions does not get returned by Google's servers, instead it is an INVALID_ARGUMENT, which incorrect. If you tried the same command with gcloud alpha cloud-shell ssh (while authenticated as a service account), and tried the bq command: bq mk --transfer_config --project_id=PROJECT_ID --target_dataset=temp --display_name=temp_tr --params='{"customer_id": "XXX-XXX-XXXX", "exclude_removed_items": "false"}' --data_source=adwords, then it will complain that adwords is an unknown data source.
But if you tried the above command under a user account which has access to both Big Query and Adwords account, then it succeeds.

The workaround I did was get authenticated as a user using:
https://console.developers.google.com/apis/credentials/oauthclient
https://developers.google.com/oauthplayground/?code=4/AAA0-jbP9OUCEa5RT_BSg9AW6zFn-wytdbn9IbmYVYLG30vafyE7BfpZESU_S2VOjaM3YP3Wpwomg0pqvbKSW8U#
Using the API credentials, create a OAUTH2 client and secret, and enter it into the oauthplayground. This will return a refresh key, which you can call Google's authentication server to give you an access token, for example:
To get a access token (they expire hourly):
import requests
import json
request = requests.post(f"https://www.googleapis.com/oauth2/v4/token?client_id={client_id}&client_secret={client_secret}&refresh_token={refresh_token}&grant_type=refresh_token")
access_token = json.loads(request.text)["access_token"]

Then create the biquery client using the access token:
from google.cloud import bigquery_datatransfer
from google.oauth2.credentials import Credentials
client = bigquery_datatransfer.DataTransferServiceClient(credentials=Credentials(token=access_token))

Then you can successfully initiate a transfer:
project_id = "blabla-land-18304"
parent = client.project_path(project_id)
config = bigquery_datatransfer.types.TransferConfig()
config.destination_dataset_id = "temp"
config.display_name = "temp display"
config.data_source_id = "adwords"
config.schedule = "every 24 hours"
config.data_refresh_window_days = 7
config.disabled = False
config.params["customer_id"] = "XXX-XXX-XXXX"
config.params["exclude_removed_items"] = False
config.params["exclude_inactive_accounts"] = False
client.create_transfer_config(parent=parent, transfer_config=config)

Thanks for sharing! Sounds like it'll be important to have user-authentication samples for BQ-DTS.


Set include_only_confirmed to true

This PR excludes transactions that haven't yet been confirmed by the network from the list of transactions that are ready to be received by recipient.
This is one of two potential solutions. An alternative solution would require grouping pending transactions into two lists: "Transactions pending network confirmation" if "confirmed" is set to 'false', and "Transactions ready to be received" if "confirmed" is set to 'true'.
-
https://docs.nano.org/commands/rpc-protocol/?h=rpc#accounts_pending
Optional "include_only_confirmed"
version 19.0+
Boolean, false by default. Only returns blocks which have their confirmation height set or are undergoing confirmation height processing.

in my opinion, it makes sense to exclude unconfirmed blocks when viewing recipient's account chain, due to the fact that they are already excluded when viewing sender's account chain, and it results in inconsistent information being conveyed
it would still be possible to look up unconfirmed blocks with their hash (transaction id)

hmm it appears unconfirmed blocks appear in sender's account history so we would have to exclude these too for consistency..

There is a proposal to make true the default value for "include_only_confirmed". If it passes, this change is no longer required.
https://github.com/nanocurrency/nano-node/issues/3175

implemented in v22 node, explicit option value is no longer necessary


ResolverCache.loadInternalRef poorly written

The existing code looks in parameters for #/definitions and then later looks in definitions if it hasn't found anything yet.  It works, but the logic is very poor.
Here is a potential replacement:
private Object loadInternalRef(String ref) {

    if(ref.startsWith("#/definitions")) {
        return getFromMap(ref, swagger.getDefinitions(), DEFINITION_PATTERN);
    }
    if(ref.startsWith("#/responses")) {
        return getFromMap(ref, swagger.getResponses(), RESPONSE_PATTERN);
    }
    if(ref.startsWith("#/parameters")) {
        return getFromMap(ref, swagger.getParameters(), PARAMETER_PATTERN);
    }
    return null;
}

it could definitely be improved, could you send a PR?

Will do.

#351 has been merged.


[5.10][cxx-interop] Fix compiler crash when emitting objc header with C++ interop enabled

Explanation: In C++ interop mode, public functions with an empty-sized parameter trip an assertion incorrectly, because LoweredFunctionSignature::visitParameterList has a special case for parameters with an empty LLVM representation (e.g. an empty struct) but forgot to increment the counter.
Scope: C++ interop
Risk: Low
Testing: Unit test
Issue: #70016
Original PR: #70018
Reviewer: @artemcm

@swift-ci please test

@swift-ci please test macOS


odd "no packages can be updated"

I've an old version of go.crypto/{sha3,blowfish} (two packaged from 1 repo) that i want to update. in manifest:
		{
			"ImportPath": "code.google.com/p/go.crypto/blowfish",
			"Comment": "null-219",
			"Rev": "00a7d3b31bbab5795b4a51933c04fc2768242970"
		},
		{
			"ImportPath": "code.google.com/p/go.crypto/sha3",
			"Comment": "null-219",
			"Rev": "00a7d3b31bbab5795b4a51933c04fc2768242970"
		}

i try:
> ls Godeps/_workspace/src/code.google.com/p/go.crypto/sha3
keccakf.go  sha3.go  sha3_test.go
> ls ~/go/src/code.google.com/p/go.crypto/sha3/
doc.go  hashes.go  keccakKats.json.deflate  keccakf.go  register.go  sha3.go  sha3_test.go  shake.go
> godep update code.google.com/p/go.crypto/sha3
godep: no packages can be updated

:(
I ended up blowing out the dependencies manually, and re-adding it and it worked. :)

I think I am seeing the same issue. I have a repo that contains a go package as a sub-directory in a repository where the top level is not a go package. It saves fine but won't update. I assume this is a side-affect of not wanted to allow for updating of subpackages. But in this case it isn't a subpackage, but a top level package just contained in a subdirectory of the repo.

Just encountered the same issue. Glad to see I'm not alone.

Same issue here. We vendor github.com/prometheus/client_golang in github.com/prometheus/prometheus, and my GOPATH now has a slightly newer version which I want to save. But alas,
godep update github.com/prometheus/client_golang/model
godep: no packages can be updated

The exact revision at which this is happening in Prometheus is this: https://github.com/prometheus/prometheus/commit/d4ef509b0f4b808133cce7222cb202273854f253
I wonder if this is connected to us manually including some files in Godeps which godep didn't include (licenses of the vendored packages are legally required, but if they're in the vendored project's root and you only vendor packages from subdirectories, you're suddenly in violation).

This seems to be caused by this line here: https://github.com/tools/godep/blob/master/update.go#L205
If packages A and B are under the same root, and I try to only update B, the root will be marked for skipping update because A isn't being updated. I'm not sure what the motivation for this feature is, it seems that developers should be able to selectively update sub packages as they desire.
For what it's worth, I fixed my problem by globbing from the root in my godep update command. A helpful error message would go a long way

@mpuncel thanks so much saves a lot of time!
Is this on the radar to be fixed?

@mpuncel How would godep restore work if different packages in the same repo are recorded at different versions? Which is the right version of the repository to restore to? That goes away when we can get rid of godep restore, which won't be until after Go 1.6 though.

You're totally right. A better error message would be more than sufficient, this was a very confusing error to encounter as a user.

@mpuncel agreed.

@mpuncel Thank you for providing the information.  That is very useful and saved my time :)


[SPARK-44937][CORE] Mark connection as timedOut in TransportClient.close

What changes were proposed in this pull request?
This PR avoids a race condition where a connection which is in the process of being closed could be returned by the TransportClientFactory only to be immediately closed and cause errors upon use.
This race condition is rare and not easily triggered, but with the upcoming changes to introduce SSL connection support, connection closing can take just a slight bit longer and it's much easier to trigger this issue.
Looking at the history of the code I believe this was an oversight in https://github.com/apache/spark/pull/9853.
Why are the changes needed?
Without this change, some of the new tests added in https://github.com/apache/spark/pull/42685 would fail
Does this PR introduce any user-facing change?
No
How was this patch tested?
Existing tests were run in CI.
Without this change, some of the new tests added in https://github.com/apache/spark/pull/42685 fail
Was this patch authored or co-authored using generative AI tooling?
No

@srowen I don't know about spark OSS guidelines for when something should be backported or not. It's been in the code this way for many years and no one's complained so I think we can be fine with a backport. It's only with SSL support that this starts to become a problem, and since that functionality isn't being backported I assume we are fine?

Merged to master, 3.5, 3.4, 3.3
Thanks for fixing this @hasnain-db !
Thanks for the reviews @JoshRosen, @srowen :-)


Add FRR base training plans

Hello, and thanks for the tool!
This PR adds the 3 base training plans from "Faster Road Racing":

up to 30 miles per week
up to 45 miles per week
up to 60 miles per week

This is really great! Thanks so much for taking the time to put it together.


Failed: Update autorest version to prerelease 3.0.0-alpha.20240507.1

Triggered from pull request: https://github.com/Azure/autorest.csharp/pull/4682

API change check
API changes are not detected in this pull request.


consul ambiguous import

Hasn't the problem been solved yet?
$ go mod tidy
git.bitkinetic.com/micro/auth imports
	github.com/micro/go-micro imports
	github.com/micro/go-micro/config/cmd imports
	github.com/micro/go-micro/registry/consul imports
	github.com/hashicorp/consul/api: ambiguous import: found github.com/hashicorp/consul/api in multiple modules:
	github.com/hashicorp/consul v1.4.2<EMAIL_ADDRESS>	github.com/hashicorp/consul/api v1.2.0<EMAIL_ADDRESS>

@tttlkkkl why are you trying to tidy go-micro imports?

go.mod is defined as required by go-micro and you do not need to run go mod tidy. Any issues related to consul are because of their sub package go module use. There's not much we can do about this.


Better support for error_highlight (and similar)

I have just looked into why asciidoctor-pdf is broken in Fedora and this is the error:
  1) Asciidoctor::PDF::Converter#convert theme should log error with filename and reason if exception is thrown during theme compilation
     Failure/Error: (expect logger).to have_message expected
       expected ERROR message matching `(?-mix:because of NoMethodError undefined method `start_with\?' for 10:(Fixnum|Integer); reverting to default theme)' to have been logged, but got ERROR: could not locate or load the built-in pdf theme `/builddir/build/BUILD/asciidoctor-pdf-1.6.1/spec/fixtures/invalid-theme.yml' because of NoMethodError undefined method `start_with?' for 10:Integer
                     if (path.start_with? 'GEM_FONTS_DIR') && (sep = path[13])
                             ^^^^^^^^^^^^; reverting to default theme
     # ./spec/spec_helper.rb:644:in `block (3 levels) in <top (required)>'
     # ./spec/spec_helper.rb:508:in `with_memory_logger'
     # ./spec/spec_helper.rb:640:in `block (2 levels) in <top (required)>'
     # ./spec/converter_spec.rb:162:in `block (4 levels) in <top (required)>'

This is apparently caused by error_highlight gem introduced in Ruby 3.1 and it seems it has been fixed by 0fc983c86cdf49f0ce46618aab67e765e32ee0db. But replacing part of the error message seems to be big hammer, especially since Ruby is going to introduce yet another helper gem (syntax_suggest) in Ruby 3.2.
Other project had to deal with this and notably this is how it was fixed in RSpec:
https://github.com/rspec/rspec-expectations/pull/1339/files
So it seems that the DidYouMean gem (which was first in line of these developer friendly tools) keeps the plain Ruby error and it can be accessed via original_message if available. I think that this would also be better approach for asciidoctor-pdf.

I'm confused. Are you saying it has been fixed, or that the fix didn't work? We need to modify the error message to make it make sense. I first want to establish whether there is actually a bug, because all the tests are passing in CI.

Please note that Asciidoctor PDF < 2.0.0 is no longer supported and will not be receiving any more updates.

I'm confident that this error has already been fixed and the risk mitigated. We have no plans to release another version in the 1.6.x line since that release line has been closed for development. Therefore, I'm closing this issue as already resolved. Please use at least Asciidoctor PDF 2, preferably 2.3.

I am saying that the https://github.com/asciidoctor/asciidoctor-pdf/commit/0fc983c86cdf49f0ce46618aab67e765e32ee0db is more workaround then proper fix. It cuts of some part of the message without too much knowledge what is inside. Let me explain.
In Ruby 3.0 and older, the error message which is checked in the test case looked like:
ERROR: could not locate or load the built-in pdf theme `/builddir/build/BUILD/asciidoctor-pdf-1.6.1/spec/fixtures/invalid-theme.yml' because of NoMethodError undefined method `start_with?' for 10:Integer

That was it. But if error_highlight is enabled in Ruby 3.1+, it contains additional debug information:
ERROR: could not locate or load the built-in pdf theme `/builddir/build/BUILD/asciidoctor-pdf-1.6.1/spec/fixtures/invalid-theme.yml' because of NoMethodError undefined method `start_with?' for 10:Integer
                     if (path.start_with? 'GEM_FONTS_DIR') && (sep = path[13])
                             ^^^^^^^^^^^^; reverting to default theme

The current solution is:
diff --git a/lib/asciidoctor/pdf/converter.rb b/lib/asciidoctor/pdf/converter.rb
index bf10dcc7e..b5720978e 100644
--- a/lib/asciidoctor/pdf/converter.rb
+++ b/lib/asciidoctor/pdf/converter.rb
@@ -444,7 +444,7 @@ def load_theme doc
             message = %(could not locate or load the built-in pdf theme `#{theme_name}')
           end
           message += %( because of #{$!.class} #{$!.message})
-          log :error, %(#{message}; reverting to default theme)
+          log :error, (message.sub %r/$/, '; reverting to default theme')
           @themesdir = (theme = ThemeLoader.load_theme).__dir__
           prepare_theme theme
         end

I.e. cut everything behind end of line and replace it with 'reverting to default theme'. If the intention is to fiddle around with the message, the better solution would be:
diff --git a/lib/asciidoctor/pdf/converter.rb b/lib/asciidoctor/pdf/converter.rb
index ac4dd13b..ec035028 100644
--- a/lib/asciidoctor/pdf/converter.rb
+++ b/lib/asciidoctor/pdf/converter.rb
@@ -549,8 +549,8 @@ def load_theme doc
           else
             message = %(could not locate or load the built-in pdf theme `#{theme_name}')
           end
-          message += %( because of #{$!.class} #{$!.message})
-          log :error, (message.sub %r/$/, '; reverting to default theme')
+          message += %( because of #{$!.class} #{$!.respond_to?(:original_message) ? $!.original_message : $!.message})
+          log :error, %(#{message}; reverting to default theme)
           @themesdir = (theme = ThemeLoader.load_theme).__dir__
           prepare_theme theme
         end

However, the question is what is the real intent here. If it is provide the original message with some extended asciidoctor-pdf, then the test case should be adjusted instead.
P.S. the version is just red herring. That is what I have at hand. And if I used some more recent version, I would probably not notice that there could be IMHO better way, because it would just work.

Your understanding of what the code is doing is not correct. All the code is doing is inserting additional context at the location of the first newline. It is not cutting away any part of the message.
I'm not going to put in hacks that use the undocumented original_message property. Besides, there is no need as the tests prove that the code is working exactly as expected.

Your understanding of what the code is doing is not correct. All the code is doing is inserting additional context at the location of the first newline. It is not cutting away any part of the message.
I'm not going to put in hacks that use the undocumented original_message property. Besides, there is no need as the tests prove that the code is working exactly as expected.

Well, you already put hack there, you replace end of $!.message with '; reverting to default theme'. This is not less documented then the original_message.
But if you don't put hacks inside, then the test case should be fixed to accept that Ruby 3.1+ provides additional debug information in the exception.

you already put hack there, you replace end of $!.message with '; reverting to default theme'

That's not a hack. The code is writing to a documented property of the error object.

test case should be fixed to accept that Ruby 3.1+ provides additional debug information in the exception.

The tests already do run on Ruby 3.1, so I'm not sure why you are suggesting that the test needs to be changed to work.

IOW with Ruby 3.1 and error_highlihgt, this test is wrong:
https://github.com/asciidoctor/asciidoctor-pdf/blob/06040c03682c3e3365a3f09af850f4acafada7e0/spec/converter_spec.rb#L330
You have already put one workaround at place. If you don't want any, the the test should be fixed and possible the error handling as well, so it is readable.

Are you saying that in order to get the test to fail, I need to load the error_highlight gem?

Ok, I was wrongly reading the code, sorry about that. What it does is changing the error from:
could not locate or load the built-in pdf theme `/builddir/build/BUILD/asciidoctor-pdf-1.6.1/spec/fixtures/invalid-theme.yml' because of NoMethodError undefined method `start_with?' for 10:Integer
                     if (path.start_with? 'GEM_FONTS_DIR') && (sep = path[13])
                             ^^^^^^^^^^^^; reverting to default theme

to
could not locate or load the built-in pdf theme `/builddir/build/BUILD/asciidoctor-pdf-1.6.1/spec/fixtures/invalid-theme.yml' because of NoMethodError undefined method `start_with?' for 10:Integer; reverting to default theme
                     if (path.start_with? 'GEM_FONTS_DIR') && (sep = path[13])
                             ^^^^^^^^^^^^

IOW moving the ; reverting to default theme around.
Nevertheless, your assertion about The code is writing to a documented property of the error object. is not completely true IMHO. The problem is that the error message is not specified at all. The code and test did some assumptions, the situation changed and with that also the assumptions. The original_message as I proposed originally would not be any better. From this POV the fix is valid.
Thank you for helping me understand the code and sorry for the noise.

IOW moving the ; reverting to default theme around.

Exactly. Otherwise, it gets mixed up with the formatted error message. The first line is the "safe" area to add additional notations.

Nevertheless, your assertion about The code is writing to a documented property of the error object. is not completely true IMHO.

I meant to say that it is reading from the documented property of the error object, which is $!.message. That's the only error message we are given. And we are preserving it.

The code and test did some assumptions, the situation changed and with that also the assumptions.

I still don't understand what assumption you are talking about. The tests verify exactly what the user sees, which is this:
asciidoctor: ERROR: could not locate or load the built-in pdf theme `./my-theme.yml' because of NoMethodError undefined method `start_with?' for 10:Integer; reverting to default theme

              if (path.start_with? 'GEM_FONTS_DIR') && (sep = path[13])
                      ^^^^^^^^^^^^

We are putting everything we can put in a log message that is provided in this context. There is no other information available.


Question regarding division into S * S grid

First of all, thanks for the great work!
I had some questions regarding the implementation. As I correctly understand, a (9 * 2 + 1 + C) vector
is returned for each S * S grid where S is set to 13 to be same as YOLOv2 network. Where and how is this information regarding 'S' coded exactly?
As far as I tried to understand from the code, I could not find anything explicit to divide the image region into S * S grid. Does that S * S grid division come implicitly from the network architecture and the width and height of the RGB images in the initial layer and is reflected in the output dimensions S * S * D ? If it is so, how can we say for sure, that the network is dividing it that way, or if the S * S division is uniform ?
Also, in that case, if we change the output dimension to some other value say 7 * 7 * (9 * 2 + 1 + C), then would the network behave as if the images were divided into 7 * 7 grid?

The image is always divided into cells of size 32*32 pixels. So we use image-sizes that are multiples of 32. The number of such cells depends on the input size. For training, images with multiple sizes are used. The output dimensions are S * S * D, but S may be different for each batch.
Checkout this line in dataset.py.
If the input image size is 416416, S = 13
if the input image size is 672672, S = 21

Thanks for your explanation @saadhana.


Only information

Sometimes, mostly when there is a WLAN change, these error messages occur.
I can only fix them if I delete the errors and restart the extension.
After every browser restart I have to do it like this.
Should now only serve as info, so no urgent need to fix the error on my part.
Top work, thank you for it. Keep it up!

I have the same issues for a few secs/minutes when a lan issue appear and resolve itself.
I believe this might be caused by some cache and some keepalive settings but I am pretty sure it's not an extension issue and something that can be solved on this side.


Define a minimum Scrapy version

We should indicate a minimum Scrapy version in the README.
I also wonder if Scrapy should be a dependency, setup.py-wise, so that the right version of Scrapy (or, more likely, the other way around) can be enforced during installation. scrapy-zyte-smartproxy does it.

I think we could perhaps set 2.6, as the minimum as briefly discussed in https://github.com/scrapy-plugins/scrapy-zyte-api/pull/10#discussion_r883248928.
+1 on enforcing it in the install_requires param.


Get commits GitHub

**ACTIVE**: comment

**ACTIVE**: dfgbnh

ACTIVE: the bold type
https://github.com/hubreviewapp/hubreview/pull/73#issuecomment-2037099515

never gonna let you down

**ACTIVE**: I have a dream, a song to sing.

**ACTIVE**: hfhfghhgnh

ACTIVE: hfhfghhgnh
https://github.com/hubreviewapp/hubreview/pull/73#issuecomment-2048227528

merhaba irem

ACTIVE: hfhfghhgnh
https://github.com/hubreviewapp/hubreview/pull/73#issuecomment-2048227528

merhaba irem

ACTIVE: hfhfghhgnh
https://github.com/hubreviewapp/hubreview/pull/73#issuecomment-2048227528

karpuz

**ACTIVE**: böcek

**ACTIVE**: çiçek

**ACTIVE**: arı

**ACTIVE**: YORUM

YORUM 2 YA

YORUM 3

**ACTIVE**: test

ACTIVE: test
https://github.com/hubreviewapp/hubreview/pull/73#issuecomment-2072085327

reply to alper

ACTIVE: dfgbnh
https://github.com/hubreviewapp/hubreview/pull/73#issuecomment-2030436505

ayseye reply

ACTIVE: dfgbnh
https://github.com/hubreviewapp/hubreview/pull/73#issuecomment-2030436505

ayseye reply

https://github.com/hubreviewapp/hubreview/pull/73#issuecomment-2072120336

ireme reply

**ACTIVE**: bir yorum

ACTIVE: bir yorum
https://github.com/hubreviewapp/hubreview/pull/73#issuecomment-2072275681

bana cevap

ACTIVE: bir yorum
https://github.com/hubreviewapp/hubreview/pull/73#issuecomment-2072275681

bana cevap

https://github.com/hubreviewapp/hubreview/pull/73#issuecomment-2072276587

cevabıma cevap

ACTIVE: bir yorum
https://github.com/hubreviewapp/hubreview/pull/73#issuecomment-2072275681

bana cevap

https://github.com/hubreviewapp/hubreview/pull/73#issuecomment-2072276587

cevabıma cevap

https://github.com/hubreviewapp/hubreview/pull/73#issuecomment-2072277359

cevabımın cevabının cevabııı

ACTIVE: the bold type
https://github.com/hubreviewapp/hubreview/pull/73#issuecomment-2037099515

never gonna let you down

https://github.com/hubreviewapp/hubreview/pull/73#issuecomment-2041446452

reply

**ACTIVE**: kkmönmvvcccvcvcxcvcvcvcvcv


VIDNY-261. Updated version of the videojs in html's href.

Many fixes happened since 5.9.x in videojs in particular for iOS support:
https://github.com/wikimedia/mediawiki-extensions-TimedMediaHandler/commit/69c91c59fb4034a55d8aa6cbc41fe7c285b8ae13
Updated version of the videojs script from 5.9.2 to 6.4.0 in the html... that fixed issue.

Thanks @xlaboratory !


fix(config): APTT-507 when module is linked statically use a #define …

…RPT_SDK_VERSION from the podspec as a fallback for getting the SDK version

Codecov Report

Merging #50 into master will decrease coverage by 0.12%.
The diff coverage is 85.71%.

@@            Coverage Diff             @@
##           master      #50      +/-   ##
==========================================
- Coverage   87.92%   87.79%   -0.13%
==========================================
  Files          25       25
  Lines        1292     1295       +3
==========================================
+ Hits         1136     1137       +1
- Misses        156      158       +2

Impacted Files
Coverage Δ

RPerformanceTracking/Private/_RPTTrackingManager.m
97.2% <100%> (-0.02%)
:arrow_down:

RPerformanceTracking/Private/_RPTEnvironment.m
96.29% <75%> (-3.71%)
:arrow_down:

...ng/Private/_RPTClassManipulator+UIViewController.m
98.38% <0%> (-1.62%)
:arrow_down:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update e6d3ca2...ba9f474. Read the comment docs.


Standardized menu and shortcut to match the system’s

Fixes issue #557 and standardizes application's menu to match the system.
My own approval.
    ↓

Nice! I do like/prefer how this is done. I will try and test later on if I get chance (don't usually work weekends)

Oh, could you fix the build errors please. Complaining about unused globalShortcut. Thanks!

Done

@alexbarnsley Could you review it? (I don't have OSX)

@gabrielbull I like how this all works. However, Cmd + H doesn't hide the window like it used to with my High Sierra OS.

@alexbarnsley That's weird, it works fine for me. On macOS, you cannot hide an application if it is the only application visible. You can try this with any other application, like Safari, try to hide all other applications with ⌥⌘H and then try to hide Safari with ⌘H, it will not hide. Have you made sure that Ark is not the only visible application? Make sure you see another's application window and Ark's window at the same time.

Don't worry. I think it'll be an issue with my setup (i've probably got something controlling keyboard shortcuts). It doesn't work on Chrome either as you say, and i have loads of windows open. The menu shows ⌘H as the shortcut.
I was happy other than this, and blaming my setup! Thanks! 👍

@gabrielbull provide me with your ARK address or contact me on Ark slack (boldninja) if you don't want to share it publicly.

88/A/U


Pool not utilising available CPUs

Description
Hi, I'm sure this will turn out to be more of a question rather than a bug, anyway... I'm trying to run a very basic example script following from the example provided in the repo. I'm using aiomultiprocess.Pool to execute a task which sleeps and then does some CPU intensive work. I've timed the execution and it takes the same amount of time with aiomultiprocess.Pool when running with 1 process or 2, or 4, or 8.
Further to this, I have added equivalent implementations using asyncio (which just runs on a single process of course) and multiprocessing.Pool. The asyncio version takes the same amount of time as the aiomultiprocess.Pool version. The multiprocessing.Pool version takes less than half the time when running with 4 cores which is in the range of my expectations.
As well as the timing results I can also see from watching htop during the experiment that the aiomultiprocess and asyncio versions are maxing out a single CPU whilst the multiprocess version is using around 80% on 4 of 8 of the available logical cores on my machine at any given moment. As an aside, is there a better way to check CPU utilisation of python scripts rather than eye balling htop?
Here's an example script showing the three implementations. I think I've done everything correctly as far as I can tell but clearly I must be missing something! I like the look of aiomultiprocess and would like to use it in a project at work so any help getting it working would be much appreciated!
#!/usr/bin/env python3
"""A simple example of multiprocessing + asyncio with the aiomultiprocess library.
"""

import asyncio
import multiprocessing
import time
from typing import Any, Dict, List

import aiomultiprocess

SLEEP_TIME = 0.1
CALC_ITERS = 100000000

def calc(iters=CALC_ITERS) -> float:
    """Performs FLOPS in a loop with specified number of iterations."""
    x = 0.0
    for i in range(1, iters + 1):
        x = (x + i) / i
    return x

async def exec_and_sleep(*args: List, **kwargs: Dict) -> float:
    """Sleeps and then runs a CPU bound function."""
    await asyncio.sleep(SLEEP_TIME)
    return calc()

def get_or_create_event_loop():
    try:
        return asyncio.get_event_loop()
    except RuntimeError as ex:
        if "There is no current event loop in thread" in str(ex):
            loop = asyncio.new_event_loop()
            asyncio.set_event_loop(loop)
            return asyncio.get_event_loop()

def wrap_async(fn, args, kwargs) -> Any:
    loop = get_or_create_event_loop()
    result = loop.run_until_complete(fn(*args, **kwargs))
    return result

async def main_aiomultiprocess() -> None:
    async with aiomultiprocess.Pool(processes=4) as pool:
        results = await pool.map(exec_and_sleep, [() for _ in range(4)])
        print(results)

async def main_asyncio() -> None:
    results = await asyncio.gather(*[exec_and_sleep() for _ in range(4)])
    print(results)

def main_multiprocessing() -> None:
    with multiprocessing.Pool(processes=4) as pool:
        results = pool.starmap(wrap_async, [(exec_and_sleep, (), {}) for _ in range(4)])
        print(results)

if __name__ == "__main__":
    t_start = time.monotonic()
    asyncio.run(main_aiomultiprocess())
    t_total = time.monotonic() - t_start
    print(f"Execution of {main_aiomultiprocess.__name__} took {t_total:.2f}s")

    t_start = time.monotonic()
    asyncio.run(main_asyncio())
    t_total = time.monotonic() - t_start
    print(f"Execution of {main_asyncio.__name__} took {t_total:.2f}s")

    t_start = time.monotonic()
    main_multiprocessing()
    t_total = time.monotonic() - t_start
    print(f"Execution of {main_multiprocessing.__name__} took {t_total:.2f}s")

Here's the results of running the script
(.venv-dev) csk@aquila: PMF $ aiomultiprocess-simple-example.py
[1.0000000100000002, 1.0000000100000002, 1.0000000100000002, 1.0000000100000002]
Execution of main_aiomultiprocess took 23.48s
[1.0000000100000002, 1.0000000100000002, 1.0000000100000002, 1.0000000100000002]
Execution of main_asyncio took 23.36s
[1.0000000100000002, 1.0000000100000002, 1.0000000100000002, 1.0000000100000002]
Execution of main_multiprocessing took 10.52s

Details

OS: Ubuntu 20.04 LTS
Python version: 3.7.11
aiomultiprocess version: 0.9.0
Can you repro on master? Not checked
Can you repro in a clean virtualenv? Yes

@jreese I have come across this confusion, and I would be grateful if you could solve it

@chrisk314 @fz-gaojian The default child_concurrency is 16, change to 0 or 1 and behavior would be as you expected.


item metadata returns a 'bundle' field - undocumented facet or bug?

I have come across an item that looks like a folder from the UI but when requesting metadata it does not have a folder facet, but instead returns a 'bundle' field containing 'childCount' information.
Is this some undocumented facet that acts similarly to a folder? If so, what is the difference from a folder?
Also, in case this is a feature and not a bug, is there a way to call view.delta on such an item? Because the typical way of requesting /drive/items/{itemId}/view.delta gives a 'Method Not Allowed' error.

You have indeed stumbled across an undocumented facet :)
A bundle is like a folder, except it doesn't have "ownership" of its contents like folders do. The OneDrive apps use these for Albums and for grouping items together in multi-select sharing.
The reason it's not yet documented is that, as you discovered, view.delta isn't supported. You have to do a full enumeration to see what changed (though you could optimize by looking at parent timestamps/ctags to cut down your recursion).
Curious, how did you come across one of these in the API? Did you plug in an ID that you found in the UI?

Thanks for the response! A few additional questions:

Not having "ownership" of the contents means the contents are also available in the drive through some other path? Sort of like a folder with links?
Getting the contents works like folders (i.e. with /drive/items/{item-id}/children)?
Do normal items (i.e. files and folders) within a bundle support view.delta as usual?

I got the item through the /drive/view.sharedWithMe endpoint.

Yes, exactly.
More or less. Access by path (or by 'children') won't work consistently. Bundles can also contain items that live in multiple drives. The best thing to do for now is to get the DriveID and ItemId for the thing you want to access, and get to it through /drives/{drive-id}/items/{item-id}.
They do if you access them "directly" (ie not through the bundle).

Ah, yes, SharedWithMe. For some reason I thought we filtered bundles out, but that's clearly not the case :)

Ok, thanks for the information!

So just for testing purposes how can I create a new bundle, either from the UI or trough the API?
I tried creating a new folder but using the bundle facet instead of folder as shown below, but this returns a folder.
{
"name": "MyBundle",
"bundle" : {} //I also unsuccessfully tried "bundle" : { "childCount": 0 }
}
This seams to be in the right direction though, as without any facet I get an error message saying "Must provide one of the following facets to create an item: Bundle, File, Folder, RemoteItem". I'm probably missing some additional information that goes inside the bundle facet.

@johnlilis I got a little further: I POSTed a payload:
{
  "name": "Test Album",
  "bundle": {
    "album": {}
  }
}

and got a response
{
    "error": {
        "code": "accessDenied",
        "message": "Access Denied",
        "innerError": {
            "request-id": "9eb484d7-702b-422f-9db8-019a6df0f721",
            "date": "2018-08-29T20:44:40"
        }
    }
}

Don't have any clue what kind of permission is necessary to create albums. Any thoughts?

As part of a repository clean up effort we are closing older issues. If this issue remains, please: open a new issue, reference this issue, and provide any additional details that may help in resolution. Thank you for your understanding as we work to improve our responsiveness.


added a "go to games" button and the UI of play cards #697

Added a button at navbar which direct user towards the games section and make the arrangement of games-card more clear visible and readable to user.
fixed issue #697

Please Create new PRs for this because it contains conflict issue.


DynamicLinks.GetShortLinkAsync crashes on Android

[REQUIRED] Please fill in the following fields:

Unity editor version: 2019.4.11f1
Firebase Unity SDK version: 6.16.0
Source you installed the SDK: Unity Package Manager
Problematic Firebase Component: DynamicLinks
Other Firebase Components in use: Analytics, App, Auth, Crashlytics, Database, Functions
Additional SDKs you are using: Facebook
Platform you are using the Unity editor on: Mac, Windows
Platform you are targeting: iOS, Android
Scripting Runtime: IL2CPP

[REQUIRED] Please describe the issue here:
We are using DynamicLinks to generate an invite link. There is no issue generating a long link and sending+receiving it on Android or iOS. However, it immediately crashes after receiving the response for GetShortLinkAsync on Android (iOS is fine).
There is an error just after the GetShortLinkAsync response:
indirect_reference_table.cc:60] JNI ERROR (app bug): accessed stale Local 0x21  (index 2 in a table of size 0)
which looks like a GC issue (https://stackoverflow.com/questions/14765776/jni-error-app-bug-accessed-stale-local-reference-0xbc00021-index-8-in-a-tabl). We're targeting api level 30, minimum api level 21, if that's relevant.
Full crash log dynamiclinks-crash.log
Steps to reproduce:
Have you been able to reproduce this issue with just the Firebase Unity quickstarts (this GitHub project)?  Have not tried yet
What's the issue repro rate? 100%
What happened? How can we make the problem occur?
Run GetShortLinkAsync on Android. I used a Pixel 3.
Note: this issue sounds similar to #429 in title, however we have not enabled stripping or Proguard.
Relevant Code:
Our code is pretty similar to the Unity example (https://firebase.google.com/docs/dynamic-links/unity/create):
public void GetShortLinkAsync(Action<string> callback)
{
    string deeplink = "some deeplink";
    string dynamicLinkPrefix = "prefix setup on Firebase console";

    // generate long link (works)
    DynamicLinkComponents components = new DynamicLinkComponents(
        new System.Uri(deeplink),
        dynamicLinkPrefix)
    {
        IOSParameters = new IOSParameters("our ios package"),
        AndroidParameters = new AndroidParameters("our android package"),
    };

    Debug.LogWarning("GetShortLinkAsync longlink " + components.LongDynamicLink.ToString());

    // generate short link
    var options = new DynamicLinkOptions
    {
        PathLength = DynamicLinkPathLength.Default
    };

    DynamicLinks.GetShortLinkAsync(components, options).ContinueWith(task => {
        // if the short link failed, just use the deeplink as is
        if (task.IsCanceled)
        {
            Debug.LogError("GetShortLinkAsync was canceled.");
            callback?.Invoke(deeplink);
            return;
        }
        if (task.IsFaulted)
        {
            Debug.LogError("GetShortLinkAsync encountered an error: " + task.Exception);
            callback?.Invoke(deeplink);
            return;
        }

        // Short Link has been created.
        ShortDynamicLink link = task.Result;
        var warnings = new List<string>(link.Warnings);
        string warningsString = "";
        foreach (var warning in warnings)
            warningsString += "\n" + warning;
        Debug.LogWarning("GetShortLinkAsync Generated short link "+ link.Url+", warnings "+warnings.Count+warningsString);
        callback?.Invoke(link.Url.ToString());

        // CRASH on Android
    });
}

Hi @robotoKK ,
Would you mind updated to the latest version and validating that you're still running the issue. RemoteConfig's underlying Android implementation has gone through some significant refactors since the 6.x implementation, and just the version bump to 7.0.1 should hopefully put you in a better state.
--Patrick

@patm1987 thanks for the info! We can't upgrade to 7.0.1 just yet since Firebase is now built with XCode 11.7 as of 7.0.0. Our project depends on Unity Cloud Build for our release builds, and it only supports up to XCode 11.4.1. Unity said they will update this soon. I can try 7.0.1 locally though.
As a workaround until we can upgrade, we found that the DynamicLinks REST API works fine with UnityWebRequest on both Android and iOS (better even, since it works on Web and in Editor too), though the package manager version is still required to receive links.

I get that. Perhaps if you could try reproducing on the quickstart (it should be fine to configure it with the same app id &c as your current app to make everything easier). If you see the crash on the Firebase SDK there (7.0.1), that would help a ton. If you can't get it to work on 7.0.1 but it does occur on 6.16.0, it'd be useful to know and maybe there's a better workaround that could be tracked down.


Fixed grammatical errors in README.md

Description

Fixed 39 issues in README.md which include spelling mistakes and grammatical errors.
Motivation and Context

This change is required to provide a more clear, lucid, and user-friendly README.md

[x] I have raised an issue to propose this change, which has been given a label of design/approved by a maintainer (required)

How Has This Been Tested?

If updating or adding a new CLI to arkade get, run:
go build && ./hack/test-tool.sh TOOL_NAME

Types of changes

[ ] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to change)

Documentation

[ ] I have updated the list of tools in README.md if (required) with ./arkade get --format markdown
[ ] I have updated the list of apps in README.md if (required) with ./arkade install --help

Checklist:

[x] My code follows the code style of this project.
[ ] My change requires a change to the documentation.
[x] I have updated the documentation accordingly.
[x] I've read the CONTRIBUTION guide
[x] I have signed-off my commits with git commit -s

[ ] I have tested this on arm, or have added code to prevent deployment

Hi, this looks like it might have been generated by an automated tool, parts of the output you want to change are auto-generated from upstream projects, so cannot be changed.
I'll take a look over this and cherry pick what I think is worth changing.
FYI, sign-offs need a proper email address, and a no-reply address won't pass checks.
Alex

/close: cherry-picked elsewhere as per https://github.com/alexellis/arkade/pull/990#issuecomment-1772738421

/lock: resolved


Benchmarks fail due to AttributeError: run_with_pdb

This started happening recently, most probably due this commit: https://github.com/GoogleCloudPlatform/PerfKitBenchmarker/commit/90064bbb3a693cf625193c974428fa16c5f9a0a0
Example stacktrace can be found here: https://builds.apache.org/view/A-D/view/Beam/job/beam_PerformanceTests_TextIOIT/342/console

Thanks for the report.  Fixed in https://github.com/GoogleCloudPlatform/PerfKitBenchmarker/pull/1622/commits/acea9babe2d2f0b3886e44264548a914337e55a3

Merged in https://github.com/GoogleCloudPlatform/PerfKitBenchmarker/pull/1622


feat: ignore trailing slash support

This PR aims to support the ignoreTrailingSlash permission option, in order for Rond to recognize two paths that differ uniquely because of the presence of a trailing slash, as the same path.
Configuration validation
Invalid configuration examples:

the same path is registered with and without slash; the GET verb is defined in both paths; both of these paths, for this verb, have the ignoreTrailingSlash flag set to true.
the same path is registered with and without slash; the GET verb is defined in both paths; for one of these paths, for this verb, the ignoreTrailingSlash flag is set to true, while for the other one it is not set.
the same path is registered with and without slash; the first path has the ALL verb configured, the second one the GET verb; for the first path, the ignoreTrailingSlash flag is set to true, while for the other one it is not set.

Valid configuration examples:

the same path is registered with and without slash; the GET verb is defined in both paths; both of these paths, for this verb, have the ignoreTrailingSlash flag set to false or not set.
the same path is registered with and without slash; the first path has the GET verb configured, the second one the POST verb; both of these paths, for the respective verb, have the ignoreTrailingSlash flag set to true.
the same path is registered with and without slash; the first path has the ALL verb configured, the second one the GET verb; for the first path, the ignoreTrailingSlash flag is set to false, while for the other one it is set to true.

After the changes in this PR can you submit a PR in the documentation site as well?
github.com/rond-authz/rond-authz.github.io


feat(localstore): add chunkstore

Checklist

[ ] I have read the coding guide.
[ ] My change requires a documentation update, and I have done it.
[ ] My change requires updating the Open API specification and/or changing its version, and I've done it.
[ ] I have added tests to cover my changes.
[ ] I have filled out the description and linked the related issues.

Description

Motivation and context (Optional)

Related Issue (Optional)

Screenshots (if appropriate):

This change is

So there were some issues during rebase and it is easier to do a separate PR. Closing this.


Restore clean compilation with USE_MCJIT=1, at least for LLVM 3.4

Amended this pull request with more MCJIT-related work:
Primarily, remove all build-time MCJIT options. Instead, it automatically compiled in MCJIT support if it's using a new enough LLVM. Additionally, there is a "llvm_mcjit" runtime ShadingSystem attribute (defaulting to off). So now the logic is:

LLVM < 3.3 : use old JIT
LLVM 3.3-3.5 : use old JIT by default, but use MCJIT if "llvm_mcjit" attribute was set to nonzero.
LLVM >= 3.6 : always use MCJIT (no more old JIT)

I don't yet recommend turning on "llvm_mcjit" -- there are some performance issues that I'm continuing to work through. But this makes it easier for me to experiment, in the hopes of coming up with a superior MCJIT solution.

LGTM


Consider adding a ContinuingTrainer subclass for LoftQ models

Implementing LoftQ as an alternative to QLoRA would provide several advantages.

Much smaller base model downloads (75% less data transferred)
Significantly more accurate starting model.  (the quantization damage is mostly repaired by remedial LoRA initialization)
Merging the trained adapter into the model would be higher fidelity and thus survive more rounds of train/merge train again.

Resources:
https://arxiv.org/pdf/2310.08659 (LoftQ paper)


	As a website user with a disability, I want to be able to access and use the website without barriers, so that I can benefit from the content and functionality.

Acceptance criteria

User with a visual impairment can navigate the website using a screen reader and access all of the website's content.
User with limited mobility can use the website's keyboard-only navigation and access all of the website's features.
User with a hearing impairment can access video content with closed captioning.
User attempts to fill out a form, but the form fields are not labeled properly, causing confusion and difficulty.
User with a cognitive disability becomes overwhelmed by flashing content on the website and experiences a seizure.
User with a mobility impairment is unable to access certain features of the website due to lack of keyboard navigation.

Importance: High
Urgency: High
Estimation: 1-2 weeks
Resources: accessibility guidelines, accessibility testing tools, website design expertise, user feedback
Story Points: 8


Fix session string

Fix replit session string.
Ive tried tg-login aswell and other session strings replit. same problem. must have to do with some update telegram has done.
When are you fixing this? been 2-3 months people started to complain about it, still not fixxed.

i also need sesssion string, tried google diff. solutions, nothing working, can anyone help ?

I did solve by install the tg-login in the my-tgcf folder.

I did solve by install the tg-login in the my-tgcf folder.

Yes i got it working but i found out its not working to forward other private channels? Where can i not put the bot inside??

You cant get a bit inside a private channel, you have to use a user for that.

You cant get a bit inside a private channel, you have to use a user for that.

yes. i have the user(my phone number) inside that. but can tgcf forward those messages then or not ? i am confused

yes, then could also have shut off Forwarding function if it is a channel, then its not possible.


"Could not get Apple Pay session" error in logs

Hi, we have noticed a number of Apple Pay session errors in our logs. They seem to be related to merchant validation. We get about 50 errors a day (so very low numbers but something we want to address). We have been in touch with Adyen support but felt it would be worth raising an issue here as it does not seem to be configuration related.
We use the Adyen Apple Pay certificate and the Apple Pay component (not dropin). We use @adyen/adyen-web version 5.52.0 and 5.55.1 (2 different environments, with the error happening for both versions)
The errors we receive are
Could not get Apple Pay session
InvalidAccessError: The object does not support the operation or argument.

This is thrown when calling completeMerchantValidation inside the onvalidatemerchant method of ApplePayService.ts
https://github.com/Adyen/adyen-web/blob/f574a64bacefc9ffced49beb012654faad029e41/packages/lib/src/components/ApplePay/ApplePayService.ts#L75
The only related issue I’ve found online is this https://stackoverflow.com/a/39480875, which makes me wonder if maybe there are scenarios where what is passed to completeMerchantValidation is inaccurate. I'm drawn to the You can use the merchant session object a single time line on https://developer.apple.com/documentation/apple_pay_on_the_web/apple_pay_js_api/providing_merchant_validation and am wondering if there could be scenarios (rerenders perhaps) where the same session data is used twice
We are using a fairly standard implementation using the example here as a base. We log when our component remounts and don't see that happening (so if a rerender is causing a stale merchant session object I don't think the rerender is happening on our application)
Is this an error that anyone has seen before or has any idea about the possible cause of? Many thanks

Hey @willhowlett ,
Do you have any visibility of what happens when this error occurs? Does the ApplePay payment sheet closes and shopper needs to retry/try another payment method or is it still possible to make the payment? Are you by any chance catching any error in the onError callback? It is quite hard to tell what could be going wrong here

The only related issue I’ve found online is this https://stackoverflow.com/a/39480875, which makes me wonder if maybe there are scenarios where what is passed to completeMerchantValidation is inaccurate. I'm drawn to the You can use the merchant session object a single time line on https://developer.apple.com/documentation/apple_pay_on_the_web/apple_pay_js_api/providing_merchant_validation and am wondering if there could be scenarios (rerenders perhaps) where the same session data is used twice

The session is created every time that the button is pressed, so it must be a different session every time the button is clicked. We do not keep it saved anywhere in order to reuse it, so I believe this use-case of reusing the same session twice is possible.

Regarding your implementation and the example that you used as base, I'd tweak it a bit since the ApplePay has the isAvailable() method which detects if you should mount or not the Component within the page:
const applepay = checkout.create('applepay');

applepay.isAvailable()
  .then(() => {
    applepay.mount('#applepay-container');
  })
  .catch(() => {
   // Component not available
  });

One thing that you could possibly do in order to check what is being passed to the completeMerchantValidation and to verify that this is not being triggered 'multiple times' due to some re-render is to provide your own onValidateMerchant function to the ApplePay Component.
As part of its implementation, you can write your code following what we have in place. This way you will be able to always verify the response of the session data and also be able to have more ownership of what is being passed to completeMerchantValidation function.  Perhaps this can help to spot the issue.

Many thanks for the response! Regarding isAvailable we do already do an ApplePaySession check higher up the stack to decide whether to include ApplePay at all, however we're going to modify it to match the isAvailable check here so will see if that makes any difference
We'll have a look at implementing our own onValidateMerchant method as well.
Thanks again for the advice. I will post back if we see any results

@willhowlett nice! I hope it works for you. I am going to close this issue for now, but feel free to reach out back again if the problem persists after your changes. We can reopen this thread and follow up on the problem.
Cheers

Hiya. Just wanted to report back that matching the Adyen isAvailable check seems to have made a difference (we have had 5  Could not get Apple Pay session in the last week which look to just be network issues)
The InvalidAccessError: The object does not support the operation or argument. error looks to be occur when the user closes the pay sheet before the validation occurs (video attached) so not a biggie. User here reports the same thing: https://forums.developer.apple.com/forums/thread/740453
Just thought I'd let you know in case it comes up again for other users
Thanks for your time!
https://github.com/user-attachments/assets/ae69d069-3de3-4e0b-ba9b-586e00ab8067


Authenticate, go home from login page

If a user is already logged in but because of an unknown reason ends up on the login page.
The login page for logged-in users is useless.
Possible reasons:

Not the best bookmark
Cached autocompletes

Ok, I suppose, this might be nice change but so many integration tests should be fixed. Maybe bit later.

Good change! I am surprised by the number of failing tests...

It looks like there has not been any activity here for a while. In order to keep the list of pull requests in a manageable state, we are closing this one for now. If we are making a mistake here, please reopen the pull request, and leave us a note 😄


[Linux] desktop file is lacking a Categories= entry

The desktop file is lacking a Categories= entry in the *.desktop file.
According to the menu spec,

By including one of the Main Categories in an application's desktop entry file, the application will be ensured that it will show up in a section of the application menu dedicated to this category. If multiple Main Categories are included in a single desktop entry file, the entry may appear more than once in the menu.

Hence, please add at least one of the following in the Categories= key.

Main Category
Description
Notes

AudioVideo
Application for presenting, creating, or processing multimedia (audio/video)

Audio
An audio application
Desktop entry must include AudioVideo as well

Video
A video application
Desktop entry must include AudioVideo as well

Development
An application for development

Education
Educational software

Game
A game

Graphics
Application for viewing, creating, or processing graphics

Network
Network application such as a web browser

Office
An office type application

Science
Scientific software

Settings
Settings applications
Entries may appear in a separate menu or as part of a 		"Control Center"

System
System application, "System Tools" such as say a log viewer or network monitor

Utility
Small utility application, "Accessories"

In addition, you could specify one or more from the longer list of Additional Categories.
Please test the result with desktop-file-validate and make sure it passes.
electron-builder offers native support for this since v19.22.1.
Reference: https://github.com/AppImage/AppImageHub/issues/2

Thanks for feedback @probonopd.
We actually don't use electron to build the linux files but @EragonJ let's try to build it with electron as we use the home directory instead of /usr/share/Kaku/... 👍

OK; in this case simply forget about the electron-builder comment ;) the desktop file should be easy to fix.

@funilrys so what's the action item here ? can you help on this part because it's linux related lol

kaku.desktop file has the following entry
Categories=Application;Audio;AudioVideo;
and works for me on KDE/Plasma 5 desktop. The application is categorized as it should be on Linux.


How to debug msal:loginFailure, AADB2C90085?

Library

[ ]<EMAIL_ADDRESS>[ ]<EMAIL_ADDRESS>
Framework

[ ] React 16.14 (CRAv3)

Description
~3 weeks ago I switched from MSAL v1 to MSAL-Browser  and MSAL-React. Everything worked as expected for about two weeks, when suddenly 2 of the 3 envs started to misbehaving at login with the custom policies.
Most of the issues are resolved (reverting a change in the policy and regenerating the singing key), but still facing a mysterious one. Not sure what and where is failing.
I'm using the the useMsal() hook to get the instance and initiate a loginRedirect with a signed token if there is no authenticated user:
      await instance.loginRedirect({
        authority: authority for the policy,
        scopes: [api endpoint for access token],
        extraQueryParameters: {
          id_token_hint: signed id token ,
        },
      });

If it fails, it fails for the  '.../oauth2/v2.0/token' endpoint POST request. Seemingly all the required data is provided (code/code_verifier etc.), but the response is:
{   "error": "invalid_grant",   "error_description": "AADB2C90085: The service has encountered an internal error. Please reauthenticate and try again.\r\nCorrelation ID: 84......2b\r\nTimestamp: 2021-03-02 13:41:45Z\r\n" }
Now I cannot see or catch this error in any way. B2C trace says everything was ok, 'JourneyCompleted' so no exceptions in AppInsights and it does not go to catch either with the loginRedirect, I see it only in the browser network tab and Fiddler. Although msal-browser emits loginFailure:
<EMAIL_ADDRESS>: Info - Emitting event: msal:handleRedirectStart
<EMAIL_ADDRESS>: Info - MsalProvider - msal:handleRedirectStart results in setting inProgress to handleRedirect
<EMAIL_ADDRESS>: Info - in acquireToken call

 POST https://xxx.b2clogin.com/xxx.onmicrosoft.com/b2c_1a_xxx/oauth2/v2.0/token 400 (Bad Request)

<EMAIL_ADDRESS>: Info - BrowserCacheManager.cleanRequestByInteractionType: Removing temporary cache items for state: eyJ...
<EMAIL_ADDRESS>: Info - Emitting event: msal:loginFailure
<EMAIL_ADDRESS>: Info - MsalProvider - no account changes
<EMAIL_ADDRESS>: Info - MsalProvider - msal:loginFailure results in setting inProgress to none
<EMAIL_ADDRESS>: Info - Emitting event: msal:handleRedirectEnd
<EMAIL_ADDRESS>: Info - MsalProvider - no account changes

Any idea how to approach this? Can it be an MSAL bug or  it must be a custom policy issue?
This solution worked for weeks (with implicit flow and now with the authorization code flow).

@voloszad Could you open a ticket with the B2C support service? It sounds like this is an issue with the B2C service. You can file a support ticket here and link this issue in that ticket.

@pkanher617 Thank you for the response. We did that in the same time. No conclusion from the support yet, but it's definitely either or a combination of the custom policy or identity server.
Still curious if there is a token endpoint error, why can't I catch it in the application with MSAL?
Currently if the root page is protected and the user tries to sign in, after redirecting back to the app the user gets in a loop. MSAL knows there was a failure, but the interesting part, that the authentication was successful from B2C side , just the tokens never arrived, hence the loop.
Login page is not showing up again. Because there is a valid session from the user, MSAL calls for token, but never gets them, page reloads MSAL calls B2C again and it goes around again.

Still curious if there is a token endpoint error, why can't I catch it in the application with MSAL?

The error you posted looks like it is in the format of an error object created by MSAL. Where is this error object coming from?
MSAL should be throwing the error in handleRedirectPromise, so you should be able to surround this with a try/catch or using a .catch block on the promise returned from this API. If you aren't seeing a ServerError coming from this we can investigate it.

Currently if the root page is protected and the user tries to sign in, after redirecting back to the app the user gets in a loop. MSAL knows there was a failure, but the interesting part, that the authentication was successful from B2C side , just the tokens never arrived, hence the loop

If we aren't getting tokens from the service, there isn't much we can do other than forward whatever error the service has given us. The easiest way to ensure that the app doesn't loop is to only call loginRedirect when handleRedirectPromise returns null, because that means that it has not detected an authentication response hash. However if, as you are describing, the handleRedirectPromise API is not returning any values, there is probably some other issue going on. If you can, please post a snippet of how your app is handling redirects and we can assist you further.


TypeScript/ES2015 bundle fails due to unreplaced TypeScript syntax

I'm trying to use TypeScript and ES2015 features and have them work in browser or bundled.  I learned the hard way that TypeScript does not attempt to transpile ES2015 iterator features.  It will pass for/of syntax right through to the browser, but if what's being iterated is not an array, it won't work.  The solution as I understand it is to configure TypeScript with target: "es6" and then run the result through a more complete transpiler like babel.  This is working well enough in the browser, but when I try to bundle, I get an error because the file also contains TypeScript syntax which doesn't appear to have been replaced.  (The error below is on the colon in the type definition.)
JSPM is at 0.16.29.  I ran jspm install ts and jspm dl-loader babel.
// package.json
{
  "jspm": {
    "dependencies": {
      "plugin-typescript"<EMAIL_ADDRESS>      "ts"<EMAIL_ADDRESS>    },
    "devDependencies": {
      "babel"<EMAIL_ADDRESS>      "babel-runtime"<EMAIL_ADDRESS>      "core-js"<EMAIL_ADDRESS>      "typescript"<EMAIL_ADDRESS>    }
  }
}

// config.js
System.config({
  baseURL: "/",
  defaultJSExtensions: true,
  transpiler: "babel",
  babelOptions: {
    "optional": [
      "runtime",
      "optimisation.modules.system"
    ]
  },
  typescriptOptions: {
    "module": "es2015",
    "target": "es6",
    "sourceMap": false,
	"removeComments":true,
    "inlineSourceMap": true,
    "listFiles": true
  },
  paths: {
    "npm:*": "jspm_packages/npm/*",
    "github:*": "jspm_packages/github/*"
  },

  packages: {
    "src": {
      "defaultExtension": "ts",
      "meta": {
        "*.ts": {
          "loader": "ts"
        }
      }
    }
  },

  map: {
    "babel"<EMAIL_ADDRESS>    "babel-runtime"<EMAIL_ADDRESS>    "core-js"<EMAIL_ADDRESS>    "ts"<EMAIL_ADDRESS>    "ts-runtime"<EMAIL_ADDRESS>    "typescript"<EMAIL_ADDRESS><EMAIL_ADDRESS>{
      "typescript"<EMAIL_ADDRESS>    },
<EMAIL_ADDRESS>{
      "assert"<EMAIL_ADDRESS>    },
<EMAIL_ADDRESS>{
      "path-browserify"<EMAIL_ADDRESS>    },
<EMAIL_ADDRESS>{
      "process"<EMAIL_ADDRESS>    },
<EMAIL_ADDRESS>{
      "util"<EMAIL_ADDRESS>    },
<EMAIL_ADDRESS>{
      "util"<EMAIL_ADDRESS>    },
<EMAIL_ADDRESS>{
      "process"<EMAIL_ADDRESS>    },
<EMAIL_ADDRESS>{
      "fs"<EMAIL_ADDRESS>      "path"<EMAIL_ADDRESS>      "process"<EMAIL_ADDRESS>      "systemjs-json"<EMAIL_ADDRESS>    },
<EMAIL_ADDRESS>{
      "util"<EMAIL_ADDRESS>    },
<EMAIL_ADDRESS>{
      "process"<EMAIL_ADDRESS>    },
<EMAIL_ADDRESS>{
      "assert"<EMAIL_ADDRESS>    },
<EMAIL_ADDRESS>{
      "inherits"<EMAIL_ADDRESS>      "process"<EMAIL_ADDRESS>    }
  }
});

<html>
<head>
    <title>Test</title>
    <script src="jspm_packages/system.src.js"></script>
    <script src="config.js"></script>
</head>
<body>
    <script>
        System.import('src/main');
    </script>
</body>
</html>

// src/main.ts
class Foo {
	[Symbol.iterator]() {
		let m = new Map();
		m.set(1, '1');
		m.set(2, '2');
		m.set(3, '3');
		return m.values();
	}
}

const foo:Foo = new Foo();

for (const x of foo) {
	console.log(x);
}

$> jspm bundle-sfx src/main
     Building the single-file sfx bundle for src/main...

err  MultipleErrors: Error compiling esm module "src/main.ts" at src\main.ts
        src/main.ts:11:7: const variables must have an initializer
     src/main.ts:11:10: Semi-colon expected
     src/main.ts:11:10: Unexpected token :
     src/main.ts:11:11: Semi-colon expected

I've updated the angular2 example so that it is using the same configuration, and it is not giving me any errors when bundling. Perhaps you could try running that and see if it works for you?

Thanks for checking.  It looks like this is due to a JSPM bug.  After updating from 0.16.29 to 0.16.30, I don't get the build error anymore.

Looks like I spoke too soon.  bundle-sfx no longer errors, but it's not producing correct output.  It looks like something that came out of the typescript compiler but didn't go through babel because it still contains things like Symbol.iterator() and x of foo.  In browser (testing in Firefox instead of Chrome since it's currently missing more ES6 features), I can look in main.ts!transpiled and see that all of the syntax has been compiled down to ES5, but build.js is not fully reduced.
This is with 0.16.31.  The beta appears to handle this example correctly, but I've had other issues with building under the beta, so I've not been able to move over yet.

This looks like an issue in systemjs-builder related to the new rollup support. I have reproduced it here: https://github.com/frankwallis/jspm-ts-bundle (in master).
Internally, when load.originalSource gets set then the bundled output is not transpiled to es5 for some reason. If you can disable the rollup support then that may fix it, otherwise try using an older version of systemjs-builder or report this issue on that repo.

Thanks for the analysis.  I'm back to not being able to reproduce it (on a different system today) which is really strange.  That at least gives me some place to look if it recurs.  I'll follow up if I can find anything more specific about what's going on.

Sorry...Monday brain.  I forgot which build error this was (hitting way too many of these lately).  It is still occurring.  It's likely not an issue with this plugin though so I'll leave this closed.


Add disable axes option

My Controller reports random values on the axes, so i add a "--ignored-axes" option to disable some/all axes.
I cloned your logic from the ignored-button to create this feature.
sample usage :
ds4drv --led 000008 --ignored-axes motion_z,motion_x,motion_y,orientation_roll,orientation_pitch,orientation_yaw

You have completely changed the README! You should revert that one.

holy ... i am so sorry, "first" public pull request on github.
i revert the readme, extend the feature list and add another "fix" to avoid flickering axes.


ValueError: 9 is not a valid PenColor

Trying to convert from reMarkable Pro with highlights in color

Yep! This is a solved issue, but it hasn't been merged yet by @ricklupton
https://github.com/ricklupton/rmscene/pull/31

As rmscene was released as v0.6.0 does the pipx install take that into account (didn't seem to) and if not, is there is way to force the upgrade?

The released version of rmc currently uses rmscene = ">=0.1.0, <0.3.0" (see pyproject.toml#L10) so pipx mostly likely installs the 0.2.0.
There are some PRs to update rmc so that it can use a newer version of rmscene but it's still in the PR state for now :)

Thanks for the clarification. I'd argue it'd be great to go through those PRs because basically right now reMarkable Pro notes can't be exporter anymore, at least not while using (some) colors.

Yes, it's on its way (but it will probably take some time). In the meantime, you can try https://github.com/ricklupton/rmc/pull/18 (probably the best if you want colour) or https://github.com/ricklupton/rmc/pull/19 (doesn't support the new remarkable file features added by https://github.com/ricklupton/rmscene/pull/31).

@Utopiah could you try on the current version of master? Both #18 and #19 were merged by Rick Lupton

And now released as v0.2.0 ... hopefully that works with your files now.

I was so confused at first, but everything is okay: it was fixed in https://github.com/ricklupton/rmscene/pull/36 but this is not released yet.
You can "cheat" by doing pip uninstall rmscene and then using the main branch of rmscene with pip install git+https://github.com/ricklupton/rmscene.git. With this, I was able to export the svg for your file!

Yeay, colors, thank you all!


Give a nice warning if options isn't an object

It would be cool to give nice warnings if people are trying to use the plugin wrong. Example:
ExtractTextPlugin.extract('style','css','less')

yields a strange Object.keys error.

What's the correct usage? Because what you wrote is exactly what the README says.

The docs give a signature such as

ExtractTextPlugin.extract([notExtractLoader], loader, [options])

Apparently doing

ExtractTextPlugin.extract('style','css!less')

was the right thing as that maps to loader.
I probably should set up a test case for this. :+1:

Here's the example as promised.

npm i
npm run gh-pages -> Nasty error

I would probably change the interface to accept an arbitrary amount of strings (optional object at the end). This is backwards compatible. Better UX.

Has someone made a pull request？0.8.2 still has this problem，and it took me much effort to find out the reason

This should be fixed now.


Show current focused class in UI [Using Optionals]

Resolves #72.
Implementation:

Add a label to show current focus in ResultDisplay.
Add an Optional<String> in CommandResult to track changes to label. If it is:

null then no changes.
Optional.empty() then focus is cleared.
otherwise contains the changed focus class name.

Update the label in ResultDisplay after every command is run.

Merged alternative implementation #79.


[TASK-15] As a user, I can select a survey

Task Card - https://github.com/rafayet-monon/surveyor/projects/1#card-43745500
What happened
A button “Take Survey” should take the user to the survey detail screen.
Insight

[x] Create the details page component
[x] Implement details page styles
[x] Connect backend API
[x] Write unit tests
[x] Write UI tests

Proof Of Work

Survey detail page

@Lahphim Fixed reviews in c61cbdb

also, can we add surveyList.spec.js so we can test that it goes to the survey detail page after click the arrow button from the list 🙌

@carryall it's in surveyDetail.spec.js

@carryall Fixed reviews in 25d94e7


Bearer token caching

For a REST API that is being used continually, a bearer token approach should be able to cache the bearer token rather than continually get a new one.
Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 7cbe5bd8-f4fa-cfac-b3f1-ac25ae741dae
Version Independent ID: 7b7a29b9-b779-88a6-b53a-84b4a6cc1f9b
Content: Secure a Restful service in your Azure AD B2C - Azure AD B2C
Content Source: articles/active-directory-b2c/secure-rest-api.md
Service: active-directory
Sub-service: b2c
GitHub Login: @msmimart
Microsoft Alias: mimart

@alex-mason-jdas Thanks for your feedback! We will investigate and update as appropriate.

@alex-mason-jdas Thanks for your feedback. I suggest you to please post this as a feedback at UserVoice. This will allow the community to upvote and for the product team to include into their plans. "This Product" button in at the bottom section of the document now to take you directly to the appropriate feedback page.

@alex-mason-jdas We will now proceed to close this thread. If there are further questions regarding this matter, please reopen it and we will gladly continue the discussion.


To Staging: Change to cloud-hosted-draft-guide-devlab-1

Updated by github actions, triggered to the cloud-hosted-draft-guide-devlab-1 repo for guide-containerize-podman.

reject

containerize-pod does not support cloud-hosted


make compile_contracts should also compile contract/services?

Currently, make compile_contracts compile only sol files in contracts and contracts/test.  When I change a file in contracts/services, I don't get any update in contracts.json.  Is this intended?  Or should contracts/services be also compiled?

I answered here: https://github.com/raiden-network/raiden-contracts/pull/360#issuecomment-444880974, where a discussion on this was already started.
tl;dr: we can include them in the compiled data.
The services contracts were left out because they were scoped out of Red Eyes and work on them was discontinued.

OK.   Sorry for the duplicate.

Ah, it is not really a duplicate, as the discussion was on an unmerged PR. I would leave this issue open, because it describes the problem more clearly.

https://github.com/raiden-network/raiden-contracts/pull/360 was merged. Service contracts were included in the compiled data, because this is what the raiden-contracts package exports for other projects to use.


[Check-in] Add voPersonID attribute

Summary
This PR introduces the new voPersonID attribute and updates the scope-claims mapping.
Also, some code style formatting to maintain the markdown clean.

@vardizzo-lab Could you please approve this PR in order to publish these changes?


Time systems plugin v2

Checked for duplicates
Yes - I've already checked
Alternatives considered
Yes - and alternatives don't suffice
Related problems
No response
Describe the feature request
Running list of feedback from time systems plugin (https://github.com/NASA-AMMOS/aerie-ui/pull/1342) that will not make V1. Split up this ticket as needed.

Allow users to input time using additional formats
Allow users to control which time formats are displayed (pulling from the bank of additional time formats + the primary time) dynamically from within the UI
Make null checking of parse and format DRYer by creating a layer between the plugin code and the eventual store/usage that handles null checking.
Show unrounded time in display only cases like the timeline hover tooltip and time display

An SRL Aerie Surface user has requested to see the start time of an activity in UTC, in addition to LMST. It would be great to be able to add a column for Start Time (UTC) in the Activity Directives Table view, for example.


Vetro - The message "Cluj, Zalău, Satu Mare is not a city in Romania"  is displayed instead of the job locations

ENVIRONMENT: production
URL: https://scrapers.peviitor.ro/
Browser: Chrome
Device: Laptop
OS: Windows 11
STEPS TO REPRODUCE:

Open the URL in the browser
Search for "Vetro" in search field
Open "Run Scrapers" button
Check the job locations.

EXPECTED RESULTS:
Job locations should be the same on Scrapers-UI as on the company website.
ACTUAL RESULTS:
The message "Cluj, Zalău, Satu Mare is not a city in Romania"  is displayed instead of the job locations.
Attachments:

After re-testing it seems to work fine.


dbt docs generate does not work with glue catalog with large number of tables in schema

Describe the bug
Currently when attempting to run dbt docs generate you get a failure message if you have a large number of tables in any given schema. This is because the package will attempt to run the following code show table extended in <schema_name> like '<table_1>|<table_2>|...'.
Steps To Reproduce
Use glue as your metastore
Have a large number of tables in a given schema
Attempt to run dbt docs generate
Expected behavior
dbt docs generate to work regardless of how many tables you have in a given schema.
Screenshots and log output
09:40:38  Running with dbt=1.8.3
09:40:39  Registered adapter: databricks=1.8.3
09:40:40  Found 161 models, 4 data tests, 117 sources, 1142 macros
09:41:32  Concurrency: 4 threads (target='dev')
09:41:34  Building catalog
09:41:35  Encountered an error while generating catalog: Runtime Error
Runtime Error
org.apache.hadoop.hive.ql.metadata.HiveException: MetaException(message:1 validation error detected: Value 'table1|table2|table3|...' at 'expression' failed to satisfy constraint: Member must have length less than or equal to 2048 (Service: AWSGlue; Status Code: 400; Error Code: ValidationException; Request ID: 0ed28cc6-16cf-4962-9d60-ddcf2fe8ba82; Proxy: null))
System information
The output of dbt --version:
Core:
  - installed: 1.8.3
  - latest:    1.8.3 - Up to date!

Plugins:
  - databricks: 1.8.3 - Up to date!
  - spark:      1.8.0 - Up to date!

The operating system you're using:
macOS Sonoma 14.5
The output of python --version:
Python 3.9.6
Additional context
This issue is a replica of this already fixed issue that seems not to work : #325

Thanks for filing.  We had fixed this before, but I guess something I changed recently regressed it.

Do you know when this issue reappeared?  I don't have a glue setup to test against, so I could use some help tracking down the issue.

Ah, have you tried setting DBT_DESCRIBE_TABLE_2048_CHAR_BYPASS=true?

Ah, have you tried setting DBT_DESCRIBE_TABLE_2048_CHAR_BYPASS=true?

Thank you very much @benc-db, it worked with this parameter !


Fix/Login - Not being redirected

Problem:
The user is not being redirected to the Authentication/login-signup page if there is not a logged user, even when the User state is empty. This makes impossible authentications (with username)

Possible Solution

Move BrowserRouter within main.jsx and wrap component there
implement conditional redirecting with user effect hook and useNavigatehook (might not work the BrowserR-outer is not being moved)
add /authentication route (in order that when redirects, would actually exist a route to be redirected)


Fix for crash when force unwrapping Int for IGN page

See https://github.com/debriennefrancoisjean/Composter/issues/248

Actually, I created this branch from the commit hash tagged as 2.5.3 in the master repo. 2.5.3 is the version we are using in Composter. I will keep the branch and not merge it, and tag it, so we don't destabilize Composter.

LGTM


Update Angular logo in quick start on typescriptlang.org

Please update the logo of the official Angular
Expected behavior:

Actual behavior:

Major facepalm 🤦♂; this should be fixed on our next website update.

@DanielRosenwasser Did you close the task because you solved it?


Markdown support

Not sure how hard it would be to implement, I see there is also a bug for newlines that the fix may help fix my problem, but adding a 'view' type button in addition may be useful to some like me.
Found a few flutter markdown packages, here is one:
https://github.com/flutter/flutter_markdown

thanks will check it out!


Accessing Backing Database for Website Environments

Hello WebArena team,
I'm interested in building on the WebArena environment and as part of this it would be helpful to be able to inspect the backing database for each website environment by running SQL queries against them. Do you have any guidance on how I could do this for the environments in WebArena?

Hi,
This can be a site-by-site situation since each site has its own implementations. You can access each Docker container to inspect the database schema and execute SQL queries within them.
For regular data access (e.g., access the issues/repos in GitLab, orders in the shopping site), the recommended way is to use their APIs. For example, here are the APIs for GitLab.

Thanks for the pointers on using the REST API, that's definitely a good resource for the GitLab environment. However I am having trouble finding documentation on the available APIs for the other environments like the OneStopShop, CMS, and Postmill environments. Do you know where I could find those resources?

Onestopshop and CMS are backed by Magento 2: https://developer.adobe.com/commerce/webapi/rest/quick-reference/
Postmill requires dealing with the Database directly: https://gitlab.com/postmill/Postmill/-/wikis/database-setup
@frankxu2004 correct me if I am wrong.


Update dependencies

Patches transferred over cleanly, nothing special required for this round of updates, new Node version (v18) required for this update. Unlike most updates, our total asset size got smaller a little bit, which is nice.
New:
vite v5.0.12 building for production...
✓ 715 modules transformed.
dist/index.html                   5.36 kB │ gzip:   2.03 kB
dist/assets/index-xN0TiSNf.css   32.63 kB │ gzip:   6.72 kB
dist/assets/index-eR_soojH.js   691.89 kB │ gzip: 218.48 kB │ map: 2,288.24 kB
✓ built in 7.14s

Old:
vite v4.4.9 building for production...
✓ 714 modules transformed.
dist/index.html                   5.35 kB │ gzip:   2.03 kB
dist/assets/index-edb7db55.css   32.64 kB │ gzip:   6.73 kB
dist/assets/index-0e385546.js   723.59 kB │ gzip: 224.14 kB │ map: 2,353.32 kB
✓ built in 7.76s

Also includes a tiny CSS fix for a shrinking icon.

We should upgrade the backend Node version to v20, the newest LTS, as v16 is now end-of-life.

Thanks Em, for being on top of this!


Allow active support / view helpers in API Renderer.

Addresses: https://github.com/restarone/violet_rails/issues/1109
Screenshots:

@Sushmit1997 my PR feedback is not implemented. Make sure you implement it by checking the PR I previously closed

@Sushmit1997 see here and respond on GitHub, so I know the requirements are clear


Possibly add uris to headers?

Per @cruzanmo https://www.w3.org/wiki/LinkHeader

Thinking about this more, the link header would work well, but it might be safer to give the page (and all components) a private UUID stored in the instance's data, which would be more reliable in case we changed the component's name or the URI, which is unlikely, but possible. This idea came up when discussing tracking as well with @gloddy

I prefer to add links (including rel="self") in representation/payload.
With Link  or Content-Location header alone, it's difficult to write links of each item in a collection resource.
HTML includes links in representation. Atom includes links in representation. Amphora's representation should just follow existing convention and include links in its json representation.
Oh, links are in URL already. You already know the links. They are in headers...etc.   while good arguments, my preference leans towards including links in representation and following established practices of HATEOAS.  To me, including links in Amphora's representation is one critical step towards better API design.

See this discussion for why we don't include URIs in the data returned from api calls.

I agree the URI should not be in the data. We could either add the URI to the http link header, or add a new id property to page data that would be unique and, to avoid confusion, different form the URI.

Links are considered metadata. If implementation of amphora is such that links should be treated as main data, not metadata, I can see resistance in adding links in the body (data).
But at the same time, if it can be added to headers (metadata), I don't see why it's not feasible to be added in body (as metadata). Maybe it's too difficult to add a response processing layer/middleware for GET requests in current amphora code base without much factoring?
For example, for GET, add metadata like links to body before responding.


Take stock of and evaluate the lint situation.

We currently have a bunch of lints in the compiler (listed here: librustc/lint/builtin.rs) and a lot more in Clippy. Which lints exist and where they exist is pretty much historical accident - in the past we added lints to the compiler, more recently we've tried to avoid adding them to the compiler and instead added them to Clippy. Clippy in turn has (AIUI) two ranks of lints - normal and pedantic.
We don't have much of a vision for how lints fit into the Rust universe, and we should (where they should live, how many there should be, how they should work, how they can be customised, some kind of stability story). Furthermore, we should rationalise the current situation.
cc @rust-lang/tools, @Manishearth, @llogiq

I am all for moving some of the clippy lints into rustc itself. Some of these fits better in the compiler itself, than a seperate plugin.

Clippy in turn has (AIUI) two ranks of lints - normal and pedantic.

FWIW in the future clippy may have more. Normal lints will be Warn, and Allow lints will be classified in three or more groups:

pedantic: lints which are not a clear style choice (i.e. half the Rust community may prefer the style the lint eschews), or contain too many false positives.
stability: lints which suggest alternate APIs when using unstable features
"restrictions": lints which let you enforce a needs-based restriction, i.e. "no floating points" or "no panics" (see https://github.com/Manishearth/rust-clippy/issues/632)

We don't have much of a vision for how lints fit into the Rust universe

I think at the very least if we're not going to be expanding the number of lints in clippy, we should make it easy to cargo install clippy (currently not possible since clippy isn't a binary and can't be made into one without becoming a lot more unstable; see https://github.com/rust-lang/cargo/issues/2386)

where they should live

I personally don't have any strong opinion here. As far as vision is concerned I am very much for more static checks, and think that Rust as a community should also lean that way (AFAICT it does already) -- if it can be checked at compile time, it should be. Beyond that, I don't care where the static checks live; they could be in clippy or rustc or both. I do feel that we should try uplifting lints from clippy to rustc more often (ones which have zero false positives and are consistently liked), though.

how they can be customised

For customization, clippy eventually wants to get a clippy.toml or something that lets you configure lint defaults at a per-project or per-user level. Unsure about rustc.

some kind of stability story

Lints which are Deny by default should be stable, but otherwise IMO Warn lints should be allowed to evolve. A plugin API to handle lint renames would be nice (so that one can register the old name as an alias).
Clippy hasn't gone 1.0 yet because I plan to RfC the defaults once before that, but afterwards the above was how I roughly planned to think about stability.

how many there should be

Infinity?

some kind of stability story

Since the compiler-internals (HIR) will never be stable as far as I understand, but there will be some kind of interface to rustc for IDEs (I'm guessing that these will be stable at some point), we can port the lints to the IDE-interface once that time comes.
AST-lints can be stabilized either through something like syntex or when the AST becomes stable.

we should rationalise the current situation.

The ability to create static analysis without much effort is imo a major plus for Rust. We should not be fixing bugs, we should be fixing classes of bugs. Whenever I have an itch b/c of something that can easily be detected, I end up writing a lint to detect it for me.


Prebuilt Frameworks & Tagged Releases

It would be nice if ios-charts had prebuilt frameworks attached to each GitHub release. This would speed up building via Carthage by quite a bit, since it automatically downloads those if they exist instead of building from scratch each time. Right now ios-charts is the lengthiest part of our build process; this would shave off a few minutes and would be much appreciated. Shouldn't be too hard to do manually, but can also be done automatically via Travis's tagged releases. Thanks again for the great library!

Actually I'm not sure if it is possible for Swift frameworks, as those frameworks are limited already (cannot be embedded in pre iOS-8).
But I will look into it!

Carthage is only supported for iOS 8 and above, so that shouldn't be an issue. For iOS 7, files can still be dragged in (presumably as a submodule). Carthage itself includes a framework written in Swift, so you can see an example of it here.

Also see: Quick & Nimble

So, basically all we need is to build the framework binaries, pack them in Charts.framework.zip and attach to a release, and then you and Carthage are happy? :-)

Ok so I've tried - but Xcode does not have an option for archiving frameworks the way Carthage wants. It can only build it as part of a greater project, and I really don't intend to go and pick up the binaries manually after compiling for each combination...

Carthage can spit out a zip file for you. Its fairly simple carthage archive I believe. I could look into it sometime. I am mainly using carthage right now.

This can be achieved by running carthage build --no-skip-current && carthage archive Charts

Note that I've built the 2.1.4a binaries into the 2.1.4 release, since Carthage does not support letters after version numbers.


File loads from GUI, but not URL

I'm working with a localhost test environment of Neuroglancer, and I'm trying to send NIFTI files from my localhost build of my web app to the localhost Neuroglancer environment, but sending the filepath via http://localhost:8080/#!nifti://localhost/+my file path results in an "HTTP Error 0: Network or CORS error", even though inputting the exact same path into the GUI successfully loads the file. Is there something I'm doing wrong?

A few things:

This syntax http://localhost:8080/#!nifti://localhost/+my file path is not correct for adding a datasource to Neuroglancer.  That is the syntax for loading a Neuroglancer JSON state from a URL.  The syntax for adding a datasource is more verbose --- the easiest way is to just add the data source using the Neuroglancer UI, and then look at the URL you end up with.  You can also use the Neuroglancer python package to construct a URL.

You need to configure your web server to allow cross-origin requests (CORS), unless you use the same web server to also host Neuroglancer itself.   Since you say it works if adding the data source in the UI, perhaps you have already configured this correctly --- but in that case I don't know why you would have observed the error you saw.

Thank you! I definitely had the syntax wrong, this helped a lot!


Postgresql updates

What this PR does:
This PR removes references of mysql.
Notes
Maybe I'm missing something but I don't see why we need to support 2 types of db at the same time.. this is realm of activerecord, rails can switch changing only the driver gem and the database.yml for development.

@theharq because otherwise we will have to fork signon - we currently have a PR to maintain both dbs, we will use postgresql they will continue to use MySQL till they are ready to migrate.

https://github.com/alphagov/signonotron2/pull/467

I see, makes sense to help with the transition, thank you for the clarification :smiley:

can open a new pr for that .cfignore commit though


Support subscribing to playlists

For example https://www.youtube.com/feeds/videos.xml?playlist_id=PL_W8pH7dkRURclWlVmsQnAbURetbWUn7k
it will break because it currently uses channel_id=.... should be a fairly easy fix?

https://github.com/iv-org/invidious/blob/c2f74879da29f0d6b1d095489883905a72d3f3db/src/invidious/helpers/utils.cr#L350
this is how invidious detects the different parameters to use


Set framework name and framework version

Hi @felixbarny,
Here we should set framework name and version via CoreConfiguration, like service_name ?

One JVM can use multiple frameworks, and even in the same web application, you could use JAX-RS and Spring Web MVC at the same time. I think it would make the most sense to set the framework information when starting the transaction or when setting the transaction name.

Ok, thanks.