[SPARK-30431][SQL] Update SqlBase.g4 to create commentSpec pattern like locationSpec

What changes were proposed in this pull request?
In SqlBase.g4, the comment clause is used as COMMENT comment=STRING and COMMENT STRING in many places.
While the location clause often appears along with the comment clause with a pattern defined as
locationSpec
    : LOCATION STRING
    ;

Then, we have to visit locationSpec as a List but comment as a single token.
We defined commentSpec for the comment clause to simplify and unify the grammar and the invocations.
Why are the changes needed?

To simplify the grammar.
Does this PR introduce any user-facing change?

no
How was this patch tested?

existing tests

Test build #116147 has started for PR 27102 at commit 177cc7b.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/20940/
Test PASSed.

Test build #116147 has finished for PR 27102 at commit 177cc7b.

This patch fails to build.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/116147/
Test FAILed.

Test build #116151 has started for PR 27102 at commit 755a80b.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/20942/
Test PASSed.

Test build #116151 has finished for PR 27102 at commit 755a80b.

This patch fails Spark unit tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/116151/
Test FAILed.

Test build #116156 has started for PR 27102 at commit d68f83e.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/20947/
Test PASSed.

Test build #116156 has finished for PR 27102 at commit d68f83e.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/116156/
Test PASSed.

Cc @cloud-fan thanks

Test build #116202 has started for PR 27102 at commit d8d85e8.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/20994/
Test PASSed.

Test build #116202 has finished for PR 27102 at commit d8d85e8.

This patch fails to build.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/116202/
Test FAILed.

Test build #116204 has started for PR 27102 at commit fbe36f3.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/20996/
Test PASSed.

Test build #116210 has started for PR 27102 at commit e3de92c.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/21002/
Test PASSed.

Test build #116212 has started for PR 27102 at commit bd5544b.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/21004/
Test PASSed.

Test build #116204 has finished for PR 27102 at commit fbe36f3.

This patch fails Spark unit tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/116204/
Test FAILed.

Test build #116210 has finished for PR 27102 at commit e3de92c.

This patch fails due to an unknown error code, -9.
This patch merges cleanly.
This patch adds no public classes.

Test build #116212 has finished for PR 27102 at commit bd5544b.

This patch fails due to an unknown error code, -9.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/116212/
Test FAILed.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/116210/
Test FAILed.

retest this please

Test build #116229 has started for PR 27102 at commit bd5544b.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/21021/
Test PASSed.

Test build #116229 has finished for PR 27102 at commit bd5544b.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/116229/
Test PASSed.

thanks, merging to master!


Failures in PowerShell 7.2 preview

In the latest version of .NET core, there appears to be an incompatibility with the Appx commands. This module uses Get-AppxPackage so it might not work in PowerShell 7.2 or even PowerShell 7.1

This should be fixed for all PowerShell 7.x releases with this code:
 if ($PSVersionTable.PSVersion.ToString() -match "^7\.[1-9]") {
        Write-Verbose "[$((Get-Date).TimeofDay)] Detected PowerShell $($matches[0])"
        Invoke-Command -ScriptBlock { Get-AppxPackage $using:Name } -ConfigurationName Microsoft.PowerShell -ComputerName localhost
    }
    else {
         Get-AppxPackage -Name $name
    }

This was added in v1.11.1


Fix Lint/LiteralInInterpolation cop error on invalid string literal

echo '"#{"\201\203"}"' | rubocop --stdin bug.rb --only Lint/LiteralInInterpolation -d

An error occurred while Lint/LiteralInInterpolation cop was inspecting bug.rb:1:0.
invalid byte sequence in UTF-8
lib/active_support/core_ext/object/blank.rb:159:in `match?'
lib/active_support/core_ext/object/blank.rb:159:in `blank?'
lib/rubocop/cop/lint/literal_in_interpolation.rb:171:in `space_literal?'
lib/rubocop/cop/lint/literal_in_interpolation.rb:51:in `offending?'
lib/rubocop/cop/lint/literal_in_interpolation.rb:26:in `on_interpolation'

Co-authored-by: Koichi ITO<EMAIL_ADDRESS>
Before submitting the PR make sure the following are checked:

[X] The PR relates to only one subject with a clear title and description in grammatically correct, complete sentences.
[X] Wrote good commit messages.
[X] Commit message starts with [Fix #issue-number] (if the related issue exists).
[X] Feature branch is up-to-date with master (if not - rebase it).
[X] Squashed related commits together.
[X] Added tests.
[X] Ran bundle exec rake default. It executes all tests and runs RuboCop on its own code.
[X] Added an entry (file) to the changelog folder named {change_type}_{change_description}.md if the new code introduces user-observable changes. See changelog entry format for details.

Thanks!


Current gevent version not supported

Hi,
Getting the below error when attempting to migrate the database.
Traceback (most recent call last):
File "manage.py", line 10, in
execute_from_command_line(sys.argv)
File "/home/kj/.virtualenvs/meteor-django/lib/python3.4/site-packages/django/core/management/init.py", line 351, in execute_from_command_line
utility.execute()
File "/home/kj/.virtualenvs/meteor-django/lib/python3.4/site-packages/django/core/management/init.py", line 325, in execute
django.setup()
File "/home/kj/.virtualenvs/meteor-django/lib/python3.4/site-packages/django/init.py", line 18, in setup
apps.populate(settings.INSTALLED_APPS)
File "/home/kj/.virtualenvs/meteor-django/lib/python3.4/site-packages/django/apps/registry.py", line 85, in populate
app_config = AppConfig.create(entry)
File "/home/kj/.virtualenvs/meteor-django/lib/python3.4/site-packages/django/apps/config.py", line 86, in create
module = import_module(entry)
File "/home/kj/.virtualenvs/meteor-django/lib/python3.4/importlib/init.py", line 109, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
File "", line 2254, in _gcd_import
File "", line 2237, in _find_and_load
File "", line 2226, in _find_and_load_unlocked
File "", line 1200, in _load_unlocked
File "", line 1129, in _exec
File "", line 1471, in exec_module
File "", line 321, in _call_with_frames_removed
File "/home/kj/.virtualenvs/meteor-django/lib/python3.4/site-packages/dddp/init.py", line 5, in
from gevent.local import local
File "/home/kj/.virtualenvs/meteor-django/lib/python3.4/site-packages/gevent/init.py", line 41, in
from gevent.hub import get_hub, iwait, wait
File "/home/kj/.virtualenvs/meteor-django/lib/python3.4/site-packages/gevent/hub.py", line 289
except Exception, ex:
The requirements.txt file still installs gevent 1.0.2. Should it be gevent 1.1b7?
I tried installing gevent 1.1b7 and after some minor tweaks to the django model (for the to-do example) - I get the below error:
Traceback (most recent call last):
File "manage.py", line 10, in
execute_from_command_line(sys.argv)
File "/home/kj/.virtualenvs/meteor-django/lib/python3.4/site-packages/django/core/management/init.py", line 351, in execute_from_command_line
utility.execute()
File "/home/kj/.virtualenvs/meteor-django/lib/python3.4/site-packages/django/core/management/init.py", line 325, in execute
django.setup()
File "/home/kj/.virtualenvs/meteor-django/lib/python3.4/site-packages/django/init.py", line 18, in setup
apps.populate(settings.INSTALLED_APPS)
File "/home/kj/.virtualenvs/meteor-django/lib/python3.4/site-packages/django/apps/registry.py", line 115, in populate
app_config.ready()
File "/home/kj/.virtualenvs/meteor-django/lib/python3.4/site-packages/dddp/apps.py", line 31, in ready
self.api = autodiscover()
File "/home/kj/.virtualenvs/meteor-django/lib/python3.4/site-packages/dddp/init.py", line 141, in autodiscover
autodiscover_modules('ddp', register_to=API)
File "/home/kj/.virtualenvs/meteor-django/lib/python3.4/site-packages/django/utils/module_loading.py", line 74, in autodiscover_modules
import_module('%s.%s' % (app_config.name, module_to_search))
File "/home/kj/.virtualenvs/meteor-django/lib/python3.4/importlib/init.py", line 109, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
File "", line 2254, in _gcd_import
File "", line 2237, in _find_and_load
File "", line 2226, in _find_and_load_unlocked
File "", line 1200, in _load_unlocked
File "", line 1129, in _exec
File "", line 1471, in exec_module
File "", line 321, in _call_with_frames_removed
File "/home/kj/Desktop/django-meteor/todo/django_todos/ddp.py", line 16, in
Tasks,
File "/home/kj/.virtualenvs/meteor-django/lib/python3.4/site-packages/dddp/api.py", line 787, in register
if api.api_path_prefix in self._registry:
AttributeError: 'Task1' object has no attribute 'api_path_prefix'

Hi @Kannaj - the PyPy feature branch has platform specific install requirements that will be useful in solving this, I'll see what I can do to apply this technique for you today.


Multi-schema support for db pull

Within the multiSchema preview feature, db pull should by default introspect all schemas in the database.

We need some TS tests in prisma/prisma repo.

(working on it now)

Missing: MySQL.

We'tracking the progress for MySQL for in https://github.com/prisma/prisma/issues/16943


use integral calculation to prevent wrong fractional rounding

Hi, i meet a bug when try to filter values by DateTimeOffset. Say we have a class
[Table("buckets")]
public class Bucket
{
	[PartitionKey]
	public int Index { get; set; }

	[ClusteringKey]
	public DateTimeOffset Date { get; set; }
}

insert some values
// Table<Bucket> table defined above
var date = new DateTimeOffset(2017, 1, 1, 0, 0, 0, 0, TimeSpan.Zero); // 01.01.2017 0:00:00 +00:00
table.Insert(new Bucket { Index = 1, Date = date }).Execute();
table.Insert(new Bucket { Index = 1, Date = date.AddDays(1) }).Execute();

Now we have two records.
var endOfDay = date.AddTicks(TimeSpan.TicksPerDay - 1); // last tick of date
var result = table.Where(bucket => bucket.Index == 1 && bucket.Date <= endOfDay).Execute(); // returns both values!

So my changes eliminate this problem.

Nice catch @Kran440 ! makes perfect sense.
I'll wait for CI builds to finish and I'll merge it.


Improve unit tests

The test coverage is pretty low at the moment. This needs to be improved.

Known limitation:

--filter flag is ignored in exportTranslationKeys
--filter flag cannot be set for generateSchema

https://github.com/skolmer/i18n-tag-schema/tree/next


Log errors from iterating results

Closes #61

Rebased, cherry-picked and merged in https://github.com/adtac/commento/pull/73 (commit author information intact)


Python : How to overcome from EOL Error in Compititve programming... #8008

Description 📜
What is EOL and How to overcome from this error in Python.
Fixes #8008

Type of change 📝

[ ] Au#dio (Should be in mp3 format Includes speech clarity, Concise ,Low distortion)
[ ] Vi#deo (Animations, screen-recordings, presentations and regular explanatory films are all possibilties etc)
[x] Documentation (Content Creation in the form of codes or tutorials)
[ ] Other (If you choose other, Please mention changes below)

Domain of Contribution 📊

[ ] Android Dev #(Flutter)
[ ] Android Dev #(Java)
[ ] Android Dev #(Kotlin)
[ ] Backend Dev #(Java)
[ ] Backend Dev #(.NET)
[ ] Backend Dev #(PHP)
[ ] Backend Dev #(Python)
[ ] C/#CPP
[x] Competitive Programming
[ ] Cyber #Security
[ ] DS#A
[ ] Data#base
[ ] Datascience with #Python
[ ] Datascience with #R
[ ] Frontend Dev #HTML/CSS/JS
[ ] Frontend Dev #React/Angular/Vue
[ ] Go#lang
[ ] Interview #Prep
[ ] Java_#Domain
[ ] JavaScript_#Domain
[ ] ME#RN
[ ] Machine #Learning
[ ] Open #Source
[ ] Python_#Domain
[ ] Ru#st
[ ] Statis#tics
[ ] UI/#UX

Checklist ✅

[x] I follow Contributing Guidelines & Code of conduct of this project.
[x] I have performed a self-review of my own code or work.
[x] My changes generates no new warnings.
[x] I'm GWOC'21 contributor

Screenshots / Gif (Optional) 📸

@ErzaTitania-2001  I haven't approved it yet :man-shrugging:

@ravireddy07 My apologies. I seem to have made a mistake.

np, I would have approved. It's ok.  🙌

np, I would have approved. It's ok.  🙌

Thanks sir


Cell.py crashes when metadata_child has no "name" field.

I simply changed metadata_child['name'] to metadata_child.get('name') in line 163 in cell.py file and it bypasses the error. Not sure if this is the best way to fix this, but it works for me.
    if metadata_child and component.get_child_name:
        component_name = f"{metadata_child.get('name')}_{name}"
        component_name = get_name_short(
            component_name, max_name_length=max_name_length
        )
    else:
        component_name = name

Thank you Athena!
releasing 5.5.1 with your improvements


17/05/19 23:22:28 INFO BlockManagerMasterEndpoint: Using org.apache.spark.storage.DefaultTopologyMapper for getting topology information
17/05/19 23:22:28 INFO BlockManagerMasterEndpoint: BlockManagerMasterEndpoint up
17/05/19 23:22:28 INFO DiskBlockManager: Created local directory at /private/var/folders/zk/w7xfpj_51t90z7xv5kw2zdm80000gn/T/blockmgr-181a29c7-0eb1-4e20-b55a-84a20fd25f18
17/05/19 23:22:28 INFO MemoryStore: MemoryStore started with capacity 120.0 MB
17/05/19 23:22:29 INFO SparkEnv: Registering OutputCommitCoordinator
17/05/19 23:22:29 INFO Utils: Successfully started service 'SparkUI' on port 4040.
17/05/19 23:22:29 INFO SparkUI: Bound SparkUI to <IP_ADDRESS>, and started at http://<IP_ADDRESS>:4040
17/05/19 23:22:29 INFO Executor: Starting executor ID driver on host localhost
17/05/19 23:22:29 INFO Executor: Using REPL class URI: http://LIs-MacBook-Pro.local:50218
17/05/19 23:22:29 INFO Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 50220.
17/05/19 23:22:29 INFO NettyBlockTransferService: Server created on <IP_ADDRESS>:50220
17/05/19 23:22:29 INFO BlockManager: Using org.apache.spark.storage.RandomBlockReplicationPolicy for block replication policy
17/05/19 23:22:29 INFO BlockManagerMaster: Registering BlockManager BlockManagerId(driver, <IP_ADDRESS>, 50220, None)
17/05/19 23:22:29 INFO BlockManagerMasterEndpoint: Registering block manager <IP_ADDRESS>:50220 with 120.0 MB RAM, BlockManagerId(driver, <IP_ADDRESS>, 50220, None)
17/05/19 23:22:29 INFO BlockManagerMaster: Registered BlockManager BlockManagerId(driver, <IP_ADDRESS>, 50220, None)
17/05/19 23:22:29 INFO BlockManager: Initialized BlockManager: BlockManagerId(driver, <IP_ADDRESS>, 50220, None)
17/05/19 23:22:29 INFO SparkContext: Starting job: collect at /Users/lihaoyi/Dropbox/Github/Ammonite/foo.sc:59
17/05/19 23:22:29 INFO DAGScheduler: Got job 0 (collect at /Users/lihaoyi/Dropbox/Github/Ammonite/foo.sc:59) with 8 output partitions
17/05/19 23:22:29 INFO DAGScheduler: Final stage: ResultStage 0 (collect at /Users/lihaoyi/Dropbox/Github/Ammonite/foo.sc:59)
17/05/19 23:22:29 INFO DAGScheduler: Parents of final stage: List()
17/05/19 23:22:29 INFO DAGScheduler: Missing parents: List()
17/05/19 23:22:29 INFO DAGScheduler: Submitting ResultStage 0 (MapPartitionsRDD[1] at map at /Users/lihaoyi/Dropbox/Github/Ammonite/foo.sc:59), which has no missing parents
17/05/19 23:22:29 INFO MemoryStore: Block broadcast_0 stored as values in memory (estimated size 1848.0 B, free 120.0 MB)
17/05/19 23:22:29 INFO MemoryStore: Block broadcast_0_piece0 stored as bytes in memory (estimated size 1188.0 B, free 120.0 MB)
17/05/19 23:22:29 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on <IP_ADDRESS>:50220 (size: 1188.0 B, free: 120.0 MB)
17/05/19 23:22:29 INFO SparkContext: Created broadcast 0 from broadcast at DAGScheduler.scala:996
17/05/19 23:22:29 INFO DAGScheduler: Submitting 8 missing tasks from ResultStage 0 (MapPartitionsRDD[1] at map at /Users/lihaoyi/Dropbox/Github/Ammonite/foo.sc:59)
17/05/19 23:22:29 INFO TaskSchedulerImpl: Adding task set 0.0 with 8 tasks
17/05/19 23:22:29 INFO TaskSetManager: Starting task 0.0 in stage 0.0 (TID 0, localhost, executor driver, partition 0, PROCESS_LOCAL, 5954 bytes)
17/05/19 23:22:29 INFO TaskSetManager: Starting task 1.0 in stage 0.0 (TID 1, localhost, executor driver, partition 1, PROCESS_LOCAL, 5954 bytes)
17/05/19 23:22:29 INFO TaskSetManager: Starting task 2.0 in stage 0.0 (TID 2, localhost, executor driver, partition 2, PROCESS_LOCAL, 5954 bytes)
17/05/19 23:22:29 INFO TaskSetManager: Starting task 3.0 in stage 0.0 (TID 3, localhost, executor driver, partition 3, PROCESS_LOCAL, 5954 bytes)
17/05/19 23:22:29 INFO TaskSetManager: Starting task 4.0 in stage 0.0 (TID 4, localhost, executor driver, partition 4, PROCESS_LOCAL, 5954 bytes)
17/05/19 23:22:29 INFO TaskSetManager: Starting task 5.0 in stage 0.0 (TID 5, localhost, executor driver, partition 5, PROCESS_LOCAL, 5954 bytes)
17/05/19 23:22:29 INFO TaskSetManager: Starting task 6.0 in stage 0.0 (TID 6, localhost, executor driver, partition 6, PROCESS_LOCAL, 5954 bytes)
17/05/19 23:22:29 INFO TaskSetManager: Starting task 7.0 in stage 0.0 (TID 7, localhost, executor driver, partition 7, PROCESS_LOCAL, 6011 bytes)
17/05/19 23:22:29 INFO Executor: Running task 7.0 in stage 0.0 (TID 7)
17/05/19 23:22:29 INFO Executor: Running task 0.0 in stage 0.0 (TID 0)
17/05/19 23:22:29 INFO Executor: Running task 2.0 in stage 0.0 (TID 2)
17/05/19 23:22:29 INFO Executor: Running task 1.0 in stage 0.0 (TID 1)
17/05/19 23:22:29 INFO Executor: Running task 6.0 in stage 0.0 (TID 6)
17/05/19 23:22:29 INFO Executor: Running task 4.0 in stage 0.0 (TID 4)
17/05/19 23:22:29 INFO Executor: Running task 5.0 in stage 0.0 (TID 5)
17/05/19 23:22:29 INFO Executor: Running task 3.0 in stage 0.0 (TID 3)
17/05/19 23:22:29 INFO Executor: Finished task 7.0 in stage 0.0 (TID 7). 912 bytes result sent to driver
17/05/19 23:22:29 INFO Executor: Finished task 1.0 in stage 0.0 (TID 1). 912 bytes result sent to driver
17/05/19 23:22:29 INFO Executor: Finished task 2.0 in stage 0.0 (TID 2). 908 bytes result sent to driver
17/05/19 23:22:29 INFO Executor: Finished task 5.0 in stage 0.0 (TID 5). 908 bytes result sent to driver
17/05/19 23:22:29 INFO Executor: Finished task 4.0 in stage 0.0 (TID 4). 912 bytes result sent to driver
17/05/19 23:22:29 INFO Executor: Finished task 6.0 in stage 0.0 (TID 6). 912 bytes result sent to driver
17/05/19 23:22:29 INFO Executor: Finished task 0.0 in stage 0.0 (TID 0). 908 bytes result sent to driver
17/05/19 23:22:29 INFO Executor: Finished task 3.0 in stage 0.0 (TID 3). 999 bytes result sent to driver
17/05/19 23:22:29 INFO TaskSetManager: Finished task 1.0 in stage 0.0 (TID 1) in 79 ms on localhost (executor driver) (1/8)
17/05/19 23:22:29 INFO TaskSetManager: Finished task 7.0 in stage 0.0 (TID 7) in 71 ms on localhost (executor driver) (2/8)
17/05/19 23:22:29 INFO TaskSetManager: Finished task 2.0 in stage 0.0 (TID 2) in 81 ms on localhost (executor driver) (3/8)
17/05/19 23:22:29 INFO TaskSetManager: Finished task 4.0 in stage 0.0 (TID 4) in 77 ms on localhost (executor driver) (4/8)
17/05/19 23:22:29 INFO TaskSetManager: Finished task 5.0 in stage 0.0 (TID 5) in 75 ms on localhost (executor driver) (5/8)
17/05/19 23:22:29 INFO TaskSetManager: Finished task 6.0 in stage 0.0 (TID 6) in 74 ms on localhost (executor driver) (6/8)
17/05/19 23:22:29 INFO TaskSetManager: Finished task 0.0 in stage 0.0 (TID 0) in 115 ms on localhost (executor driver) (7/8)
17/05/19 23:22:29 INFO TaskSetManager: Finished task 3.0 in stage 0.0 (TID 3) in 79 ms on localhost (executor driver) (8/8)
17/05/19 23:22:29 INFO TaskSchedulerImpl: Removed TaskSet 0.0, whose tasks have all completed, from pool
17/05/19 23:22:29 INFO DAGScheduler: ResultStage 0 (collect at /Users/lihaoyi/Dropbox/Github/Ammonite/foo.sc:59) finished in 0.128 s
17/05/19 23:22:29 INFO DAGScheduler: Job 0 finished: collect at /Users/lihaoyi/Dropbox/Github/Ammonite/foo.sc:59, took 0.313729 s
Spark result: List(10, 20, 30, 40, 50)
17/05/19 23:22:30 INFO BlockManagerInfo: Removed broadcast_0_piece0 on <IP_ADDRESS>:50220 in memory (size: 1188.0 B, free: 120.0 MB)
17/05/19 23:22:30 INFO SparkContext: Invoking stop() from shutdown hook
17/05/19 23:22:30 INFO SparkUI: Stopped Spark web UI at http://<IP_ADDRESS>:4040
17/05/19 23:22:30 INFO MapOutputTrackerMasterEndpoint: MapOutputTrackerMasterEndpoint stopped!
17/05/19 23:22:30 INFO MemoryStore: MemoryStore cleared
17/05/19 23:22:30 INFO BlockManager: BlockManager stopped
17/05/19 23:22:30 INFO BlockManagerMaster: BlockManagerMaster stopped
17/05/19 23:22:30 INFO OutputCommitCoordinator$OutputCommitCoordinatorEndpoint: OutputCommitCoordinator stopped!
17/05/19 23:22:30 INFO SparkContext: Successfully stopped SparkContext
17/05/19 23:22:30 INFO ShutdownHookManager: Shutdown hook called
17/05/19 23:22:30 INFO ShutdownHookManager: Deleting directory /private/var/folders/zk/w7xfpj_51t90z7xv5kw2zdm80000gn/T/spark-a0a125b8-e6dd-4cd8-84a7-1c7472c0c1c1
lihaoyi Ammonite$


Broken link

Hello Team,
In Bestpractices Christoph Szymanski  linkden profile link is broken.
Thanks

Thanks. It's fixed now.


Where to see CHECK-conditions of tables?

I've added a CHECK-condition to one of my MariaDB tables but I've not been able to see it anywhere in DBeaver. Am I blind or is this feature lacking?

MySQL doesn't support CHECK constraints.
You can specify them in table create query but they will be ignored. Official docs: http://dev.mysql.com/doc/refman/5.7/en/create-table.html

While I searched something else I just found this: https://mariadb.com/kb/en/mariadb/check-constraints-support/ . So MariaDB does support CHECK constraints since v10.2.1 but MySQL doesn't. So indeed, this should be fixed.
Source: https://jira.mariadb.org/browse/MDEV-7563

As i see in mysql documents, the version 8 of mysql supports CHECK constraint. See this:
https://dev.mysql.com/doc/refman/8.0/en/create-table-check-constraints.html

Looks like this has come up again in #6069


didReceiveRegistrationToken Called twice

Description
didReceiveRegistrationToken is being called twice on first installation, each time with a different fcmToken.
Firebase SDK Version
9.6.0
Xcode Version
14.0.1
Installation Method
CocoaPods
Firebase Product(s)
Messaging
Targeted Platforms
iOS

Thanks for reaching out, @Raja995. This seems like an intended behavior. You may check this existing ticket for more info.


{AzureIoT} fixes Azure/azure-sdk-for-python#27252 update description

fixes Azure/azure-sdk-for-python#27252
PR to update the description for create_device_with_sas method to "Creates a device identity on IoTHub that will use SAS as authentication method."

@ethanann-ms can you take a look at this? I directed @navba-MSFT when reviewing this documentation PR.


Feature request: Add basic client side load balancing for gRPC

There is no client side load balancing for gRPC module.
All the requests land on one instance rather than distributing the load between multiple instances.
Is it possible to add basic load balancing on client side e.g. round_robin or other pattern so request load can be distributed among instances?

That akka-grpc PR is in Pekko gRPC. The fork was made after the merge was made.

indeed, but there is no clear doc/explaination on how to achieve client side load balancing, even with the default static mechanism as I mentioned in above comment.

I will repeat pekko-grpc is built on top of grpc-java and https://pekko.apache.org/docs/pekko-grpc/current/client/details.html#load-balancing highlights how to set the load-balancing-policy config. You can go and read the grpc-java docs to find out what the settings are. Apache Pekko is a free lib with no warranties or support. You can help by coming back with what you learn and add to the pekko-grpc docs to help future users.

As mentioned in the link you shared, "When multiple endpoints are discovered for a gRPC client, currently one is selected and used for all outgoing calls".

We should probably add a 'by default' there.

Ideally we should be able to send requests to both endpoints in a round_robin fashion. Even if round_robin is provided as load balancing policy, only one host is receiving requests.

As that documentation mentions, while perhaps counter-intuitive, there are situations where that's a better strategy - but I agree it would be good if client-side load balancing were possible.

I see in the docs, "Client-side load balancing is desirable when you are using the default static or the grpc-dns discovery mechanism.".

I suspect we should replace 'desirable' with 'possible' here.

But the meaning of default static method is not clear to me.

'static' is the discovery method that is used when you don't configure a different service discovery mechanism (https://pekko.apache.org/docs/pekko-grpc/current/client/configuration.html#using-pekko-discovery-for-endpoint-discovery).

Can we add some example for this use case?

I agree that would be helpful.

Even if round_robin is provided as load balancing policy, only one host is receiving requests.

Indeed that seems to contradict the documentation. Could you boil down your application to a minimal test project to show the behavior?


Add an option for displaying the track enveloppe

For track shapes that are very different from a triangle, I'd like to know what's the geometric enveloppe of my track.
Would it be possible to add an option for displaying the enveloppe and its length?
For example, a small button with a lasso in it, below the other green buttons in the top-right corner of the map, would show/hide the enveloppe on the map, and a message box somewhere with the enveloppe length and its opening lengths. (The opening length is the distance between the start and end waypoints.)

Not sure what you exactly mean ? Do you have an exemple / known OSS implementation ?

Here's an example of a flight track, where I manually added the enveloppe in green.

What is the purpose ?

The purpose is to get an evaluation of the track length that is more realistic than with the standard geometric shapes now used for distance scoring.
With a fixed number of sides (3 for FAI triangles, or even 4 as were allowed in the past by French CFD rules), many "interesting" tracks (those with many extrema, or with convex shapes like a circle) do get widely under-evaluated. The example image above shows that well on such a track, with the green enveloppe much longer than the blue FAI triangle. On the other hand, tracks with just 3 points will often have an enveloppe almost identical to their FAI triangle. This is the case for most of the top tracks in the CFD this year.
I proposed that idea publicly last spring in a letter that was published in the #166 issue of Parapente Mag.
Then last week, I was happily surprised to learn that a Paramotor association had adopted it and implemented it for their own distance scoring. See their new rule here:
[http://cfdm.forumperso.com/t141-reglement-de-la-cfdm]
And here's an example of a paramotor track with the enveloppe shown.
[http://cfdm.forumperso.com/t130-0001-13-08-16-julien-heyl-79-6-km-homologue]
So now my request is to add that capability to VisuGps as an optional feature. People who don't care will see no change. And people interested can visualize their envelopes, and get its length, by clicking on a button.
Note that I've heard that many graphic libraries do already have functions for drawing envelopes. If you do use such a library, this may be relatively easy to implement. Else it'll be more work. I'm a developer, so I volunteer to contribute if needed.

Looking at your ex your previous reasoning does not seem valid.
If the question is how to better reflect "real" distance for recreational pilots, may be there are better options ? (ie more segments).
I'll probably be quite busy for the 2 coming weeks but nappy to discuss this after.


For BTC Wallet receive, enable Breez-SDK LNURL and Lightning Address on PayCode Tab

@islandbitcoin Was it implemented before and not working? Or should I implement from scratch?

Breez Liquid has the functionality now, but requires heavy code and server implementation for LNURL to be on pay code tab. See this link as reference: https://sdk-doc-liquid.breez.technology/guide/lnurl_pay_service.html


supporting checkers that can check across multiple packages

dupl for example, see https://github.com/alecthomas/gometalinter/issues/32

I don't think this will be added at this stage.


Include onnx_node_name in MLIR attributes for zhigh dialect ops

This is a request for enhancement to the MLIR output. When --EmitMLIR is used with NNPA acceleration, it would be useful to have some sort of reference in the MLIR output to indicate which onnx.* a particular zhigh.* replaces.
As an example, currently when compiling bertsquad-12 for NNPA, some MatMul Operations went to CPU and some were lowered to NNPA.
The CPU (ie onnx.* Ops) include onnx_node_name in the attributes dictionary. That can be copy and pasted into a netron.app view of the model to make it easy find the Op in a graphical view.
%317 = "onnx.MatMul" (%316, %299) {onnx_node_name = "bert/encoder/layer_0/attention/self/MatMul_1"} : (tensor<?x?x256x256xf32>, tensor<?x?x?x?xf32>) -> tensor<?x?x256x?xf32>

Later when another MatMul Op is lowered to NNPA in MLIR, There's no `onnx_node_name`. So it is not as easy to identify exactly which MatMul a particular zhigh operation is replacing.
%323 = "zhigh.MatMul"(%320, %321, %322): (tensor<?x?xf32, #zhigh.encoding<{dataLayout = "2D"}>>, tensor<768x768xf32, #zhigh.encoding<{dataLayout = "2D"}>>, tensor<768xf32, #zhigh.encoding<{dataLayout = "1D"}>>) -> tensor<?x768xf32, #zhigh.encoding<{dataLayout = "2D"}>>

I believe this should be possible, there is also line info that can be embedded in each op.


Sometimes the crate cannot be built

Because of this error, that only sometimes occurs, it is difficult to build the crate
error: failed to run custom build command for `license v3.2.0`

Caused by:
  process didn't exit successfully: `/home/target/debug/build/license-5e8ba4d961a88bb4/build-script-build` (exit status: 101)
  --- stderr
  Cloning into 'license-list-data'...
  fatal: unable to access 'https://github.com/spdx/license-list-data.git/': Failed to connect to github.com port 443 after 138630 ms: Couldn't connect to server
  thread 'main' panicked at /home/.cargo/registry/src/index.crates.io-6f17d22bba15001f/license-3.2.0/build.rs:103:35:
  `git clone --depth 1` failed with exit code `128`
  note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace

Hi, looks like it can't connect to github.
You can use the offline feature to fix this for now, and I will try to fix this in #3 later.

Up till now the offline feature seems to work really well, thanks!


Use one RNG per Event Producer

This PR updates #171  to create one RNG per event producer to decrease the variance across runs of the simulator when running with a fixed seed. This approach was originally taken in #171, but each RNG was seeded with the same value which led to nodes with the same capacity having the exact same payment flows (not what we want). I suggested that we share a RNG to get around that, but it introduces other problems - specifically that all tasks in the simulator are vying for mutex access to the same RNG, so the order of operations highly effects the determinism of the simulator.
This PR takes a new approach, which "salts" the seed with material from each node's public key to make the RNGs per-task deterministic but different.
Two design decisions that I wasn't totally happy with:

We use a single NetworkGenerator because it holds the whole graph, so we can't pass a unique RNG in for each event producer. The solution here is to include the RNG in the API of the network generator in each call:

It seemed inconsistent to do this for network generator and not PaymentGenerator (though we could, because this one is generated per event producer).
We end up passing in unnecessary RNG to the DefinedPaymentGenerator implementation of PaymentGenerator where we don't actually need it.

We seed the RNG with Option<u64> and then salt it with u64, this should probably by an Option<u64, u64> because we don't need the salt if we don't have a seed, but it seems unnecessary to unwrap and re-wrap (got lazy, might fix).

To get an idea of the improvement, I ran the simulator 50x with the two approaches and measured the coefficient of variance (mean / std dev) for the revenue that one node has in the simulation.

Old approach: CoV = 0.5
New approach: CoV = 40

A larger number indicates that our variance is lower, so this is quite a dramatic improvement which IMO makes it worthwhile to make the API changes.

@enigbe while using the simulator with fixed seed I noticed that the variance issues that you pointed out get much worse with larger networks (makes sense, there are more events taking place so we have more variance).
I should have thought about this option during review when you had the original version with one rng per producer (as I've done here), sorry! Took me running this to get more of an intuition into where we need to fix things up.

@enigbe while using the simulator with fixed seed I noticed that the variance issues that you pointed out get much worse with larger networks (makes sense, there are more events taking place so we have more variance).
I should have thought about this option during review when you had the original version with one rng per producer (as I've done here), sorry! Took me running this to get more of an intuition into where we need to fix things up.

Please don't apologize. It was fine implementing it in the way you suggested (helps me learn more about the project). I will review this today/tomorrow.

Closing due to (my own) inactivity, I'll open it back up when I've got some capacity for this.
Would still like to find an approach that doesn't require carting a rng around our traits, but couldn't figure that out when I looked at it last.


Rethink api

Please review as you see fit.
Notable stuff:

BasicDocument - gives you a feel of how a document gets composed.
Editor - here you see how such a document gets selected, rendered and controlled.
The link module (files below here)  - has a property form

The utils folder contains a lot of very basic stuff, that's why I decided to have everything in there at least somehow tested. It's a start I guess. I'd recommend:

createFormatButton - Very basic HOC
createMarkButton - Decorates the former
Scary test shit - Because that's what it is.

The rule composition thing is already working, but naming is still meh. Bear with me.
Can get imported from components/editor/Editor and used as drop-in-replacement of the previous import.
That's it for now.

Missing: Image


More explicitly document invalidation rules

The reference/iterator invalidation rules can surprise people who expect
associative containers to be node-based, similar to std::[unordered_]map.
This calls it out more visibly to avoid surprises.

I got the snippet reference wrong after all. Sigh. Also, it looks weird because the callout box is hiding the snippet box. Perhaps it's better to put the callout at the bottom, separate from the snippet?
Will update so that we have something tangible to compare.

I think this looks better now.

Merged via 98d37f93706b50fd057d14bd241a2bfbcfec1527


urllib3 unverified https request

recently I am not caplabe to upload videos for this issue, does anyone has a clue what could be the solution ?
Error: Command failed: python uploader.py -i "<SSID>" -p "...video.mp4" -t "🌳 Compartir Crece 🌱 " --tags  fyp foryoupage

...\anaconda3\lib\site-packages\urllib3\connectionpool.py:1045: InsecureRequestWarning: Unverified HTTPS request is being made to host 'tos-awsuseast16-up.tiktokcdn.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings
  warnings.warn(
Traceback (most recent call last):
  File "...\anaconda3\lib\site-packages\requests\models.py", line 971, in json
    return complexjson.loads(self.text, **kwargs)
  File "...\anaconda3\lib\json\__init__.py", line 346, in loads
    return _default_decoder.decode(s)
  File "...\anaconda3\lib\json\decoder.py", line 337, in decode
    obj, end = self.raw_decode(s, idx=_w(s, 0).end())
  File "...\anaconda3\lib\json\decoder.py", line 355, in raw_decode
    raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "...\uploader.py", line 117, in <module>
    uploadVideo(args.session_id, args.path, args.title, args.tags, args.users)
  File "...\uploader.py", line 96, in uploadVideo
    if r.json()["status_code"] == 0:
  File "...\Users\Miguel\anaconda3\lib\site-packages\requests\models.py", line 975, in json
    raise RequestsJSONDecodeError(e.msg, e.doc, e.pos)
requests.exceptions.JSONDecodeError: Expecting value: line 1 column 1 (char 0)

Hey @MiguelRodriguezR that issue is not from unverified HTTPS request. TIktok added a few more flags that you need to pass in for the final step to go through. I will raise a PR soon once I am done testing

@MrUnreal How to raise a PR?

fork - make your changes and raise pull request against the repo

i forked but not work and the error is :
raise RequestsJSONDecodeError(e.msg, e.doc, e.pos)
requests.exceptions.JSONDecodeError: Expecting value: line 1 column 1 (char 0)

I mean if you want to fix it you have to fix it first before trying ?

do you have fixed it ?

still testing

these params i have tryed before, it`s unuseful,so i remove it.
now, maybe the api checked these unuseful params.
sorry, I have been busy recently.

@546200350 tiktok加了一些参数，抓紧更新 buddy

Hey @MiguelRodriguezR that issue is not from unverified HTTPS request. TIktok added a few more flags that you need to pass in for the final step to go through. I will raise a PR soon once I am done testing

Thanks man, let me know if I can help in any way, maybe testing or something

bros, does Tiktok require X-Bogus param at last step? @MrUnreal @546200350

did anyone fix this? Id really appreciate an update sorry I havent had time to help

@MrUnreal  @546200350 Hello guys is there any updates or solutions with this issue ?  I've been trying everithing but nothing seems to work

I can generate shape headers, xbogus but It does not work, the API still return empty string, lol. I dont know what is lacked.

The key words is X-Bogus.
All of the algorithms are based on the Get on market, but we need  Post request.
I`m trying to fix it.

i have resolved this problem, update the latest script and try again.
it`s work for me.


TECS initialization and misc cleanup

TECS initialization

subtract pitchsp_offset from _pitch used to initialize TECS
constrain pitch to min, max (eg bad throws)
TAS instead of EAS where appropriate

remove unused COM_DL_LOSS_EN in SITL vtol configs

remove unused vehicle_status from vtol_att_control

fix land_detector status string

@dagar have you test flown this?

Only SITL so far. The only important part of this PR is the pitch for tecs. If you take a look at transition to FW you'll see the initial pitch setpoint from TECS offset.
The rest is trivial/cosmetic readability stuff.

@dagar can you explain the TAS/EAS changes?

_integ5_state is TAS, but it was initialized with EAS. _TAS_dem is 0
initially.
I'm aware that fw_pos_ctrl_l1 still uses 1 for EAS2TAS, but I'm planning
ahead.
On Mon, Sep 26, 2016 at 9:21 AM, Andreas Daniel Antener <
<EMAIL_ADDRESS>wrote:

@dagar https://github.com/dagar can you explain the TAS/EAS changes?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/PX4/Firmware/pull/5546#issuecomment-249567646, or mute
the thread
https://github.com/notifications/unsubscribe-auth/AAFK6HioNXFrLWSDJkW0XaXk_jHPKVDRks5qt8b1gaJpZM4KGHLk
.


Update README.md

I added the chmod +x before running

Hello! This should not be necessary to chmod the powershell script. It should already have proper permissions. Are you seeing a different behavior? If so, which OS?


Css args

Fixes #88

Looks very nice! The example in the documentation showcases an integer parameter, does it also handle strings?
Like for example background url('{ myVar }'). If so, what kind of escaping is used?

It looks exactly the way I need it to look! 👍
@a-h when are you planning to release this?

Plan to release tomorrow.


ColorSetting query not triggering

Hi,
In UK English, the query "what colour is my light?" isn't recognised.
I can set them but can't query them

This verbal query is currently not supported.

It's in the documentation - can it be updated

I'm going to seek more guidance on the current state of querying for colors.

Thanks @Fleker - appreciate it :)

Querying commands "what color is the desk lamp?" from document is still not working...
@Fleker have you found any guidance on the current state of querying for colors?

It's not supported yet.

Going thru the back of issues, this sounds like an general issue with the Smart Home platform/documentation, and not something specific to the sample code hosted in the repo.
I order to give more visibility, I would suggest following the instructions about filing issues in the public issue tracker at https://developers.google.com/assistant/smarthome/support.

Going thru the back of issues, this sounds like an general issue with the Smart Home platform/documentation, and not something specific to the sample code hosted in the repo.
I order to give more visibility, I would suggest following the instructions about filing issues in the public issue tracker at https://developers.google.com/assistant/smarthome/support.


Rules' AND operator with empty rules always intercept the request

Describe the bug
Having empty rules with "AND" operator serves the corresponding response even if another response's rules match
To Reproduce

create 2 responses
set the first response's rules to AND, and remove all rules
add one rule on the second one
make a call that matches the second response, you get the first one

bug#6.zip
Expected behavior
We should get the second one
Mockoon version:
all
OS / OS version:
all

The error is this line
The problem is that Array.every returns true if the input array is empty.
Potential fix:
let response = this.routeResponses.find((routeResponse) => {
  if (routeResponse.rules.length === 0) {
    return false;
  }

  return routeResponse.rulesOperator === 'AND'
    ? routeResponse.rules.every(this.isValidRule)
    : routeResponse.rules.some(this.isValidRule)
});

Notice, that I also changed !!routeResponse.rules.find(this.isValidRule) to routeResponse.rules.some(this.isValidRule) and removed the unnecessary double negation at routeResponse.rules.every(this.isValidRule)

Thanks @mauriceackel your fix is indeed working!


prettier formatting consistency

What

[x] ensure format script applies to all root files and e2e/ as well as src/
[x] include prettier.config.mjs in tsconfig to avoid eslint complaint in prettier.config.mjs
[x] apply new format script
[x] readme typo

Also  WHY tabWidth: 4, ? :D :D :D  my eyes...

Also WHY tabWidth: 4, ? :D :D :D my eyes...

trying to discourage deeply nested anything... although I've recently heard a good argument for just using real tabs, so then the display of the tabs can be preferable per dev

thank you for this!
since it seems somewhat related to what you're doing here, could you fix this warning for me?


add mllama image processing to the generate handler

Fixes #7362

This was merged into "main", and when compiling main this does not work for me when using 'llama-3.2-vision' neither with chat nor with generate.
key clip.has_text_encoder not found in file
terminate called after throwing an instance of 'std::runtime_error'
  what():  Missing required key: clip.has_text_encoder

I believe that this needs to be merged with v0.4.0-rc5 and get a v0.4.0-r6 to be useable or is the plan to rebase the v0.4.0 code and then create the new release candidate for v0.4.0?


Food Recipe App: Prod

In this milestone,
With coding partner:

@MoyasiGinko
@Marcraphael12
Have built our group project Food Recipe a full stack Ruby on Rails project.

Project Highlights:

A login page.
A registration page.
A food list (with all CRUD implementation, except for 'update').
A recipes list (with all CRUD implementation, except for 'update').
A general shopping list view (all missing food for all your recipes and total price).
A list of all public recipes from other users with their names and total prices.

Thank you @ichala for taking time to review and approve our project


Deal with duplicate DID exception when injecting multiple file replicas into Rucio

Impact of the bug
WMAgent
Describe the bug
We don't seem to have hit this exception - yet - in production, but there will certainly be a moment where we will try to add a list of file replicas (add_replicas Rucio client API) into Rucio, and some of those will already exist in the database, thus hitting a DataIdentifierAlreadyExists exception.
With the current code, we would simply try the same call (or same files + freshly created ones after the previous cycle) again and again, which would likely keep failing on the server side.
How to reproduce it
Inject a file replica against a block, then try to inject the same replica again (or the same replica plus a new file)
Expected behavior
Duplicated file replica exception should not be considered if we tried to add a single file replica, the component should deal with it as if it had a successful replica injection.
However, if there are multiple file replicas in the input, our wrapper API createReplicas should signal (or raise an exception) back to the caller and let the caller break that list of file replicas into single replicas, making a new createReplicas call for every replica file.
Additional context and error message
Initial handling (single file replica) in: https://github.com/dmwm/WMCore/pull/10024

Hi @amaltaro, I am not 100% sure I fully understand your concern, mostly because the exception DataIdentifierAlreadyExists you are mentioning is a different one from the one - DuplicateRule we've  already seen in a similar case [1]. But besides the exception difference, IIUC the rest of the case you describe here is exactly the same. And if I am not wrong ... then this  has been already brought to the Rucio developers' attention [2].
[1]
https://github.com/dmwm/WMCore/pull/9772#discussion_r447827209
[2]
https://github.com/rucio/rucio/issues/3807

I had a chat with Eric and Yuyi today, and indeed this code looks suspicious and could potentially be causing creating issues with data produced in central production.
This add_replicas Rucio python API:
https://github.com/dmwm/WMCore/blob/master/src/python/WMCore/Services/Rucio/Rucio.py#L464
actually performs two actions:

create a DID in the database
create a replica in the database (a file at a given location)

so, it could be that our datasets are ending without a replica, we are not sure.
The suggested approach for such exceptions would be to:

iterate over every single file and
check whether the DID exists in Rucio
check whether a replica exists in Rucio

if a file passes these 2 checks, then indeed we can consider this data insertion operation complete.
@yuyiguo @ericvaandering will provide us with some guidance on which Python APIs we could use for this error handling/check.
PS.: and here is a GH issue reporting this (possible) problem in October 2020 :(

OK, I don't know if it will help but I'm parsing the logs and looking for anything other than an exit 201 from POST /replicas from WMCore.
So far nothing.

Thanks @ericvaandering I am also trying to find some records in the wmagent logs related to any of those files. I'll post my findings here as well.

I have no idea what has generated  the above two records.
In the meantime, while checking the Rucio injector logs I do find two types of errors we experience lately:[1] && [2]. Strangely enough I do not see those files in the jira ticket listing the file mismatches.
[1]
2022-04-23 04:19:07,578:139769485022976:ERROR:Rucio:Failed to add replicas for: [{'name': '/store/data/Run2018A/EGamma/AOD/15Feb2022_UL2018-v1/28210000/B213CA40-C61E-314E-A443-323017D18A8A.root', 'scope': 'cms', 'bytes':<PHONE_NUMBER>, 'state': 'A', 'adler32': 'e2145bf5'}, {'name': '/store/data/Run2018A/EGamma/AOD/15Feb2022_UL2018-v1/28210000/D1F43378-DADA-D147-8950-150A551F6744.root', 'scope': 'cms', 'bytes':<PHONE_NUMBER>, 'state': 'A', 'adler32': '3a1886f6'}] and block: /EGamma/Run2018A-15Feb2022_UL2018-v1/AOD#48a7f226-b463-46e5-8386-5738b7656684. Error: An unknown exception occurred.
Details: no error information passed (http status code: 500)

[2]
2022-05-18 10:23:08,942:140444646516480:ERROR:RucioInjectorPoller:Failed to update file status in the database, reason: (cx_Oracle.DatabaseError) ORA-25408: can not safely replay call
[SQL: UPDATE dbsbuffer_file SET in_phedex = :status WHERE lfn = :lfn]
[parameters: [{'lfn': '/store/mc/RunIISummer20UL16RECOAPV/BdToPsi2sKpi_SoftQCDnonD_TuneCP5_13TeV-pythia8-evtgen/AODSIM/106X_mcRun2_asymptotic_preVFP_v8-v3/2830000/64CBE7B2-F05A-7547-AFF6-55D
EEC6BAA89.root', 'status': 1}, {'lfn': '/store/mc/RunIISummer20UL16RECOAPV/BdToPsi2sKpi_SoftQCDnonD_TuneCP5_13TeV-pythia8-evtgen/AODSIM/106X_mcRun2_asymptotic_preVFP_v8-v3/2830000/19F5E539-C
83C-0E48-8730-F26BAC838B28.root', 'status': 1}]]
(Background on this error at: http://sqlalche.me/e/4xp6)
2022-05-18 10:23:08,948:140444646516480:ERROR:RucioInjectorPoller:Caught unexpected exception in RucioInjector. Details:
<@========== WMException Start ==========@>
Exception Class: RucioInjectorException
Message: Failed to update file status in the database, reason: (cx_Oracle.DatabaseError) ORA-25408: can not safely replay call
[SQL: UPDATE dbsbuffer_file SET in_phedex = :status WHERE lfn = :lfn]
[parameters: [{'lfn': '/store/mc/RunIISummer20UL16RECOAPV/BdToPsi2sKpi_SoftQCDnonD_TuneCP5_13TeV-pythia8-evtgen/AODSIM/106X_mcRun2_asymptotic_preVFP_v8-v3/2830000/64CBE7B2-F05A-7547-AFF6-55D
EEC6BAA89.root', 'status': 1}, {'lfn': '/store/mc/RunIISummer20UL16RECOAPV/BdToPsi2sKpi_SoftQCDnonD_TuneCP5_13TeV-pythia8-evtgen/AODSIM/106X_mcRun2_asymptotic_preVFP_v8-v3/2830000/19F5E539-C
83C-0E48-8730-F26BAC838B28.root', 'status': 1}]]
(Background on this error at: http://sqlalche.me/e/4xp6)
        ClassName : None
        ModuleName : WMComponent.RucioInjector.RucioInjectorPoller
        MethodName : _updateLFNState
        ClassInstance : None
        FileName : /data/srv/wmagent/v2.0.2.patch1/sw/slc7_amd64_gcc630/cms/wmagentpy3/2.0.2.patch1/lib/python3.8/site-packages/WMComponent/RucioInjector/RucioInjectorPoller.py
        LineNumber : 308
        ErrorNr : 0

Traceback:
  File "/data/srv/wmagent/v2.0.2.patch1/sw/slc7_amd64_gcc630/cms/wmagentpy3/2.0.2.patch1/lib/python3.8/site-packages/WMComponent/RucioInjector/RucioInjectorPoller.py", line 298, in _updateLF
NState
    self.setStatus.execute(listLfns, 1)

  File "/data/srv/wmagent/v2.0.2.patch1/sw/slc7_amd64_gcc630/cms/wmagentpy3/2.0.2.patch1/lib/python3.8/site-packages/WMComponent/DBS3Buffer/MySQL/DBSBufferFiles/SetPhEDExStatus.py", line 25,
 in execute
    self.dbi.processData(self.sql, bindVars, conn = conn,

  File "/data/srv/wmagent/v2.0.2.patch1/sw/slc7_amd64_gcc630/cms/wmagentpy3/2.0.2.patch1/lib/python3.8/site-packages/WMCore/Database/DBCore.py", line 159, in processData
    result.extend(self.executemanybinds(sqlstmt[0], subBinds,

  File "/data/srv/wmagent/v2.0.2.patch1/sw/slc7_amd64_gcc630/cms/wmagentpy3/2.0.2.patch1/lib/python3.8/site-packages/WMCore/Database/DBCore.py", line 113, in executemanybinds
    result = connection.execute(s, b)

  File "/data/srv/wmagent/v2.0.2.patch1/sw/slc7_amd64_gcc630/external/py3-sqlalchemy/1.3.3-comp/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 982, in execute
    return self._execute_text(object_, multiparams, params)
...

And here is one ERROR which might be more related to the duplicate DID exception.
2022-05-31 11:43:32,158:140444646516480:ERROR:Rucio:Failed to add replicas for: [{'name': '/store/mc/RunIISummer20UL16RECOAPV/LambdaBTopKPsi2s_SoftQCDnonD_TuneCP5_13TeV-pythia8-evtgen/AODSIM/106X_mcRun2_asymptotic_preVFP_v8-v3/2830000/139D23C2-7D60-9743-83A0-180BC27A4948.root', 'scope': 'cms', 'bytes':<PHONE_NUMBER>, 'state': 'A', 'adler32': '11e77647'}] and block: /LambdaBTopKPsi2s_SoftQCDnonD_TuneCP5_13TeV-pythia8-evtgen/RunIISummer20UL16RECOAPV-106X_mcRun2_asymptotic_preVFP_v8-v3/AODSIM#ef65006a-bf3f-4dfe-bc26-4957dceb0f43. Error: An unknown exception occurred.
Details: ('(cx_Oracle.IntegrityError) ORA-00001: unique constraint (CMS_RUCIO_PROD.DIDS_PK) violated',)

Repeating the debugging information I've posted in the Jira ticket: https://its.cern.ch/jira/browse/CMSCOMPPR-25873 here as well:
Today I took one of the two workflows Hasan Ozturk was pointing as the latest ones suffering the issue and did the following debugging:

The request I used: https://dmytro.web.cern.ch/dmytro/cmsprodmon/workflows.php?prep_id=ReReco-Run2017G-HighEGJet-09Aug2019_UL2017-00002
The workflow name in request manager: pdmvserv_Run2017G_HighEGJet_09Aug2019_UL2017_220602_103813_4635
The list of agents that have been working on this workflow:

cmsgwms-submit7.fnal.gov
cmsgwms-submit8.fnal.gov
vocms0282.cern.ch
vocms0283.cern.ch

Checking with dasgoclient, all of the files listed by Hasan belong to only two blocks:

/HighEGJet/Run2017G-09Aug2019_UL2017-v2/MINIAOD#ac7dc12c-bcde-4576-90de-276bcf1a2105
/HighEGJet/Run2017G-09Aug2019_UL2017-v2/AOD#af7390e5-776b-49b9-a810-e368448384b7

By parsing the logs of all of the agents I've found, both of those blocks have been produced by agent vocms0283
Further more took one of the blocks and parsed the logs searching for the following steps:

opening the block
inserting into Rucio
file insertions into the block
closing the block

 cmst1@vocms0283:/data/srv/wmagent/current $ grep -rin /HighEGJet/Run2017G-09Aug2019_UL2017-v2/MINIAOD#ac7dc12c-bcde-4576-90de-276bcf1a2105 install/wmagentpy3/RucioInjector/ComponentLog
354599:2022-06-03 10:37:22,923:140444646516480:INFO:RucioInjectorPoller:Block /HighEGJet/Run2017G-09Aug2019_UL2017-v2/MINIAOD#ac7dc12c-bcde-4576-90de-276bcf1a2105 inserted into Rucio
354622:2022-06-03 10:39:25,502:140444646516480:INFO:RucioInjectorPoller:Successfully inserted 1 files on block /HighEGJet/Run2017G-09Aug2019_UL2017-v2/MINIAOD#ac7dc12c-bcde-4576-90de-276bcf1a2105
354633:2022-06-03 10:40:14,308:140444646516480:INFO:RucioInjectorPoller:Block rule created for block: /HighEGJet/Run2017G-09Aug2019_UL2017-v2/MINIAOD#ac7dc12c-bcde-4576-90de-276bcf1a2105, at: T2_US_Nebraska, with rule id: 666e71aa0e1344a5b13a1c5a66f7ebd9
354708:2022-06-03 11:11:15,937:140444646516480:INFO:RucioInjectorPoller:Successfully inserted 1 files on block /HighEGJet/Run2017G-09Aug2019_UL2017-v2/MINIAOD#ac7dc12c-bcde-4576-90de-276bcf1a2105
354846:2022-06-03 11:51:15,901:140444646516480:INFO:RucioInjectorPoller:Successfully inserted 1 files on block /HighEGJet/Run2017G-09Aug2019_UL2017-v2/MINIAOD#ac7dc12c-bcde-4576-90de-276bcf1a2105
354868:2022-06-03 11:56:59,654:140444646516480:INFO:RucioInjectorPoller:Successfully inserted 2 files on block /HighEGJet/Run2017G-09Aug2019_UL2017-v2/MINIAOD#ac7dc12c-bcde-4576-90de-276bcf1a2105
354976:2022-06-03 12:31:02,459:140444646516480:INFO:RucioInjectorPoller:Successfully inserted 1 files on block /HighEGJet/Run2017G-09Aug2019_UL2017-v2/MINIAOD#ac7dc12c-bcde-4576-90de-276bcf1a2105
355054:2022-06-03 12:54:10,751:140444646516480:INFO:RucioInjectorPoller:Successfully inserted 1 files on block /HighEGJet/Run2017G-09Aug2019_UL2017-v2/MINIAOD#ac7dc12c-bcde-4576-90de-276bcf1a2105
355142:2022-06-03 13:18:28,715:140444646516480:INFO:RucioInjectorPoller:Successfully inserted 1 files on block /HighEGJet/Run2017G-09Aug2019_UL2017-v2/MINIAOD#ac7dc12c-bcde-4576-90de-276bcf1a2105
355264:2022-06-03 13:57:17,740:140444646516480:INFO:RucioInjectorPoller:Successfully inserted 2 files on block /HighEGJet/Run2017G-09Aug2019_UL2017-v2/MINIAOD#ac7dc12c-bcde-4576-90de-276bcf1a2105
355378:2022-06-03 14:35:43,214:140444646516480:INFO:RucioInjectorPoller:Successfully inserted 2 files on block /HighEGJet/Run2017G-09Aug2019_UL2017-v2/MINIAOD#ac7dc12c-bcde-4576-90de-276bcf1a2105
355443:2022-06-03 14:53:51,129:140444646516480:INFO:RucioInjectorPoller:Successfully inserted 1 files on block /HighEGJet/Run2017G-09Aug2019_UL2017-v2/MINIAOD#ac7dc12c-bcde-4576-90de-276bcf1a2105
355508:2022-06-03 15:11:27,012:140444646516480:INFO:RucioInjectorPoller:Successfully inserted 1 files on block /HighEGJet/Run2017G-09Aug2019_UL2017-v2/MINIAOD#ac7dc12c-bcde-4576-90de-276bcf1a2105
355716:2022-06-03 16:10:48,692:140444646516480:INFO:RucioInjectorPoller:Successfully inserted 1 files on block /HighEGJet/Run2017G-09Aug2019_UL2017-v2/MINIAOD#ac7dc12c-bcde-4576-90de-276bcf1a2105
355784:2022-06-03 16:33:53,366:140444646516480:INFO:RucioInjectorPoller:Successfully inserted 1 files on block /HighEGJet/Run2017G-09Aug2019_UL2017-v2/MINIAOD#ac7dc12c-bcde-4576-90de-276bcf1a2105
356041:2022-06-03 17:39:51,321:140444646516480:INFO:RucioInjectorPoller:Successfully inserted 2 files on block /HighEGJet/Run2017G-09Aug2019_UL2017-v2/MINIAOD#ac7dc12c-bcde-4576-90de-276bcf1a2105
356153:2022-06-03 17:52:37,681:140444646516480:INFO:RucioInjectorPoller:Successfully inserted 1 files on block /HighEGJet/Run2017G-09Aug2019_UL2017-v2/MINIAOD#ac7dc12c-bcde-4576-90de-276bcf1a2105
356290:2022-06-03 18:35:07,894:140444646516480:INFO:RucioInjectorPoller:Successfully inserted 1 files on block /HighEGJet/Run2017G-09Aug2019_UL2017-v2/MINIAOD#ac7dc12c-bcde-4576-90de-276bcf1a2105
356374:2022-06-03 18:58:55,960:140444646516480:INFO:RucioInjectorPoller:Successfully inserted 1 files on block /HighEGJet/Run2017G-09Aug2019_UL2017-v2/MINIAOD#ac7dc12c-bcde-4576-90de-276bcf1a2105
356403:2022-06-03 19:09:27,742:140444646516480:INFO:RucioInjectorPoller:Successfully inserted 1 files on block /HighEGJet/Run2017G-09Aug2019_UL2017-v2/MINIAOD#ac7dc12c-bcde-4576-90de-276bcf1a2105
356427:2022-06-03 19:15:23,533:140444646516480:INFO:RucioInjectorPoller:Successfully inserted 1 files on block /HighEGJet/Run2017G-09Aug2019_UL2017-v2/MINIAOD#ac7dc12c-bcde-4576-90de-276bcf1a2105
356507:2022-06-03 19:38:55,326:140444646516480:INFO:RucioInjectorPoller:Successfully inserted 1 files on block /HighEGJet/Run2017G-09Aug2019_UL2017-v2/MINIAOD#ac7dc12c-bcde-4576-90de-276bcf1a2105
356575:2022-06-03 19:54:09,903:140444646516480:INFO:RucioInjectorPoller:Successfully inserted 2 files on block /HighEGJet/Run2017G-09Aug2019_UL2017-v2/MINIAOD#ac7dc12c-bcde-4576-90de-276bcf1a2105
356648:2022-06-03 20:17:39,122:140444646516480:INFO:RucioInjectorPoller:Successfully inserted 3 files on block /HighEGJet/Run2017G-09Aug2019_UL2017-v2/MINIAOD#ac7dc12c-bcde-4576-90de-276bcf1a2105
356791:2022-06-03 20:58:39,406:140444646516480:INFO:RucioInjectorPoller:Successfully inserted 2 files on block /HighEGJet/Run2017G-09Aug2019_UL2017-v2/MINIAOD#ac7dc12c-bcde-4576-90de-276bcf1a2105
356847:2022-06-03 21:16:09,073:140444646516480:INFO:RucioInjectorPoller:Successfully inserted 1 files on block /HighEGJet/Run2017G-09Aug2019_UL2017-v2/MINIAOD#ac7dc12c-bcde-4576-90de-276bcf1a2105
357048:2022-06-03 22:19:26,911:140444646516480:INFO:RucioInjectorPoller:Successfully inserted 1 files on block /HighEGJet/Run2017G-09Aug2019_UL2017-v2/MINIAOD#ac7dc12c-bcde-4576-90de-276bcf1a2105
357108:2022-06-03 22:37:29,622:140444646516480:INFO:RucioInjectorPoller:Successfully inserted 2 files on block /HighEGJet/Run2017G-09Aug2019_UL2017-v2/MINIAOD#ac7dc12c-bcde-4576-90de-276bcf1a2105
357166:2022-06-03 22:58:57,280:140444646516480:INFO:RucioInjectorPoller:Successfully inserted 2 files on block /HighEGJet/Run2017G-09Aug2019_UL2017-v2/MINIAOD#ac7dc12c-bcde-4576-90de-276bcf1a2105
357316:2022-06-03 23:40:18,098:140444646516480:INFO:RucioInjectorPoller:Successfully inserted 1 files on block /HighEGJet/Run2017G-09Aug2019_UL2017-v2/MINIAOD#ac7dc12c-bcde-4576-90de-276bcf1a2105
357399:2022-06-04 00:03:56,876:140444646516480:INFO:RucioInjectorPoller:Successfully inserted 1 files on block /HighEGJet/Run2017G-09Aug2019_UL2017-v2/MINIAOD#ac7dc12c-bcde-4576-90de-276bcf1a2105
357447:2022-06-04 00:16:19,235:140444646516480:INFO:RucioInjectorPoller:Successfully inserted 1 files on block /HighEGJet/Run2017G-09Aug2019_UL2017-v2/MINIAOD#ac7dc12c-bcde-4576-90de-276bcf1a2105
357592:2022-06-04 01:00:58,789:140444646516480:INFO:RucioInjectorPoller:Successfully inserted 1 files on block /HighEGJet/Run2017G-09Aug2019_UL2017-v2/MINIAOD#ac7dc12c-bcde-4576-90de-276bcf1a2105
357648:2022-06-04 01:17:44,846:140444646516480:INFO:RucioInjectorPoller:Successfully inserted 1 files on block /HighEGJet/Run2017G-09Aug2019_UL2017-v2/MINIAOD#ac7dc12c-bcde-4576-90de-276bcf1a2105
357726:2022-06-04 01:36:36,447:140444646516480:INFO:RucioInjectorPoller:Successfully inserted 2 files on block /HighEGJet/Run2017G-09Aug2019_UL2017-v2/MINIAOD#ac7dc12c-bcde-4576-90de-276bcf1a2105
357821:2022-06-04 02:01:28,830:140444646516480:INFO:RucioInjectorPoller:Successfully inserted 1 files on block /HighEGJet/Run2017G-09Aug2019_UL2017-v2/MINIAOD#ac7dc12c-bcde-4576-90de-276bcf1a2105
357892:2022-06-04 02:20:18,870:140444646516480:INFO:RucioInjectorPoller:Successfully inserted 1 files on block /HighEGJet/Run2017G-09Aug2019_UL2017-v2/MINIAOD#ac7dc12c-bcde-4576-90de-276bcf1a2105
357944:2022-06-04 02:41:21,894:140444646516480:INFO:RucioInjectorPoller:Successfully inserted 2 files on block /HighEGJet/Run2017G-09Aug2019_UL2017-v2/MINIAOD#ac7dc12c-bcde-4576-90de-276bcf1a2105
358112:2022-06-04 03:18:44,061:140444646516480:WARNING:Rucio:Dids: [{'scope': 'cms', 'name': '/HighEGJet/Run2017G-09Aug2019_UL2017-v2/MINIAOD#ac7dc12c-bcde-4576-90de-276bcf1a2105'}] already attached to: /HighEGJet/Run2017G-09Aug2019_UL2017-v2/MINIAOD
358113:2022-06-04 03:18:44,061:140444646516480:INFO:RucioInjectorPoller:Block /HighEGJet/Run2017G-09Aug2019_UL2017-v2/MINIAOD#ac7dc12c-bcde-4576-90de-276bcf1a2105 inserted into Rucio
358147:2022-06-04 03:20:58,205:140444646516480:INFO:RucioInjectorPoller:Successfully inserted 3 files on block /HighEGJet/Run2017G-09Aug2019_UL2017-v2/MINIAOD#ac7dc12c-bcde-4576-90de-276bcf1a2105
358236:2022-06-04 03:44:26,378:140444646516480:INFO:RucioInjectorPoller:Successfully inserted 1 files on block /HighEGJet/Run2017G-09Aug2019_UL2017-v2/MINIAOD#ac7dc12c-bcde-4576-90de-276bcf1a2105
358328:2022-06-04 04:04:15,027:140444646516480:INFO:RucioInjectorPoller:Successfully inserted 1 files on block /HighEGJet/Run2017G-09Aug2019_UL2017-v2/MINIAOD#ac7dc12c-bcde-4576-90de-276bcf1a2105
358414:2022-06-04 04:23:48,662:140444646516480:INFO:RucioInjectorPoller:Successfully inserted 2 files on block /HighEGJet/Run2017G-09Aug2019_UL2017-v2/MINIAOD#ac7dc12c-bcde-4576-90de-276bcf1a2105
358499:2022-06-04 04:43:34,505:140444646516480:INFO:RucioInjectorPoller:Successfully inserted 1 files on block /HighEGJet/Run2017G-09Aug2019_UL2017-v2/MINIAOD#ac7dc12c-bcde-4576-90de-276bcf1a2105
369537:2022-06-05 10:39:00,076:140444646516480:INFO:RucioInjectorPoller:Closing block: /HighEGJet/Run2017G-09Aug2019_UL2017-v2/MINIAOD#ac7dc12c-bcde-4576-90de-276bcf1a2105

Counting all successful insertions from the logs above I've got the number expected by DBS: 56. So according to the agent the whole block has been produced and uploaded to Rucio properly.

$ dasgoclient -query "file block=/HighEGJet/Run2017G-09Aug2019_UL2017-v2/MINIAOD#ac7dc12c-bcde-4576-90de-276bcf1a2105" |wc -l
56

Checking all the missing files at Rucio, gives exactly the result Hasan was telling about - Rucio knows about the files but basically only about their names

 $ for file  in `cat filemismatch.list`; do echo $file:; rucio list-file-replicas cms:$file ;done
/store/data/Run2017G/HighEGJet/MINIAOD/09Aug2019_UL2017-v2/2830000/F642CFC6-1ECC-9747-B4E2-A1DFAA8D59E0.root:
+---------+--------+------------+-----------+----------------+
| SCOPE   | NAME   | FILESIZE   | ADLER32   | RSE: REPLICA   |
|---------+--------+------------+-----------+----------------|
+---------+--------+------------+-----------+----------------+
/store/data/Run2017G/HighEGJet/MINIAOD/09Aug2019_UL2017-v2/2830000/ECA4B03B-C808-1D40-8316-06CFA35B61C8.root:
+---------+--------+------------+-----------+----------------+
| SCOPE   | NAME   | FILESIZE   | ADLER32   | RSE: REPLICA   |
|---------+--------+------------+-----------+----------------|
+---------+--------+------------+-----------+----------------+
/store/data/Run2017G/HighEGJet/MINIAOD/09Aug2019_UL2017-v2/2830000/D626B272-5233-4646-8B46-84C438E6CC84.root:
+---------+--------+------------+-----------+----------------+
| SCOPE   | NAME   | FILESIZE   | ADLER32   | RSE: REPLICA   |
|---------+--------+------------+-----------+----------------|
+---------+--------+------------+-----------+----------------+
/store/data/Run2017G/HighEGJet/MINIAOD/09Aug2019_UL2017-v2/2830000/2256BCD5-F101-184F-9A0E-908CED2F2327.root:
+---------+--------+------------+-----------+----------------+
| SCOPE   | NAME   | FILESIZE   | ADLER32   | RSE: REPLICA   |
|---------+--------+------------+-----------+----------------|
+---------+--------+------------+-----------+----------------+
/store/data/Run2017G/HighEGJet/MINIAOD/09Aug2019_UL2017-v2/2830000/C1CED714-7175-734B-B218-5C5CB8836084.root:
+---------+--------+------------+-----------+----------------+
| SCOPE   | NAME   | FILESIZE   | ADLER32   | RSE: REPLICA   |
|---------+--------+------------+-----------+----------------|
+---------+--------+------------+-----------+----------------+

In contrast to a randomly taken file from the same block:

$ rucio list-file-replicas cms:/store/data/Run2017G/HighEGJet/MINIAOD/09Aug2019_UL2017-v2/2830000/1C9F45DC-A744-DC43-8392-E0CC08A90E24.root
+---------+--------------------------------------------------------------------------------------------------------------+------------+-----------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| SCOPE   | NAME                                                                                | FILESIZE   | ADLER32   | RSE: REPLICA                                                                                |
|---------+--------------------------------------------------------------------------------------------------------------+------------+-----------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| cms     | /store/data/Run2017G/HighEGJet/MINIAOD/09Aug2019_UL2017-v2/2830000/1C9F45DC-A744-DC43-8392-E0CC08A90E24.root | 2.450 GB   | 470975b1  | T2_US_Nebraska: davs://xrootd-local.unl.edu:1094/store/data/Run2017G/HighEGJet/MINIAOD/09Aug2019_UL2017-v2/2830000/1C9F45DC-A744-DC43-8392-E0CC08A90E24.root                                      |
| cms     | /store/data/Run2017G/HighEGJet/MINIAOD/09Aug2019_UL2017-v2/2830000/1C9F45DC-A744-DC43-8392-E0CC08A90E24.root | 2.450 GB   | 470975b1  | T2_UK_London_Brunel: gsiftp://dc2-grid-64.brunel.ac.uk:2811/dpm/brunel.ac.uk/home/cms/store/data/Run2017G/HighEGJet/MINIAOD/09Aug2019_UL2017-v2/2830000/1C9F45DC-A744-DC43-8392-E0CC08A90E24.root |
+---------+--------------------------------------------------------------------------------------------------------------+------------+-----------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+

So we need to understand:

Were those files actually successfuly inserted into Rucio at the first place.
If so, what has happened with those files in between the moment  the request for inserting them into the block has been done and now
if not, what was the error we should have been expecting from Rucio and probably we have not handled properly

So to answer my own previous two questions:

Rucio does know about the files and their names because at some point they have been present in the system, but currently the block length in Rucio is 51 files, which is exactly 5 files short from the number expected in DBS (and I did check, the missing files are indeed the ones reported):

In [17]: len(list(rcl.list_content('cms', '/HighEGJet/Run2017G-09Aug2019_UL2017-v2/MINIAOD#ac7dc12c-bcde-4576-90de-276bcf1a2105')))
Out[17]: 51

Checking the content history tells us exactly when the files has been deleted:

 In [18]: list(rcl.list_content_history('cms', '/HighEGJet/Run2017G-09Aug2019_UL2017-v2/MINIAOD#ac7dc12c-bcde-4576-90de-276bcf1a2105'))
Out[18]:
[{'scope': 'cms',
  'name': '/store/data/Run2017G/HighEGJet/MINIAOD/09Aug2019_UL2017-v2/2830000/2256BCD5-F101-184F-9A0E-908CED2F2327.root',
  'type': 'FILE',
  'bytes':<PHONE_NUMBER>,
  'adler32': '7750106d',
  'md5': None,
  'deleted_at': datetime.datetime(2022, 6, 6, 6, 55, 4),
  'created_at': datetime.datetime(2022, 6, 3, 20, 58, 57),
  'updated_at': datetime.datetime(2022, 6, 3, 20, 59, 27)},
 {'scope': 'cms',
  'name': '/store/data/Run2017G/HighEGJet/MINIAOD/09Aug2019_UL2017-v2/2830000/D626B272-5233-4646-8B46-84C438E6CC84.root',
  'type': 'FILE',
  'bytes':<PHONE_NUMBER>,
  'adler32': '3f70a19c',
  'md5': None,
  'deleted_at': datetime.datetime(2022, 6, 6, 6, 55, 6),
  'created_at': datetime.datetime(2022, 6, 4, 1, 20, 58),
  'updated_at': datetime.datetime(2022, 6, 4, 1, 21, 2)},
 {'scope': 'cms',
  'name': '/store/data/Run2017G/HighEGJet/MINIAOD/09Aug2019_UL2017-v2/2830000/F642CFC6-1ECC-9747-B4E2-A1DFAA8D59E0.root',
  'type': 'FILE',
  'bytes':<PHONE_NUMBER>,
  'adler32': '21e29b2e',
  'md5': None,
  'deleted_at': datetime.datetime(2022, 6, 6, 6, 55, 6),
  'created_at': datetime.datetime(2022, 6, 3, 22, 16, 19),
  'updated_at': datetime.datetime(2022, 6, 3, 22, 16, 39)},
 {'scope': 'cms',
  'name': '/store/data/Run2017G/HighEGJet/MINIAOD/09Aug2019_UL2017-v2/2830000/C1CED714-7175-734B-B218-5C5CB8836084.root',
  'type': 'FILE',
  'bytes':<PHONE_NUMBER>,
  'adler32': '5ae5c49c',
  'md5': None,
  'deleted_at': datetime.datetime(2022, 6, 6, 6, 55, 7),
  'created_at': datetime.datetime(2022, 6, 3, 20, 37, 29),
  'updated_at': datetime.datetime(2022, 6, 3, 20, 37, 53)},
 {'scope': 'cms',
  'name': '/store/data/Run2017G/HighEGJet/MINIAOD/09Aug2019_UL2017-v2/2830000/ECA4B03B-C808-1D40-8316-06CFA35B61C8.root',
  'type': 'FILE',
  'bytes':<PHONE_NUMBER>,
  'adler32': 'e4456340',
  'md5': None,
  'deleted_at': datetime.datetime(2022, 6, 6, 6, 55, 6),
  'created_at': datetime.datetime(2022, 6, 4, 0, 20, 18),
  'updated_at': datetime.datetime(2022, 6, 4, 0, 20, 30)}]

Which for all of them seems to be happening simultaneously 2 or 3 days after their creation, at:

    'deleted_at': datetime.datetime(2022, 6, 6, 6, 55, 6)

If someone from from Data Management could check the reason for these deletions, this would be of great help. Thanks!
Could that be because of a missing rule protecting them or because the insertion has not completed, or because they were  not properly associated with a higher level data container...? The latest seems to be a negative answer, though, since at some point the block/(dataset in Rucio terms) did know about those files?

I looked into the undertaker, which I think is the thing deleting files. It's only been running since June 7 and only removed one DID:
Removing did cms:/store/mc/RunIISummer20UL17MiniAODv2/ZpToMuMu_M85_TuneCP5_13TeV-madgraph-pythia8/MINIAODSIM/106X_mc2017_realistic_v9-v2/2530000/A9E566C4-79B9-4941-9642-7B0F23469747.root
We have our Rucio meeting now and I will try to understand under what circumstances DIDs get deleted.

Hi @ericvaandering  we did double check with @amaltaro  and the answer is: No, we do not set did replicas with expiration date, neither for file nor for dataset. And actually if we were having those set for the dataset(blocks in CMS terms) this expiration data would have been affecting also the rest 51 files in the same dataset. There is something different with those 5 that has been deleted, and I cannot figure out what.

@todor-ivanov @ericvaandering have we concluded that there is nothing in WMCore to be fixed on this regard and that actually files get inserted into Rucio, but they (files/replicas) somehow get deleted by something in the Rucio consistency monitor eco-system?

Hi @amaltaro I do not think there is anything we can do here from the WMCore side. Closing this issue now.


Update static_type_checking.md for tox4

Description
Please add an informative description that covers that changes made by the pull request and link all relevant issues.
If an SDK is being regenerated based on a new swagger spec, a link to the pull request containing these swagger spec changes has been included above.
All SDK Contribution checklist:

[ ] The pull request does not introduce [breaking changes]
[ ] CHANGELOG is updated for new features, bug fixes or other significant changes.
[ ] I have read the contribution guidelines.

General Guidelines and Best Practices

[ ] Title of the pull request is clear and informative.
[ ] There are a small number of commits, each of which have an informative message. This means that previously merged commits do not appear in the history of the PR. For more information on cleaning up the commits in your PR, see this page.

Testing Guidelines

[ ] Pull request includes test coverage for the included changes.

Going to close this, looks the docs updates were made in the PR that updated tox 😄


⚠ Bofrost.at has degraded performance

In 9592d1b, Bofrost.at (https://www.bofrost.at) experienced degraded performance:

HTTP code: 200
Response time: 1684 ms

Resolved: Bofrost.at performance has improved in ec31980.


feat: disable the feature, if a customer needs to

adds ios feature https://github.com/customerio/customerio-ios/pull/430 to the expo plugin

Changing this to a draft PR. We may not need to modify Expo plugin at all depending on what config option we end up using in iOS PR https://github.com/customerio/customerio-ios/pull/430

Closing. We are re-using an existing expo config option to enable/disable feature. No change needed to expo plugin.


[BUG] extra space added to resource value when using --use-aapt2

Information

Apktool Version (apktool -version) - 2.5.0
Operating System (Mac, Linux, Windows) - Mac
APK From? (Playstore, ROM, Other) - custom made
there is a fix in private String checkIfStringIsNumeric(String val) that adds "\ " to large integer values in xml.
the original issue seems to have been specifically for manifest metadata, but was added to all xml.
using apktool with aapt1 does as was intended, and changes the value "\<PHONE_NUMBER>" to "1000000000".
using apktool with aapt2 does not work as intended, and changes the value "\<PHONE_NUMBER>" to "<PHONE_NUMBER>"
the attached app tries to read the value and parse it as an integer, and crashes due to the extra space in the value.
is there some way in apktool's code, in checkIfStringIsNumeric, to know if it is currently running in aapt2, so that at least as some sort of workaround, it won't add the "\ "?

Stacktrace/Logcat
08-25 09:56:48.957 19389 19389 E AndroidRuntime: Caused by: java.lang.NumberFormatException: For input string: "<PHONE_NUMBER>"
08-25 09:56:48.957 19389 19389 E AndroidRuntime: 	at java.lang.Integer.parseInt(Integer.java:604)
08-25 09:56:48.957 19389 19389 E AndroidRuntime: 	at java.lang.Integer.parseInt(Integer.java:650)
08-25 09:56:48.957 19389 19389 E AndroidRuntime: 	at com.itay.apktooltest.MainActivity$MyLayout.<init>(MainActivity.java:27)```

### Steps to Reproduce
1. `apktool  d ~/app-debug.apk -o ~/apktool_output --use-aapt2`
2. `apktool  b ~/apktool_output -o ~/apktool.apk --use-aapt2`

### Frameworks
If this APK is from an OEM ROM (Samsung, HTC, LG). Please attach framework files
(`.apks` that live in `/system/framework` or `/system/priv-app`)

### APK
If this APK can be freely shared, please upload/attach a link to it.

[app-debug.apk.zip](https://github.com/iBotPeaches/Apktool/files/7044395/app-debug.apk.zip)

### Questions to ask before submission
1. Have you tried `apktool d`, `apktool b` without changing anything? the app works when using apktool without --use-aapt2
2. If you are trying to install a modified apk, did you resign it? yes
3. Are you using the latest apktool version? 2.5.0

this relates to:
https://github.com/iBotPeaches/Apktool/issues/767
i am not even sure that the same aapt issue that was seen in the metadata also affects other xml properties.
i added an xml custom property with a value of<PHONE_NUMBER>000. run apktool d & b, signed and run the app. the property was read as it should without truncation.
this leads me to believe the addition of "\ " should be limited to the metadata, and should also be limited to aapt 1.
moreover, the current solution also adds the "\ " to numbers lower than INT_MAX (and doesn't handle negative numbers at all).

also relates to https://github.com/iBotPeaches/Apktool/pull/2612
seems a change was added to master to handle the "\ " addition for the manifest specifically, but was not removed from the other XMLs.
i am not completely sure, but since aapt2 doesn't remove the space added by apktool, this means that apktool will actually change values inside the app. i believe that for aapt2, the metadata should not be changed at all. but i am not that familiar with all the findings.

Stumbled upon this commit while digging AOSP and remembered this spacing ticket - https://github.com/iBotPeaches/platform_frameworks_base/commit/1d358ff5bb59f56ab19aa31d6afcf82c46b7c7bc
Unfortunately as I re-read this ticket, it isn't related.
I then looked into original issue and it seems we need to know if we are using aapt2/aapt1 during that chunk of code. So need to rethink some organization to get that known to that chunk of code.


ptrace_other always returns 0 (in case of success)

ptrace_other (and therefore also ptrace) seem to -- in case of success (Result::Ok) -- always return 0. This is really confusing since libc::ptrace does return useful results. Is this just a bug? If not, I wonder why this is better than returning ().

Well, ptrace is deprecated now.  Its replacements like ptrace_get_data have more useful return values.