HDFS-17436. Supplement log information for AccessControlException

Description of PR
For more information about this PR, please refer to the following issue：
HDFS-17436 checkPermission should not ignore original AccessControlException
I think we should keep the original AccessControlException information, so that we can understand the real situation of the problem.
How was this patch tested?
Because this patch has no changes at the logical level of the code, there is no corresponding unit test.
Although there is no specific unit test for this patch, I can see the corresponding information in the log of active namenode when I trigger the exception again.
For code changes:

[x] Does the title or this PR starts with the corresponding JIRA issue id (e.g. 'HADOOP-17799. Your PR title ...')?
[ ] Object storage: have the integration tests been executed and the endpoint declared according to the connector-specific documentation?
[x] If adding new dependencies to the code, are these dependencies licensed in a way that is compatible for inclusion under ASF 2.0?
[ ] If applicable, have you updated the LICENSE, LICENSE-binary, NOTICE-binary files?

This is beneficial for troubleshooting issues with external authentication components, and this log is necessary; However, printing a large number of authentication failure logs is a significant burden, and I suggest changing the log level to DEBUG.

Okay, thank you for your reminder.

LGTM.

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Logfile
Comment

+0 :ok:
reexec
0m 30s

Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  0s

No case conflicting files found.

+0 :ok:
codespell
0m  1s

codespell was not available.

+0 :ok:
detsecrets
0m  1s

detect-secrets was not available.

+1 :green_heart:
@author
0m  0s

The patch does not contain any @author tags.

-1 :x:
test4tests
0m  0s

The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.

_ trunk Compile Tests _

+1 :green_heart:
mvninstall
45m 15s

trunk passed

+1 :green_heart:
compile
1m 23s

trunk passed with JDK Ubuntu-11.0.22+7-post-Ubuntu-0ubuntu220.04.1

+1 :green_heart:
compile
1m 15s

trunk passed with JDK Private Build-1.8.0_402-8u402-ga-2ubuntu1~20.04-b06

+1 :green_heart:
checkstyle
1m 10s

trunk passed

+1 :green_heart:
mvnsite
1m 25s

trunk passed

+1 :green_heart:
javadoc
1m  6s

trunk passed with JDK Ubuntu-11.0.22+7-post-Ubuntu-0ubuntu220.04.1

+1 :green_heart:
javadoc
1m 40s

trunk passed with JDK Private Build-1.8.0_402-8u402-ga-2ubuntu1~20.04-b06

+1 :green_heart:
spotbugs
3m 17s

trunk passed

+1 :green_heart:
shadedclient
37m 18s

branch has no errors when building and testing our client artifacts.

_ Patch Compile Tests _

+1 :green_heart:
mvninstall
1m 11s

the patch passed

+1 :green_heart:
compile
1m 10s

the patch passed with JDK Ubuntu-11.0.22+7-post-Ubuntu-0ubuntu220.04.1

+1 :green_heart:
javac
1m 10s

the patch passed

+1 :green_heart:
compile
1m  8s

the patch passed with JDK Private Build-1.8.0_402-8u402-ga-2ubuntu1~20.04-b06

+1 :green_heart:
javac
1m  8s

the patch passed

+1 :green_heart:
blanks
0m  0s

The patch has no blanks issues.

+1 :green_heart:
checkstyle
0m 56s

the patch passed

+1 :green_heart:
mvnsite
1m 11s

the patch passed

+1 :green_heart:
javadoc
0m 52s

the patch passed with JDK Ubuntu-11.0.22+7-post-Ubuntu-0ubuntu220.04.1

+1 :green_heart:
javadoc
1m 34s

the patch passed with JDK Private Build-1.8.0_402-8u402-ga-2ubuntu1~20.04-b06

+1 :green_heart:
spotbugs
3m 10s

the patch passed

+1 :green_heart:
shadedclient
40m 53s

patch has no errors when building and testing our client artifacts.

_ Other Tests _

-1 :x:
unit
239m 57s
/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt
hadoop-hdfs in the patch passed.

+1 :green_heart:
asflicense
0m 44s

The patch does not generate ASF License warnings.

388m 33s

Reason
Tests

Failed junit tests
hadoop.hdfs.TestDFSStripedOutputStreamWithRandomECPolicy

hadoop.hdfs.server.datanode.TestDirectoryScanner

Subsystem
Report/Notes

Docker
ClientAPI=1.45 ServerAPI=1.45 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6651/2/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/6651

Optional Tests
dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell detsecrets

uname
Linux a34c72a38206 5.15.0-91-generic #101-Ubuntu SMP Tue Nov 14 13:30:08 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/bin/hadoop.sh

git revision
trunk / cbaa42f0cee5217c9874336412409e893f66802c

Default Java
Private Build-1.8.0_402-8u402-ga-2ubuntu1~20.04-b06

Multi-JDK versions
/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.22+7-post-Ubuntu-0ubuntu220.04.1 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_402-8u402-ga-2ubuntu1~20.04-b06

Test Results
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6651/2/testReport/

Max. process+thread count
3691 (vs. ulimit of 5500)

modules
C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs

Console output
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6651/2/console

versions
git=2.25.1 maven=3.6.3 spotbugs=4.2.2

Powered by
Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Logfile
Comment

+0 :ok:
reexec
0m 35s

Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  0s

No case conflicting files found.

+0 :ok:
codespell
0m  0s

codespell was not available.

+0 :ok:
detsecrets
0m  0s

detect-secrets was not available.

+1 :green_heart:
@author
0m  0s

The patch does not contain any @author tags.

-1 :x:
test4tests
0m  0s

The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.

_ trunk Compile Tests _

+1 :green_heart:
mvninstall
49m  3s

trunk passed

+1 :green_heart:
compile
1m 24s

trunk passed with JDK Ubuntu-11.0.22+7-post-Ubuntu-0ubuntu220.04.1

+1 :green_heart:
compile
1m 18s

trunk passed with JDK Private Build-1.8.0_392-8u392-ga-1~20.04-b08

+1 :green_heart:
checkstyle
1m 14s

trunk passed

+1 :green_heart:
mvnsite
1m 29s

trunk passed

+1 :green_heart:
javadoc
1m  6s

trunk passed with JDK Ubuntu-11.0.22+7-post-Ubuntu-0ubuntu220.04.1

+1 :green_heart:
javadoc
1m 41s

trunk passed with JDK Private Build-1.8.0_392-8u392-ga-1~20.04-b08

+1 :green_heart:
spotbugs
3m 38s

trunk passed

+1 :green_heart:
shadedclient
37m 32s

branch has no errors when building and testing our client artifacts.

_ Patch Compile Tests _

+1 :green_heart:
mvninstall
1m 17s

the patch passed

+1 :green_heart:
compile
1m 15s

the patch passed with JDK Ubuntu-11.0.22+7-post-Ubuntu-0ubuntu220.04.1

+1 :green_heart:
javac
1m 15s

the patch passed

+1 :green_heart:
compile
1m 10s

the patch passed with JDK Private Build-1.8.0_392-8u392-ga-1~20.04-b08

+1 :green_heart:
javac
1m 10s

the patch passed

+1 :green_heart:
blanks
0m  0s

The patch has no blanks issues.

+1 :green_heart:
checkstyle
0m 56s

the patch passed

+1 :green_heart:
mvnsite
1m 13s

the patch passed

+1 :green_heart:
javadoc
0m 51s

the patch passed with JDK Ubuntu-11.0.22+7-post-Ubuntu-0ubuntu220.04.1

+1 :green_heart:
javadoc
1m 33s

the patch passed with JDK Private Build-1.8.0_392-8u392-ga-1~20.04-b08

+1 :green_heart:
spotbugs
3m 22s

the patch passed

+1 :green_heart:
shadedclient
37m 50s

patch has no errors when building and testing our client artifacts.

_ Other Tests _

+1 :green_heart:
unit
227m 40s

hadoop-hdfs in the patch passed.

+1 :green_heart:
asflicense
0m 42s

The patch does not generate ASF License warnings.

377m 47s

Subsystem
Report/Notes

Docker
ClientAPI=1.44 ServerAPI=1.44 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6651/3/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/6651

Optional Tests
dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell detsecrets

uname
Linux 079b56841608 5.15.0-94-generic #104-Ubuntu SMP Tue Jan 9 15:25:40 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/bin/hadoop.sh

git revision
trunk / 822a00e26d901946130130781696bae914a4d9f5

Default Java
Private Build-1.8.0_392-8u392-ga-1~20.04-b08

Multi-JDK versions
/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.22+7-post-Ubuntu-0ubuntu220.04.1 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_392-8u392-ga-1~20.04-b08

Test Results
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6651/3/testReport/

Max. process+thread count
3467 (vs. ulimit of 5500)

modules
C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs

Console output
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6651/3/console

versions
git=2.25.1 maven=3.6.3 spotbugs=4.2.2

Powered by
Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

merged. Thanks @XbaoWu for your contribution. Thanks @slfan1989 @hiwangzhihui for your review.


[c++] Cmake bug fix and improvements

Cmake will search the system for TileDB. If not found, it will build (or download) the version specified in libtiledbsoma/cmake/Modules/FindTileDB_EP.cmake.
Use this command to explicitly build using a version of TileDB installed on the system:
make install tiledb=<absolute-path-to-tiledb-dist>

Setting LD_LIBRARY_PATH is no longer required.

Codecov Report
Base: 60.96% // Head: 74.05% // Increases project coverage by +13.08% :tada:

Coverage data is based on head (a402925) compared to base (e1f5e96).
Patch has no changes to coverable lines.

Additional details and impacted files
@@             Coverage Diff             @@
##             main     #525       +/-   ##
===========================================
+ Coverage   60.96%   74.05%   +13.08%
===========================================
  Files          63       27       -36
  Lines        3292     1869     -1423
===========================================
- Hits         2007     1384      -623
+ Misses       1285      485      -800

Flag
Coverage Δ

python
74.05% <ø> (ø)

r
?

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files
Coverage Δ

src/riterator.cpp

inst/tiledb/include/tiledb/array_schema.h

src/rinterface.cpp

R/SOMADenseNdArray.R

inst/tiledb/include/tiledb/query_condition.h

src/include/tiledbsoma/managed_query.h

src/include/span/span.hpp

src/rutilities.h

inst/tiledb/include/tiledb/domain.h

inst/tiledb/include/tiledb/core_interface.h

... and 26 more

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

:umbrella: View full report at Codecov.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.

Why do we want to block system installs of TileDB by default? This is not how we handle other applications. I believe we should always support detecting system installs automatically.

I generally only ever install one TileDB Core version (and use dev for it) and generally have not had any issues with that approach.  And make r-build still works as it did before so no objection from me.

The latest commit reverts to searching the system for TileDB by default.
Cmake VERSION ranges could help avoid linking to an old TileDB version, but they don't support specifying a minimum version number.


Question about SLEIGH when designing a language based on a variable register piece

I am trying to implement a PowerPC language variant for the Gekko and Broadway CPU used in the Nintendo GameCube and Nintendo Wii respectively. The current state of the language can be found here (Only implemented the required parts for the disassembly): https://github.com/aldelaro5/ghidra-gekko-broadway-lang I am now trying to implement the semantic, but got into a blocking issue that I would like to know possible ways to resolve.
At the end of the slaspec file, there's instructions exclusive to both CPU called paired singles instructions. These are instructions that allows to operate on 2 floats at once, but the load and store instructions supports quantization with 4 possible integers types (signed and unsigned 8 and 16 bits). To select the type, the index of a register called a GQR must be provided in the I operand. The GQR contains the settings of the load and store type for quantization as well as a scaling factor to apply when performing the quantization.
The problem I have is these settings are present within specific bits of the desired GQR. When trying to implement the semantic with SLEIGH, I can easily get the GQR by attaching I to them, but I couldn't find any way to have different constructors or sub constructors that would give a different semantic based on the bit range of the type setting of the GQR. The semantic has to be different because the size and signed/unsigned varies between the types as well as having the possibilities to skip the quantization entirely so I need multiple constructors, but I cannot put the appropriate restriction on the GQR attached by I.
My question: does the semantic of such a language possible to implement with the current SLEIGH language? If yes, how? if no, what can be done for this to become possible?

Are the values of the bits in the GQR registers known only at run-time?
If so, you cannot match on the bits during the sleigh parse.
I'm sure it is implementable.  If the values are known only at run-time, then you would need to implement conditional semantics with if () goto ;  logic.
An example of the construct would be in the x86 sgx.sinc file.
There may be other ways depending on the exact details.

it's funny you mention this because I only realised you could define labels in the semantics a few hours ago and I was about to try this as this seems to be exactly what I want.
Yes, they are known at runtime, but this isn't an issue because the targets usually sets them and never touch them again so the user can simply set the register values globally and the decompiler should take as these values. I expected that it would have been done this way, but I can at least tell where the settings comes from.
I'll try to implement with if goto logics and if that seems to work, I'll close the issue.

Maybe you could make GQR a context register, then you would be able to match the instructions based on its value. Though there are so many possible combinations it'd probably result in a huge slaspec file.

Ok the if logic does work, so I will close this. I might end up defining it as a pcode op because it's complex enough that it can look very ugly in the decompiler, but anyway, it's definitely possible which answered my question, thanks for the help!


[Bug] [Seatunnel-Core] Too much flink-table-planner.jar in the tmp dir

Search before asking

[X] I had searched in the issues and found no similar issues.

What happened
We are using a standalone cluster that doesn't exit to run the Seatunnel jobs submitted to it. After that cluster has been running for days, we found :
There are lots of jars named flink-table-planner*.jar under the tmp folder, which has used up most of the available storage

This jar was created when the method org.apache.flink.table.planner.loader.PlannerModule#PlannerModule runs.

SeaTunnel Version
2.3.5
SeaTunnel Config
{
  "env": {
    "job.mode": "BATCH",
    "parallelism": 1
  },
  "source": [
    {
      "plugin_name": "FakeSource",
      "result_table_name": "fake",
      "row.num": 100,
      "schema": {
        "fields": {
          "name": "string",
          "gender": "boolean",
          "card": "int"
        }
      }
    }
  ],
  "sink": [
    {
      "plugin_name": "Console",
      "source_table_name": "fake"
    }
  ]
}

Running Command
org.apache.seatunnel.example.flink.v2.SeaTunnelApiExample

Error Exception
There are lots of jars named `flink-table-planner*.jar` under the tmp folder, which has used up most of the available storage
![Screenshot 2024-07-08 at 17 52 58](https://github.com/apache/seatunnel/assets/38579068/238782b5-8033-49f5-9f54-6a1a3a31262f)

Zeta or Flink or Spark Version
flink 1.15.4
Java or Scala Version
java8
Screenshots
No response
Are you willing to submit PR?

[ ] Yes I am willing to submit a PR!

Code of Conduct

[X] I agree to follow this project's Code of Conduct

Also in the flink 1.17 or higher version, that temp file will be deleted when the JVM exits, but in the case the JVM doesn't exit, the tmp dir will run out of storage.  It's critical.


[Bugs] AMF/UDM Add Unsubscribe event handler

Describe the bug
AMF and UDM does not have proper Unsubscribe event handler.
To Reproduce
UE to register/unregister multiple times.  Due to not handling proper Unsubscribe event, UDR resources are not freed.
Expected behavior
When AMF receives UE Deregistration, AMF should send Unsubscribe message to UDM (DELETE /{supi}/sdm-subscriptions/{subscriptionId}).  UDM should handle this event and free corresponding resources.
Environment (please complete the following information):

free5GC Version: 3.0.4
OS: Ubuntu 18.04
Kernel version: 5.0.0-23-generic
go version: 1.14.4 linux/amd64

Pull Request
AMF Pull Request - PR has been updated.
UDM Pull Request - PR has been updated.

Thanks for the PRs!


benchmark: add --benchmem flag to benchmark command

I want to see, how many memory hugo consumes in the same way as go test -bench=. --benchmem do.

Use http://discuss.gohugo.io/ for questions.

But it's not the question, it's feature request: it would be great to add --benchmem flag to benchmark command🙏

Yes, we should maybe refit that command to a Go benchmark ...
Also see https://github.com/bep/hugo-benchmark

I think, it could be implemented like that:
var mem runtime.MemStats
runtime.ReadMemStats(&mem)
before := mem.Alloc
// operations...
runtime.ReadMemStats(&mem)
after := mem.Alloc

memUsage := after - before
// print memUsage


Pikpak support.

Recently just try out pikpak seem it cache torrent very well.
Even very old & rare movies, or other region movies also wide cache and download able.
Seem like it no delete torrents even no active torrent.
And the payment also support various like crypto currency and alipay as well.
So far just saw it appear on Media Fusion add-on (stremio) but seems it broke API.
Thanks

This is pikpak api， I doesn't It related on the integrate into the addons give help or not.
https://github.com/Quan666/PikPakAPI
For use case can refer to addons media fusion stremio.


[FEATURE] FileUploader: processing of files before upload via interface

The sap.ui.unified.FileUploader is an amazing control. However, making reuse of the existing code in custom controls can sometimes only be implemented using private APIs of sap.ui.unified.FileUploader which is always a bad practice.
This change introduces the new interface sap.ui.unified.IUploadableBlobs and changes the sap.ui.unified.FileUploader control to use this interface when upload() is called. It makes it save to implement custom controls that extend sap.ui.unified.FileUploader in order to modify the files before they get uploaded. This comes in handy in many use cases such, i.e. creating zip files for the upload.
This changes introduces minimal changes to the upload() APIs by using Promises are internally. Here, the interface API sap.ui.unified.IUploadableBlobs.getProcessedBlobsFromArray is used - a simple way to allow sub-controls the functionality in an "upgrade-save" way. The default implementation of the interface API does nothing but resolving the promise with the files received from the in the sap.ui.unified.FileUploader without changing them. This default implementation makes sure that the current behaviour is not changed.

 Thank you for your submission, we really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.Nabi Zamani seems not to be a GitHub user. You need a GitHub account to be able to sign the CLA. If you have already a GitHub account, please add the email address used for this commit to your account.You have signed the CLA already but the status is still pending? Let us recheck it.


Fix schema.

@frikille would you have a few minutes to take a look?

@mcollina @voslartomas I tend to believe that this is only a sympton of the issue described in https://github.com/mcollina/fastify-gql/issues/184

I agree with @asciidisco. The error this PR is fixing seems to be related to #184.
As I explained in https://github.com/mcollina/fastify-gql/issues/219#issuecomment-660157369 we get an error similar to the one described in #184.
I think there's slight difference here though: we get away with removing @key on just one of the extend User. We can either remove it from https://github.com/mcollina/fastify-gql/blob/master/examples/gateway-subscription.js#L111 or from https://github.com/mcollina/fastify-gql/blob/master/examples/gateway-subscription.js#L173 and in both cases the error goes away and the gateway boots.
So, it is true that this PR will fix the immediate issue with the gateway subscription and will make the server boot, but I think it is not the correct fix because as far as I can see the schema is a legitimate one and should work.
The underlying cause should be fixed instead.

So, it is true that this PR will fix the immediate issue with the gateway subscription and will make the server boot, but I think it is not the correct fix because as far as I can see the schema is a legitimate one and should work.
The underlying cause should be fixed instead.

Actually, let me take that back and ask the questions: is this a valid schema?
In this case it seems so because @key holds the same definition in both federated services. But what if the two services had different definitions? How could the gateway merge them?
And what's the best way to signal this to the user? Should the gateway silently ignore the conflicts?

@paolochiodi Which emphasizes again on what @flux627 https://github.com/mcollina/fastify-gql/issues/184#issuecomment-644174562 said & something that probably @frikille can answer best, as the original author of that code.
One could ask how apollo behaves in such cases, but then would also need to ask if apollo should be used as the reference implementation here, or not.

@asciidisco yep, that's correct.
For the record, I found this in the apollo docs at https://www.apollographql.com/docs/apollo-server/federation/entities/#referencing

The @key directive indicates that Product uses the upc field as its primary key. This value must match the value of exactly one @key defined in the entity's originating service, even if the entity defines multiple primary keys.

Also worth noting that fastify-gql's gateway seems to be doing the right thing* when an entity is extended only once. The problem occurs when it's extended twice.

the right thing: one can replace it with "the thing apollo also does"

One could ask how apollo behaves in such cases, but then would also need to ask if apollo should be used as the reference implementation here, or not.

Apollo is the authority here, and this is about more than implementation details. They have docs describing the system, but since they don't have an official spec, then we need to take their docs + implementation together as a de-facto spec. Otherwise, we're implementing something different than Federation. That's ok, but we shouldn't claim that this is Federation in that case. I personally think it's in this library's best interest to match the functionality of Apollo and not diverge into its own flavor of schema delegation (especially if it's marketed as Federation and is almost Federation).
FWIW, I was originally looking into this library for its subscription support in combination with Federation, but have since moved on to using schema stitching via the new graphql-tools stitchSchemas() type merging.

I've done some more research and I may have found the route cause... but I'm moving the discussion to https://github.com/mcollina/fastify-gql/issues/184 as it seems more relevant there.

One could ask how apollo behaves in such cases, but then would also need to ask if apollo should be used as the reference implementation here, or not.

Apollo is the authority here, and this is about more than implementation details. They have docs describing the system, but since they don't have an official spec, then we need to take their docs + implementation together as a de-facto spec. Otherwise, we're implementing something different than Federation. That's ok, but we shouldn't claim that this is Federation in that case. I personally think it's in this library's best interest to match the functionality of Apollo and not diverge into its own flavor of schema delegation (especially if it's marketed as Federation and is almost Federation).
FWIW, I was originally looking into this library for its subscription support in combination with Federation, but have since moved on to using schema stitching via the new graphql-tools stitchSchemas() type merging.

How exactly are you doing this please? You have one server witch is stitching federated schema and subscriptions? Another server is Federation and then services?

I have a gateway server (not an Apollo Federation Gateway™)  that merges the types from multiple other subschemas. No directives required, but you do need to implement queries on the subschemas to fetch types via some identifier/key. See the docs here.
As an exercise, I took this Apollo federation demo and converted it to use graphql-tools schema stitching, if you want to see a direct comparison.
For subscriptions, check out the code from this comment.

@flux627  I see, so it's the old approach before federation. Or am I missing something?

The stitchSchemas function, along with its type merging abilities, is brand new to graphql-tools v6. The old method of schema stitching (and the one that Apollo talks about as deprecated/obsolete) is much more cumbersome than what this provides.

@flux627 I see, will take a look, thanks.

@voslartomas As the conversation has been going into the direction of fixing the root cause for this, I think this could be closed.


Multi-threaded trajectory reading fails occasionally

Sometime the trajectory test fails, but not always (see this action run).
This is caused by the DCD test which uses molfiles.
Steps to reproduce:

use latest master (17a14fca)
run while :; do ctest --output-on-failure -j2 -R "^trajectory$"; done
observe failing tests (seems to have an occurrence of ~50% of the time)

Ref #422

Looks like one more reason to drop the molfiles code.
I'm working on a rewrite of the DCD format, it seems to work pretty well. The main issue is finding test files for all possible variations of the format, some of which seems to be only created by software from the early 90s!

I don't think #422 is related, this was mostly windows code. From the error message, I would suspect some kind of issue with vmd plugin initialization (we might be initializing it mutliple time from different threads).


Swift Compiler Error

ValidationTest.swift has one error(Could not build Objective-C module '')

A little more information would be helpful. Are you just trying to build the Alamofire project, or your own app? I just pulled the latest version, and every target compiles fine and tests pass.
Do you use the latest version?
Also, it looks like you are using Objective-C somewhere. AFAIK Alamofire is not meant to be used with Objective-C. Use the excellent AFNetworking library instead.

@51cc You're using an out-of-date version of Xcode. Please follow the instructions in the README, ensuring that you have the necessary requirements.

OK,thank you very much.i understand


Migration of Docusaurus users to 1.3.0

Not a real task per se, using this to track the migration status of users to 1.3.0:

Docusaurus [merged]
React Native [merged]
Jest [merged]
Reason [merged]
Reason React [merged]
Prettier [merged]
Metro [merged]
Draft.js [merged]

Good news is that no major issue was found so far. The backward-incompatible CSS wasn't as much as I thought.
Other potential users to help migrate:

Babel
Sonar

@yangshun seems that no response for https://github.com/facebook/draft-js/pull/1797

I'll ping the maintainer tomorrow and at the same time update to a newer Docusaurus version.

All projects have been updated to >= Docusaurus 1.3.0. Closing this!


Position is not reset to the original one after the helpmate solution is played

When playing the solutions of helpmate with multiple solutions reset the position before playing another solution.

That's a great suggestion! Indeed right now the initial position can only be found in the "beginning" button, which is rather inconvenient. I've changed it to having the initial position before every solution (in the new * button). Please try it!
Note: you may need to refresh the page a few times to see the update.


Crash app on Android 10

Can you help me ? I cannot run this source on Android 10

Duplicate of #7.


ERROR:root:* MakeFrameDataset

Hi. I can't add custom string (try many other) to MakeFrameDataset Node
Log

WF

Work only in I write same path inside

The problem is in this code:
@classmethod
    def VALIDATE_INPUTS(self, file_path, update_on_frame_load):
        _, n_frames = self.get_frames(self, file_path, update_on_frame_load)
        if n_frames==0:
            return f"Found 0 frames in path {file_path}"

        return True

If you delete it - everything works.
file_path is always NONE within VALIDATE_INPUTS - Perhaps the problem is that this function does not have enough time to get the value from connected node.

if delete VALIDATE_INPUTS and add validation inside get_frames - it won't be as pretty, but it will work
def get_frames(self, file_path, update_on_frame_load):
        ds = FrameDataset(file_path, outdir_prefix='', videoframes_root=folder_paths.get_output_directory(),
                          update_on_getitem=update_on_frame_load)
        if len(ds) == 0:
            return f"Found 0 frames in path {file_path}"
        return (ds,len(ds))


Access to hosts AWS IAM instance profile

Is there a way for the VM to access the hosts AWS IAM instance profile?

You mean the http://<IP_ADDRESS>/ URL?
Does it work when accessing it from the host?

Yeah, that URL works on the host and aws sts get-caller-identity returns the correct role.  Is there a way for the VM's to access that on the host?

I think with bridged networking support introduced in #75 you can make the VM to use the same networking interface and access the standard AWS metadata server. Please let us know how it will go.

Running the VM in bridged mode results in the VM never receiving an IP.  I wouldn't think bridge mode would work in EC2?
tart run --net-bridged=en0 my-vm
tart ip my-vm

no IP address found

List also showed en3 but using that causes an error.
virtual machine's network attachment <VZNetworkDevice: 0x600002b19fb0> has been disconnected with error: Error Domain=VZErrorDomain Code=1 "Internal Network Error." UserInfo={NSLocalizedFailure=Internal Virtualization error., NSLocalizedFailureReason=Internal Network Error.}

You need to use tart ip --resolver=arp my-vm if you use bridged networking. GitLab Tart Executor will do it for you:
https://github.com/cirruslabs/gitlab-tart-executor/blob/4d29d8df04173f6bd3433a1e83ae936a4d3e1da2/internal/tart/vm.go#L239-L242

@fkorotkov Running tart ip --resolver=arp my-vm still gives the same error.  Using GitLab Tart Executor also gives the same error when setting TART_EXECUTOR_BRIDGED: en0 in the job.


viewing docs on non ts files causes a blank screen

We should only display the documentation button on supported formats.

Can be closed because doc.deno.land


Add ESpeak

Hi,
I wonder if you could help me to have a possibility of ESpeak also for home-assistant like PicoTTS. It has a lot of support for languages (https://espeak.sourceforge.net/languages.html).
I just stumbled on PicoTTS and copied the folder and replaced the executable with ESpeak...

I would ask you to start a own addon repository for this. 😉
As soon as it is included in my repository I need to maintain it, and that's something I won't do for functions I don't use to keep my effort low.
A own repository is easy to create and integrate into Home Assistant

I see. Thank you anyway.


provide conda package

First of all, many thanks for this great library!
Is there any chance to have the package included in conda-forge?

Publishing to conda-forge isn't something I've been interested in doing.


build error

I am in macOS Big Sur

CMake Error at cmake/toolchain_mac_x86_64.cmake:27 (message):
grub-file not found.
Use grub4mac.sh to install grub.
Call Stack (most recent call first):
/usr/local/Cellar/cmake/3.21.3_1/share/cmake/Modules/CMakeDetermineSystem.cmake:124 (include)
CMakeLists.txt:13 (project)

can you help me to fix this issue ??

hi NukeWilliams, you can install grub via /tools/grub4mac.sh
cd tools/
./grub4mac.sh

I will try it out @MRNIU


Pantheon 7 updates 2022-05-26

Description of changes
#170361
Things done

Built on platform(s)

[ ] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

[ ] For non-Linux: Is sandbox = true set in nix.conf? (See Nix manual)
[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[ ] Tested basic functionality of all binary files (usually in ./result/bin/)
22.05 Release Notes (or backporting 21.11 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module
[ ] (Release notes changes) Ran nixos/doc/manual/md-to-db.sh to update generated release notes

[x] Fits CONTRIBUTING.md.

pantheon.appcenter: 3.9.1 → 3.10.0

[ ] Fix AppStream.PoolFlags being renamed (#1794)
[ ] Expose screenshot captions (#1801)
[ ] Update io.elementary.appcenter.appdata.xml.in
[ ] Make back button behaviour more consistant (#1752)
[ ] Automatically install curated Flatpak updates (#1793)
[ ] AppInfoView: Warn about OS runtime mismatch (#1807)
[ ] Update io.elementary.appcenter.appdata.xml.in
[ ] Show try for free label  (#1820)
[ ] Client: Trigger auto-updates when opening the app (#1811)
[ ] AppInfoView: Set banner provider for context, not screen (#1692)
[ ] MainWindow: Reliably update on view change (#1831)
[ ] Client: auto update non-native apps
[ ] UpdateManager: notify for unpaid apps
[ ] Homepage: Only scroll carousel when banner is visible (#1836)
[ ] AppInfoView: new icon and copy for old runtimes (#1838)
[ ] Homepage: more accurate navigation (#1837)
[ ] Pull apt updates less frequently (#1790)
[ ] Add a manual refresh button to update all caches (#1791)
[ ] MainWindow: misc menu fixes (#1842)
[ ] AppListView: Don't sort native apps first in search (#1840)
[ ] Core: fix appstream deprecations (#1835)
[ ] AbstractAppContainer: Remove curated warning dialog (#1841)
[ ] Homepage: remove unuseed page_loaded (#1843)
[ ] Core: set AppStream.FormatStyle to COLLECTION (#1845)
[ ] Update io.elementary.appcenter.appdata.xml.in
[ ] HumbleButton: move show_stripe_dialog here (#1847)
[ ] CategoryView: load packages async (#1851)
[ ] AbstractAppContainer: Remove progress_grid (#1854)
[ ] PackageKitBackend: don't load Ubuntu components with AppStream 0.15 (#1852)
[ ] AppInfoView: move uninstall button here (#1855)
[ ] Release 3.10.0 (#1846) Tagged: 3.10.0

pantheon.elementary-dock:
(Just translations)
pantheon.elementary-onboarding: 6.1.0 → 7.0.0

[ ] l10n: Correctly setup the locales (#147)
[ ] Improve Code Style (#153)
[ ] MainWindow: Replace ButtonBox with Box (#158)
[ ] Make Expand and Margin Properties more Specific for GTK4 Porting (#156)
[ ] DesktopEntry: NotShowIn Installer → OnlyShowIn Pantheon (#155)
[ ] Switcher: Remove unused signal (#161)
[ ] Prep for GTK4: Replace add with attach for Grids (#160)
[ ] Port to GTK4 (#152)
[ ] Update carousel to latest LibAdwaita API (#165)
[ ] Update pot
[ ] Add Updates View (#167)
[ ] Update .pot
[ ] Update onboarding.appdata.xml.in
[ ] Actions: bump release to Horus
[ ] StyleView: handle NO_PREFERENCE in switch (#172)
[ ] Add Dark Schedule Preference (#170)
[ ] Update onboarding.appdata.xml.in
[ ] Update .pot
[ ] Meson: handy → adw (#169)
[ ] MainWindow: show all views when launching from Terminal (#173)
[ ] Release 7.0.0 (#168) Tagged: 7.0.0

@ofborg test pantheon

Result of nixpkgs-review pr 174714 run on x86_64-linux 1

11 packages built:

pantheon-tweaks
pantheon.appcenter
pantheon.elementary-dock
pantheon.elementary-files
pantheon.elementary-greeter
pantheon.elementary-gsettings-schemas
pantheon.elementary-onboarding
pantheon.switchboard-plug-pantheon-shell
pantheon.switchboard-with-plugs
pantheon.wingpanel-applications-menu
pantheon.wingpanel-with-indicators


[BUG] Default keybinds reset themselves, override custom keybinds on same keys

System and StepMania info
OS: Observed on Win10 and Linux
StepMania Version: v5.3.0-alpha.4.9.7GG, may also have been present on 4.9.7 but I no longer have it to confirm
Theme: Soundwaves
Describe the problem
When setting a custom keybind on a key that already has a default keybind, the default keybind reappears after restarting the game. Both the custom and default keybinds are listed on the Config Key/Joy Mappings screen, but only the default keybind has an effect and the custom keybind does nothing.
Example: Set the arrow keys to P2 instead of P1, save your key mappings to disk, then restart the game and check the key mappings. Keybinds for the arrow keys will be shown under both P1-default and P2-primary, and will only affect P1 instead of P2 as assigned.
Describe what should happen
Default keybinds should not take precedence over custom keybinds. I typically set P1 to WASD and P2 to the arrow keys, so this is a real pain.

Thanks for your report, but this bug was already identified and fixed a few days ago. There'll be a new release soon with this correction soon.

Good to know, sorry I missed that one.


Ensure compatibility with persistence 4

This is mostly about adding return type declarations. In one instance though, it is more than that: ClassMetadataFactory redeclares $cacheSalt, a protected property inherited from the persistence package. Since it is not possible to widen or narrow the type, and since the redeclaration seems to be about setting a default value, let us set it in the constructor.

LGTM, and I also don't see any changes that we'd want to announce as deprecations in 2.x 👍

There's still DocumentManager::merge and NOTIFY tracking policy on the hook


Have Arkana support SCREAMING_SNAKE_CASE env var names

Currently the only supported case is CamelCase due to how the mapping is done internally within Arkana. However, it's pretty standard to have SCREAMING_SNAKE_CASE being used as the capitalization rule for env vars (in any programming language that I know of). For this reason, we should either make screaming snake case an alternative and valid case, OR make it the only valid case, OR allow for custom mappings (e.g. a file that maps between the env var name and the actual env var identifier it should map to when generating the code in e.g. Swift, Kotlin, etc), for instance:
{
    "API_KEY": "apiKey",
    "AUTH_TOKEN_KEY": "authToken"
    …etc.
}

+1


Bugfix open newly created wallet

What current issue(s) does this address, or what feature is it adding?

Wallets created after the PeeWee updates have a MigrationState of b'1' instead of '1' as previously, which made it impossible to open a newly created wallet.

How did you solve this problem?

This change coerces the value to an integer and compares MigrationState to 1 so that both versions will work.

How did you make sure your solution works?

manual testing

Are there any special changes in the code that we should be aware of?

I would not be surprised if there are other similar bugs related to the wallet.

Please check the following, if applicable:

[ ] Did you add any tests?
[x] Did you run make lint?
[x] Did you run make test?
[x] Are you making a PR to a feature branch or development rather than master?
[x] Did you add an entry to CHANGELOG.rst? (if not, please do)

Coverage remained the same at 80.167% when pulling a905c85addf3f39e4bce854870cac2a7c563b8de on bugfix-open-newly-created-wallet into 634129697f0ea343196c4ae99ae8a9691e73f71f on development.

This is because of my peewee PR. I remember having a problem with this. I removed it after @ixje asked me about it here:
https://github.com/CityOfZion/neo-python/pull/524/commits/525b1066b5b0cd7328a9c1f79ffbdf3b57dc779a
https://github.com/CityOfZion/neo-python/pull/524#pullrequestreview-145369629

I am sorry if I introduced more issues 😢

No worries! I think better tests could have caught the issue earlier.  Mostly I just wanted to open my wallet 😆  .  I'll keep this PR open as I look for anything similar.

Okay. I tried to include some snippets of the change to help. Mostly, the code use to prefer to store everything as a string because peewee didn't mind and would decode or not as needed. With peewee3, they added BlobField and basically took away the original functionality of CharField and StringField.

@localhuman during testing I am seeing these notifications:
neo.api.JSONRPC.test_json_rpc_api.JsonRpcApiTestCase) ... Could not save stored data <Model: Key> instance matching query does not exist:
SQL: SELECT "t1"."Id", "t1"."Name", "t1"."Value" FROM "key" AS "t1" WHERE ("t1"."Name" = ?) LIMIT ? OFFSET ?
Params: ['PasswordHash', 1, 0]
Could not save stored data <Model: Key> instance matching query does not exist:
SQL: SELECT "t1"."Id", "t1"."Name", "t1"."Value" FROM "key" AS "t1" WHERE ("t1"."Name" = ?) LIMIT ? OFFSET ?
Params: ['IV', 1, 0]
Could not save stored data <Model: Key> instance matching query does not exist:
SQL: SELECT "t1"."Id", "t1"."Name", "t1"."Value" FROM "key" AS "t1" WHERE ("t1"."Name" = ?) LIMIT ? OFFSET ?
Params: ['MasterKey', 1, 0]
Could not save stored data <Model: Key> instance matching query does not exist:
SQL: SELECT "t1"."Id", "t1"."Name", "t1"."Value" FROM "key" AS "t1" WHERE ("t1"."Name" = ?) LIMIT ? OFFSET ?
Params: ['MigrationState', 1, 0]
Could not save stored data <Model: Key> instance matching query does not exist:
SQL: SELECT "t1"."Id", "t1"."Name", "t1"."Value" FROM "key" AS "t1" WHERE ("t1"."Name" = ?) LIMIT ? OFFSET ?
Params: ['Height', 1, 0]

I am wondering if this is another issue with peewee? Since the "Could not save stored data" announcement comes from
def SaveStoredData(self, key, value):
        k = None
        try:
            k = Key.get(Name=key)
            k.Value = value
            k.save()
        except Exception as e:
            print("Could not save stored data %s " % e)

What do you think?


fix: wrong snmp_exporter binary source path

This is a PR to fix #96
Not familiar with contributions and PR, please be indulgent

Hmm, I think there's more to fix than this.

Hmm, I think there's more to fix than this.

Do you mean, this error is present on other installations, or, there is more to fix for snmp_exporter install?
To fix the error during snmp_exporter install, the change is enough on my side.
Is it possible to write a molecule test to check this issue?

The problem is actually just that the dest from get_url is missing the trailing slash.
https://github.com/prometheus-community/ansible/blob/26d2f998573819faa150deaf8806175cd53e8a30/roles/snmp_exporter/tasks/install.yml#L2-L9
Should be either
  ansible.builtin.get_url:
    url: "{{ snmp_exporter_binary_url }}"
-    dest: "/tmp"
+    dest: "/tmp/"
    checksum: "sha256:{{ snmp_exporter_checksum }}"
    mode: 0644
  register: _download_binary

or to be consistent with the other roles:
  ansible.builtin.get_url:
    url: "{{ snmp_exporter_binary_url }}"
-    dest: "/tmp"
+    dest: "/tmp/snmp_exporter-{{ snmp_exporter_version }}.linux-{{ go_arch_map[ansible_architecture] | default(ansible_architecture) }}.tar.gz"
    checksum: "sha256:{{ snmp_exporter_checksum }}"
    mode: 0644
  register: _download_binary

This should be fixed by https://github.com/prometheus-community/ansible/pull/204.

Fixed in #204


Add VisualizationCallback for in-situ visualization

https://user-images.githubusercontent.com/3637659/102814821-8c86d200-43cb-11eb-87f2-b09d7406bf63.mp4
Open questions/issues:

[ ] How do we handle the dependency on the Plots package
[ ] Allow customization of plot styles, e.g., by passing a function that will receive the solution and semidiscretization and does itself call the plot routine
[ ] [optional] Optimize plotting performance

In general, I am currently reconsidering whether the decision to pull  the plotting functionality into the Trixi package was the right decision. Maybe instead of consolidating these auxiliary methods in the main package, we should consider creating a "postprocessing package" (TrixiPostprocessing?) that consolidates things such as the plot recipes, interpolation methods, plot methods, VTK writing etc.? But maybe this is something that does not to be (or even can be) answered right now but that we should get the functionality first and consider these structural decisions separately in a refactoring step.

In general, I am currently reconsidering whether the decision to pull the plotting functionality into the Trixi package was the right decision. Maybe instead of consolidating these auxiliary methods in the main package, we should consider creating a "postprocessing package" (TrixiPostprocessing?) that consolidates things such as the plot recipes, interpolation methods, plot methods, VTK writing etc.? But maybe this is something that does not to be (or even can be) answered right now but that we should get the functionality first and consider these structural decisions separately in a refactoring step.

The advantage of having the plot recipes in Trixi.jl is that users don't need to load another package just to be able to plot(sol) - implementing the plot recipes in another package would also be type piracy. Of course, the situation is different for things like additional callbacks, VTK stuff etc. Your suggestion to get the features first, mark them as experimental, and see where they should live after working with them sounds good to me.

Using Requires for now to handle the visualization callback here is fine for me. I wouldn't like to make Plots.jl a hard dependency of Trixi.jl.
Other than that, this could also be considered as "nice to have but not necessary". Hence, it's okay to make some compromise between versatility and efficiency, I think.

Figures for the documentation:

I don't understand why the tests currently fail for 2D and misc. There seems to be an issue with the visualization callback causing warnings (e.g., here, here or here), although I don't understand why: AFAICT, there are no warnings :man_shrugging:, at least not printed to stdout/stderr :-/

The warnings may be related to deprecations in HDF5, see https://github.com/trixi-framework/Trixi.jl/pull/403/checks?check_run_id=1619055468#step:6:1792. I think Plots.jl might just need to make a new release, see https://github.com/JuliaPlots/Plots.jl/pull/3175#issuecomment-751992260.

It looks like the deprecation warnings aren't the cause for our trouble. Instead, it's this part
/home/runner/.julia/packages/GR/RlE5Y/src/../deps/gr/bin/gksqt: error while loading shared libraries: libQt5Widgets.so.5: cannot open shared object file: No such file or directory
connect: Connection refused
GKS: can't connect to GKS socket application

GKS: Open failed in routine OPEN_WS
GKS: GKS not in proper state. GKS must be either in the state WSOP or WSAC in routine ACTIVATE_WS
GKS: GKS not in proper state. GKS must be either in the state WSAC or SGOP in routine FILLAREA
[...]

found at https://github.com/trixi-framework/Trixi.jl/pull/403/checks?check_run_id=1621341375#step:6:2117.

@ranocha: Thank you very much for the fast reviews!

How would you like to handle your open questions listed in the first post?

I've added them to #397 or created a new issue (#406).

For reference and archival purposes, the video from the documentation on YouTube as the original mp4 file and converted to a gif:
https://user-images.githubusercontent.com/3637659/103352227-f1b28580-4aa5-11eb-896b-8752e28d203c.mp4


Is this project dead?

Looks like a nice attempt that was nearing success, but incomplete (piece detection, error correction...)
I don't think I have the skillset to quickly finish it.
Any chance it will proceed or do you know of anyone else working on it?

Hey! Thank you for the interest in this project.
In the past I started working on the piece detection part and what I did was to run the script against a large set of chess book pages and extract all the tiles. It worked relatively well but I stopped there.
My idea was to use ML to first distinguish empty tiles from piece tiles. After that I would move on to detect the piece type.
To that end I thought of using clustering algorithms to try to group the extracted tiles onto several groups. If the generated groups were accurate I would use them as a training set to some classifier algorithm. If the groups were not reliable, I would have to resort to manually create the groups.
Also, I think it would be useful to separate piece detection from color detection, i.e., normalize the piece color so white and black pieces would look alike and use some other way of detecting piece color.
As for error correction, I thought of using a chess game database to help breaking ties in the case some piece classification has several candidates with similar scores
Unfortunately, for the time being, I don't have the time to work in this project but I would be glad if someone else would be willing to contribute.

That's too bad, and it would make a good 1st project (for me) if I had the time.
I'm surprised that no one seems to have done this.  There are several working versions for Android.
It's only a little tedious to dig out my phone and take a picture of the screen then send the FEN to my PC (I usually transfer through Discord as a messaging app from Phone to PC.)
I use ChessVision.ai (free, and it's basically VERY LOW key advertisement to sell their web service for doing entire books) and apparently it has a recognize from local images but that would involve making a screen shot or otherwise exporting the pictures when reading a book which seem even more tedious on Anroid than a PC.
Mostly I read on my pad (or PC) and use my phone to take pictures and analyze book positions or send to PC.
It works; it's not perfect; and I supposed I could buy the web service if I wanted to entire books at once -- it's not expensive IIRC


Add index type for TypeScript

This adds an Index type to properly work in Typescript to find an element by the Country Code string.
Issue with the typescript compiler without it:
Type error: Element implicitly has an 'any' type because expression of type 'string' can't be used to index type '{ readonly AD: "EUR"; readonly AE: "AED"; readonly AF: "AFN"; readonly AG: "XCD"; readonly AI: "XCD"; readonly AL: "ALL"; readonly AM: "AMD"; readonly AN: "ANG"; readonly AO: "AOA"; readonly AQ: "USD"; ... 239 more ...; readonly ZW: "ZWL"; }'.
  No index signature with a parameter of type 'string' was found on type '{ readonly AD: "EUR"; readonly AE: "AED"; readonly AF: "AFN"; readonly AG: "XCD"; readonly AI: "XCD"; readonly AL: "ALL"; readonly AM: "AMD"; readonly AN: "ANG"; readonly AO: "AOA"; readonly AQ: "USD"; ... 239 more ...; readonly ZW: "ZWL"; }'.

Hello, @u2ix. Which TypeScript version are you using?
This library requires TypeScript 3.4+ in order to use the currently generated types.
You contribution would make the types Countries and Currencies to be unchecked strings.

I’m using
"typescript": "^5.5.3"
On Thu, Jul 11, 2024 at 11:04, Thiago Delgado Pinto @.***(mailto:On Thu, Jul 11, 2024 at 11:04, Thiago Delgado Pinto < wrote:

Hello, @.***(https://github.com/u2ix). Which TypeScript version are you using?
This library requires TypeScript 3.4+ in order to use the currently generated types.
You contribution would make the types Countries and Currencies to be unchecked strings.
—
Reply to this email directly, view it on GitHub, or unsubscribe.
You are receiving this because you were mentioned.Message ID: @.***>

Well, I'm not getting the errors that you mentioned:

Interesting, possibly it was due to that the input was just type string due to user input so it usually needs the index type on a map. But if no one else has this issue, I guess we can close it, since I figured I don't need to add this library after all to my project.

@u2ix Thank you for your support and the PR. Surely we can open this Issue later.


Xcode 14 - SwiftUI warning

If you try to run the sample app on Xcode 14 beta 5 you get the following warnings.

+1
At the same time our logs are spammed with
[SwiftUI] Publishing changes from within view updates is not allowed, this will cause undefined behavior.

Also seeing this - this is a genuine bug within the library because it is triggering a method from within the view body that has side effects, one of which is mutating some published state:
Specifically, WebImage does this:
    public var body: some View {
        // This solve the case when WebImage created with new URL, but `onAppear` not been called, for example, some transaction indeterminate state, SwiftUI :)
        if imageManager.isFirstLoad {
            imageManager.load()
        }
        ...snip...
    }

I have no context as to why this change was added but it is fundamentally wrong. Side effects should not be performed from within a SwiftUI's view body - this body method can potentially called many times (every time the view's state changes). In this case, calling .load() not only triggers a side effect, but it causes the @Published isLoading to be mutated in the middle of the view update cycle.

+1

also having the same issue, with the bug affecting my navigationStack and moves me back to previous page, needs a fix asap, at least a workaround for now...

I noticed that the picture flickered a bit in iOS16 beta 5
🥲

I encountered a similar message in my environment.

+1

Any chance this gets fixed before iOS 16's release?

Hi.
This current repo's code, need a refactory to make it works with latest SwiftUI. And drop the usage of that ObservedObject using StateObject.
If someone has expert coding experience, PR is welcomed.
Currently I'm working on LLVM/Swift toolchain in this year, so may not have enough time to maintain this changes. But I'll try to back to this repo once I have some extra time.

+1

Following @lukeredpath's hint, I made some changes that seem to fix things on iOS 16.
https://github.com/SDWebImage/SDWebImageSwiftUI/compare/master...garrettrayj:ios16-undefined-behavior
I haven't tested AppKit and I bet backwards compatibility is messed up, but the changes appear mainly to be removing old workarounds that are no longer needed. Story of my life with SwiftUI, so I'm feeling confident enough to roll with 'em for the sake of getting iOS 16 updates out the door.

If you don't need backwards compatibility another option would be to see if the built in AsyncImage does what you need and have one less third party dependency in your codebase. That's my plan.

@garrettrayj - Great work - Will you make a PR? Then it can be reviewed.

I had the same error with iOS16 RC version.

This warning appears with the latest SwiftUI update but the issue impacts all SwiftUI versions. For instance, I have observed that screens that have a SDWebImage as first element are not correctly rendered in a navigation animation (i.e. when they swipe in from right to left).

Please have a try with v2.1.0

Seems to work perfectly now. Thank you!!


RD-8917-prevent-secret-leaks

:tada: This PR is included in version 1.9.0 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release

Your semantic-release bot :package::rocket:


Follow redirects in client

Feature Request
Motivation
I just ran into an issue where a client was configured to use http:// which would result in the server sending a 308 redirect to https:// instead. The client didn't understand that though and returned an error.
Proposal
Would be cool if there was an option to make the client follow redirects 😊
Alternatives
I tried solving it wrapping my client in a tower service that would follow redirects by looking for 308 responses, change the request URI to match the Location header, and call the inner service again. However that isn't possible since Request<BoxBody> isn't Clone so you cannot send the request more than once.

This sounds like something hyper is doing in its connector?

This sounds like something hyper is doing in its connector?

Oh yeah I didn't consider hyper. I'll look into what they have.

Oh yeah I didn't consider hyper. I'll look into what they have.


Change in the Wording

The wording in the Home page has to be changed.
Existing text :
Sustainable Education Foundation (SEF) is a volunteer driven organisation founded by the former Google Student Ambassador and an alumni of University of Moratuwa.
Akshika Wijesundara. SEF was founded with the short term goal of making the Sri Lankan education system the most effective and the most dynamic education system in the world. SEF’s long term goal is to disrupt and democratise the global education system where it is available for everyone, in doing so, foundation contributes to the United Nations’ sustainable development goal of “Quality Education”.
It should change to:
Sustainable Education Foundation (SEF) is a volunteer driven organisation founded by the former Google Student Ambassador and an alumni of University of Moratuwa Akshika Wijesundara.
SEF was founded with the short term goal of making the Sri Lankan education system the most effective and the most dynamic education system in the world. SEF’s long term goal is to disrupt and democratise the global education system where it is available for everyone, in doing so, foundation contributes to the United Nations’ sustainable development goal of “Quality Education”.

https://github.com/SustainableEducationFoundation/LiveWeb/pull/92 Please someone review the pull request.


Way to test this library?

How do I test this library? In Xcode, I can simulate location events only when the app is currently running. It doesn't let me simulate the device's location after the app has been killed. Is there a way to see if this geofencing works after the app has been killed?
Same question for Android too.

I do manual testing or I use GPS mocking apps for Android. I'm not too sure how to test this in an automated way though.


WIP: reentrancy guard

Overview
Introduces an ERC20 equivalent to solmate's ERC20.

[ ] test
[ ] test if there are any gas-saving if lock value is set to 1 in constructor
[ ] test when it is better to jump, the revert case or the non-reverting case
[ ] comments

created a new branch for it.


[BUG] No Workbooks found in xls Buffer

🐛 Bug Report
When I read the attached xls file, I get an empty list of worksheets. The code works well with data read from xlsx files.
Lib version: ^4.3.0
Steps To Reproduce

import * as Excel from 'exceljs'

var reader = new FileReader();
 reader.onload = e => {
  dataBuffer = e.target.result;
   console.log('dataString Bytes', dataBuffer.length)
    this.handleData(dataBuffer);
};
reader.readAsArrayBuffer(f);

handleData(dataBuffer) {
  const workbook = new Excel.Workbook();
  workbook.xlsx.load(dataBuffer).then(() => {
   console.log('loaded',workbook.worksheets.length,'worksheets')
}

This prints on the console the number of bytes of the buffer and reports 0 found worksheets. No other error is flagged.
The expected behaviour:

The reported number of worksheets should be 1.
Possible solution (optional, but very helpful):
File to be read in:
TestdatenOpal.xls

@ingodahn exceljs does not support reading excel files with xls suffix, change xlsx this library it

Thanks for the info.

@ingodahn Since it seems that exceljs is no longer releasing new versions, you can pay attention to this project. @zurmokeeper/exceljs


Timezone issue while loading data to oracle

Hi,
The date time  is entered in  Eastern Standard time from UI but the data is getting loaded in S3 buckets in epoch time. So when it comes to oracle by the CDA open source reader, oracle treats the epoch time as UTC and convert it back to EST and we are getting a different time in the oracle which is 4-5 hrs behind the actual time.
For example : UI shows : 06/13/2022 10:00 AM   (EST)
Data in Oracle : 13-JUN-22 <IP_ADDRESS>000000 AM
Has anyone  experienced the same issue and how have you handled the same? can some one suggest any idea to overcome this problem?
Your help is appreciated

We ran into a similar issue in our cloud implementation. We have decided to fix CDA client code to replace the incorrect UTC timezone and replace it with the correct timezone.


Description not rendering properly

I have a project with a README.rst that renders properly at https://pypi.python.org/pypi/stix2 but not at https://pypi.org/project/stix2/ - the RST doesn't seem to be parsed. If I import readme_renderer and call render() on the .rst content, the output contains all the HTML tags I expected it to. Any idea why it's not rendering properly with warehouse?
Link to the readme file: https://github.com/oasis-open/cti-python-stix2/blob/master/README.rst
cc: @gtback

Hi @clenk, thanks for reporting this. The issue seems to be that your README was broken in a previous release, and the cache for this page did not get purged when the release is made.
I ran curl -XPURGE https://pypi.org/project/stix2/ and https://pypi.org/project/stix2/ now renders correctly.
I also created https://github.com/pypa/warehouse/issues/2582 to capture the underlying issue.


[stable/redis] Can't open the append-only file: Permission denied

Is this a request for help?:
Yes
Is this a BUG REPORT or FEATURE REQUEST? (choose one):
BUG REPORT
Version of Helm and Kubernetes:
Helm:
Client: &version.Version{SemVer:"v2.8.2", GitCommit:"a80231648a1473929271764b920a8e346f6de844", GitTreeState:"clean"}
Server: &version.Version{SemVer:"v2.8.2", GitCommit:"a80231648a1473929271764b920a8e346f6de844", GitTreeState:"clean"}
Kubernetes:
Client Version: version.Info{Major:"1", Minor:"8", GitVersion:"v1.8.4", GitCommit:"9befc2b8928a9426501d3bf62f72849d5cbcd5a3", GitTreeState:"clean", BuildDate:"2017-11-20T05:28:34Z", GoVersion:"go1.8.3", Compiler:"gc", Platform:"darwin/amd64"}
Server Version: version.Info{Major:"1", Minor:"8", GitVersion:"v1.8.0", GitCommit:"0b9efaeb34a2fc51ff8e4d34ad9bc6375459c4a4", GitTreeState:"clean", BuildDate:"2017-11-29T22:43:34Z", GoVersion:"go1.9.1", Compiler:"gc", Platform:"linux/amd64"}
Minikube:
minikube version: v0.24.1
Which chart:
stable/redis
What happened:
Redis is not running.
dev-redis-master-0                 0/1       CrashLoopBackOff
dev-redis-slave-85b676ddc7-64j9d   0/1       CrashLoopBackOff
Master logs:
WARN  ==> You set the environment variable ALLOW_EMPTY_PASSWORD=yes. For safety reasons, do not use this flag in a production environment.
nami    INFO  Initializing redis
redis   INFO  ==> Validating inputs...
redis   WARN  Allowing the "password" input to be empty
redis   INFO  ==> Disabling commands...
redis   INFO  ==> Disabled commands: FLUSHDB, FLUSHALL
redis   INFO  ==> Configuring replication settings...
redis   INFO  ==> Setting up Redis master...
redis   INFO
redis   INFO  ########################################################################
redis   INFO   Installation parameters for redis:
redis   INFO     Password: Not set during installation
redis   INFO     Replication Mode: master
redis   INFO   (Passwords are not shown for security reasons)
redis   INFO  ########################################################################
redis   INFO
nami    INFO  redis successfully initialized
INFO  ==> Starting redis...
28:C 15 Apr 11:31:21.240 # oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo
28:C 15 Apr 11:31:21.240 # Redis version=4.0.9, bits=64, commit=00000000, modified=0, pid=28, just started
28:C 15 Apr 11:31:21.240 # Configuration loaded
28:M 15 Apr 11:31:21.241 # Can't open the append-only file: Permission denied
Slave logs:
WARN  ==> You set the environment variable ALLOW_EMPTY_PASSWORD=yes. For safety reasons, do not use this flag in a production environment.
nami    INFO  Initializing redis
redis   INFO  ==> Validating inputs...
redis   WARN  Allowing the "password" input to be empty
redis   WARN  Allowing the "masterPassword" input to be empty
redis   INFO  ==> Disabling commands...
redis   INFO  ==> Disabled commands: FLUSHDB, FLUSHALL
redis   INFO  ==> Configuring replication settings...
redis   INFO  ==> Checking if master is ready to accept connection...
Error executing 'postInstallation': Failed to connect to dev-redis-master:6379 after 36 tries
How to reproduce it (as minimally and precisely as possible):
helm --kube-context test install --tiller-namespace dev --namespace dev --name dev --set usePassword=false stable/redis

Anything new here?

@guytish It doesn't look like you're changing the securityContext.enabled property. But when I run it with it as false, i get the error you describe. When I run it with the default, it works.
However, running it with them enabled prevents istio from working with it...

I have the same issue with sentry chart. but it doesn't have the master.securityContext.enabled value

Same problem with @ahmadalli

@Eloahman I've resolved the issue by adding these values:
redis.master.securityContext.enabled=true
redis.master.securityContext.runAsUser=0
redis.master.securityContext.fsGroup=2000

Why I still have this issue lately?

In case you are running this on local machine, like me, make sure docker has access to the drives under Resources > File sharing.

My issue was resolved after enabling the access.

Why I still have this issue lately?
�[0m�[38;5;2mINFO �[0m ==> ** Starting Redis **
1:C 05 Aug 2019 04:15:23.187 # oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo
1:C 05 Aug 2019 04:15:23.187 # Redis version=5.0.5, bits=64, commit=00000000, modified=0, pid=1, just started
1:C 05 Aug 2019 04:15:23.187 # Configuration loaded
1:M 05 Aug 2019 04:15:23.187 # Can't open the append-only file: Permission denied

Did you solve this issues ?

I have the same issue like you @afsalcodehack .

try to install redis with release name
helm install --name my-release stable/redis

Thanks for the advice @afsalcodehack . I've already used that command, the problem is another. I've tried to install redis  on a Kubernetes cluster with three nodes remotly. The first time when you install redis not start like a root service. I've resolved launching the followiing command on the nodes sudo chown -R 1001:1001 /redisPvFolder. I don't understand why but worked for me. This is the source https://stackoverflow.com/questions/55201167/redis-service-fails-with-permission-denied-on-append-file.

@LiviuCornel where i execute this command in windows sudo chown -R 1001:1001 /redisPvFolder

@afsalcodehack  I ran the command for each folder corresponding to the persistence volumes present on the physical nodes. Later I simply restarted redis. For example if we create a persistent volume for a master node in the definition of the kind we specify the entry hostPath:
path: "/ mnt / data / redis-master-0", then just access the machine or machines that make up the cluster and run the command sudo chown -R 1001: 1001 / mnt / data / redis-master-0

You have a virtual machine like minikube with docker tool box ?

yes im using minikube

@afsalcodehack
You can try launching a shell inside the redis pod, accessing the desired path and launching the command there

@LiviuCornel  Thank you

Why I still have this issue lately?
�[0m�[38;5;2mINFO �[0m ==> ** Starting Redis **
1:C 05 Aug 2019 04:15:23.187 # oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo
1:C 05 Aug 2019 04:15:23.187 # Redis version=5.0.5, bits=64, commit=00000000, modified=0, pid=1, just started
1:C 05 Aug 2019 04:15:23.187 # Configuration loaded
1:M 05 Aug 2019 04:15:23.187 # Can't open the append-only file: Permission denied

Did you solve this issues ?

I switched rom minikube to docker-desktop kubernetes.

The fundamental problem is that when redis starts, for the containerization, by default it starts with the user 1001 that does not have access to the file system. Therefore with the chown command you can assign a folder of the file system to a user. By executing the command sudo chown -R 1001: 1001 / path, access to that foder is enabled.


abstract filesystem calls

I think the file system calls in Vault should be abstracted into an interface so the vault could be stored in other locations and someone could leverage packages like flysystem.
Of course default it with the file system for ease of use.
namespace starekrow\lockbox;

interface FileSystemInterface {
    /**
     * gets the content of a file
     * @param string $file
     * @return string
     */
    public function get($file);

    /**
     * puts content into a file
     * @param string $file
     * @param string $content
     * @return bool if it was successful
     */
    public function put($file, $content);

    /**
     * checks if the file exists
     * @param string $file
     * @return bool if it exists
     */
    public function has($file);
}

namespace starekrow\lockbox;

class LocalFileSystem implements FileSystemInterface {
    /**
     * @inheritdoc
     */
    public function get($file)
    {
        return @file_get_contents($file);
    }

    /**
     * @inheritdoc
     */
    public function put($file, $content)
    {
        return @file_put_contents($file, $content);
    }

    /**
     * @inheritdoc
     */
    public function has($file)
    {
        return file_exists($file);
    }
}

Interesting; I’d be happy to see a PR along these lines. FYI, the main considerations that went into the design of the CryptoCore:

Semantic ease of use: Being able to call Crypto::hash(...) without any preliminaries is important.
see #1

Upon reflection, feel free to ignore that comment. It made a lot of sense for Crypto to be set up as an accessible, independent component that was self-configuring. OTOH, the FileSystemInterface could easily be managed by and/or through the Vault class, so adding a bit of required boilerplate to use it is really a non-issue.
I assume you were thinking along the lines of adding a $filesys argument to the constructor that, if left null, would default to LocalFileSystem (or perhaps inspect the given path for "http:" etc).


History chart improvements

Always show chart toolbar
Chart toolbar icons are made bigger
New chart hover tooltip layout

Rebase https://github.com/wirenboard/homeui/pull/199


CRIMAP-124 Add datalist for the non-JS offences dropdown

Description of change
Individual commits for more context.
This datalist is populated from the CSV, and offences are assigned to the Charge as value-objects making use of composed_of where we find the most suitable offence by name and return it if found, otherwise we assume the offence is being "created" by the provider, in which case we will not have an #offence (returns nil) and thus we lack additional attributes like offence class and type.
Add basic presence validation on the offence_name attribute.
Update the ChargePresenter as almost everything is now retrieved from the offence instance (or returns nil for manual offences).
In follow-up PRs we will add some javascript to be able to style the dropdown and to perform better in terms of accessibility. This is the non-JS version.
Link to relevant ticket
https://dsdmoj.atlassian.net/browse/CRIMAP-124
https://dsdmoj.atlassian.net/browse/CRIMAP-73
Notes for reviewer
I've only added the presence validation on the offence_name attribute. There will be additional validation on the dates but that is part of another ticket.
Some copy is still TBD, for example the hint text in the input should be more explicit about the dropdown etc.
Screenshots of changes (if applicable)

How to manually test the feature
Go to the charges page, and enter a few letters on the offence name input, you should see a dropdown with offences that contain those letters. You can either select one, or keep typing and "create" your own offence.
If you select an offence from the list, it will have a designated class on the summary page. For manually entered offences, these will not have class.

NOTE: in my tests, I've seen some inconsistencies across browsers. It seems most of them like to show 4 options before having to scroll, except Safari that for some reason reduces it to 3 options shown.
There are also some differences in styling depending on the browser, being Edge the better looking of all, IMO.
However, there is a breaking thing with the Class XYZ we add to the datalist.
It seems to work in all desktop browsers I've tried except in Firefox. More testing is required in mobile devices.
So far: Edge, Brave, Chrome, Safari and Opera all show the "Class" usually in a different text colour and below the offence name which is very nice. This class however is only a visual hint and is not submitted in the request to the server nor used in the input text (only the option value is used in the input text, at least with non-JS).
Firefox only shows the class, behaving completely differently to the rest of browsers. For this reason if we want to consider this a cross-browser solution we will need to either remove the class in the non-JS version (this will not be a problem for the JS-styled version tho), or remove it only for those browsers that don't show it properly. Some investigation on how best to do this might be needed, but for now I've leave the class in this PR, and will get back to it probably after the javascript implementation.
Example on Edge:

Example on Opera:

Example on Chrome:

Example on Brave:

Example on Safari:

Example on Firefox
How it looks on Firefox (it only shows the Class, and only searches in the Class):


Displacement boundary conditions on linear elastic model (ex2)

Hello Developers,
First of all, thank you very much for creating such an efficient FEA library.
I am facing difficulties while applying displacement boundary condition on required faces/nodes.
(Displacement BC means, initially assigning some fixed non-zero values for Ux or Uy).
Currently, I am trying to use ex2 (linear elastic model). I have directly tried to impose some values to the GridFunction 'x' to give initial displacement before PCG solver step, but it doesn't give correct results. I want to use H1- nodal elements that is why I chose ex2 over ex17.
Later, I also tried using ex17 (linear elastic - discontinuous Galerkin) to understand the process of implementation of different Dirichlet boundary condition which ex17 has implemented using InitialDisplacement function. But still I did not get clear, how you have implemented displacement BC and how can we used same technique for H1-nodal elements (for example, how can we use it in ex2)?
Thus, my main question is how can we apply the displacement boundary condition in ex2 (linear elastic model)?
Just to give you an idea about my work, I am creating Topology Optimization pipeline and in that I need to implement two types of Dirichlet BC's - i) fixed BC on one side and ii) displacement BC on the other side to perform compression, tension and shear.
I am very much thankful to your help.
Best Regards,
Raj

Hello, @rajpradi ,
It sounds like ex2 was the correct choice.  Applying Dirichlet BCs in this problem involves two pieces of information. First you need the boundary values themselves and it sounds like you have this piece.  The second piece is the portion of the boundary on which to apply those values.  Perhaps this second piece is missing.  In example 2, this piece is defined in the following lines:
   Array<int> ess_tdof_list, ess_bdr(mesh->bdr_attributes.Max());
   ess_bdr = 0;
   ess_bdr[0] = 1;
   fespace->GetEssentialTrueDofs(ess_bdr, ess_tdof_list);

These lines activate the Dirichlet BC only on the boundary elements with attribute number equal to '1'.  The opposite end of the mesh in that example happens to have attribute number '2' so you would need to add ess_bdr[1]=1; to activate the other end (note that attribute numbers are 1-based but the indices into ess_bdr are 0-based so you need to use ess_bdr[attr-1]=1; to activate boundary elements with attribute number attr.)
Best wishes,
Mark

Hello Mark,
Thank you very much for your prompt response. Now I got clear how to assign/add the portion of the of the boundary on which I will apply displacement boundary conditions.
Sorry to disturb you once again, but I am not clear how can we add boundary values to it. For example, if I want to add any non-zero initial displacement (Dirichlet BC) to the faces of boundary elements with attribute '2', where should I add/give non-zero initial displacement value? Do I need to create separate vector and linked it with ess_tdof_list/GridFunction 'x'?
Once again thank you for taking your time.
Kind Regards,
Raj

The boundary values are specified by the (ess_tdof_list) values of the grid function x in the call to FormLinearSystem.

Hi, @rajpradi ,
To expand on what @tzanio said, putting values into the GridFunction is done by creating a VectorCoefficient which reproduces the desired boundary values and projecting this onto x using x.ProjectBdrCoefficient.  You can find an example of this in ex21.  You can use a sequence of VectorConstantCoefficients on different portions of the boundary or you can write a single position dependent VectorFunctionCoefficient and apply it only once on the entire boundary.  Either choice should work fine.
Best wishes,
Mark

Thank you very much @tzanio and @mlstowell for your detailed explanation. I was able to implement the displacement boundary condition expectedly.
Kind Regards,
Raj

Hi Sir,
I am Sorry to bother you again.
Can you please tell me how can we apply displacement boundary condition (initial displacement) on a particular node instead of face boundary?
I want this to use in Topology Optimization code. Earlier, I asked you about displacement boundary condition on faces, but from that I could not figure it out out how can I implement on nodes.
I have tried with previously suggested technique, but it's giving me segmentation fault when I use x.ProjectCoefficient. Can you please suggest me where I am making mistake?
ess_tdof_list.Append(NodeNumber);
Array nodeDispX(int (1));
nodeDispX[0] = NodeNumber;
disp_X_value[0] = 0.5; // Assigned values for disp. BC. in X direction.
VectorConstantCoefficient disp_X_value_coeff(disp_X_value);
x.ProjectCoefficient(disp_X_value_coeff,nodeDispX);
Thank you vary much for your time.
Sincerely,
Raj Khawale.

This project method requires that you first call FiniteElementSpace::BuildDofToArrays() for the finite element space in x.

Thank you very much Sir. It's working well.
Sincerely,
Raj


Added gmtime(), tests and struct_time class in time.java

I implemented gmtime() and the struct_time class to store/format the tuple that gmtime() returns. I also added some tests for gmtime().

Hi there! It looks like this PR might be dead, so we're closing it for now. Feel free to re-open it if you'd like to continue, or think about directing your efforts to https://github.com/beeware/briefcase or https://github.com/beeware/toga. Both of these have more active development right now. 😄


indicate grouped windows with tabs when no_gaps_when_only is on

Window groups in hyprland have tabs, but when no_gaps_when_only is enabled they're turned off along with regular window borders, so there is no indication a window is a group when this setting is on. I think the tab lines at the top of window groups should remain visible with this setting on

This is also related to #520

I'm not sure it is? While it was mentioned in the comments of that issue, I think it's a separate feature, that's specific to the text being included and I'm referring to just the border being hidden with or without text

also implemented now @vaxerski


PO/TL changed for existing product onboarding check

When PO/TL is changed for already existing product that user's onboarding status is not checked
Rational/Why
An admin could be mislead with a new PO/TL onboarding status
Definition of done/Acceptance Criteria

onboarded status is checked for PO/TL who was added to an already existing product

let's re-iterate it with the onboarding process to make the onboarding checks for product team members efficient.


pull in IDP projections and update projections when the players are refreshed in the background

Fix for bug https://github.com/nmelhado/league-page/issues/57

Still exceeding the size limit


CDS and Model-Driven Apps Naming Conventions

Article suggestion
After a quick survey of the Power Community on Twitter, there don't seem to be any written standard for naming and other conventions around CDS and model-driven apps. Having some sort of guidelines for the community would be useful to ensure higher quality solutions.

Initial article stub: CDS and Model-Driven Apps Standards and Naming Conventions

Hi Marc, I have a page, i'm working on for naming for SharePoint elements, just wondering if a glossary like page to consolidate, then other folks can add their tech/suggestions in. Depends on how much is written per area I guess. What do you think?
Ref #19

@pkbullock - I think the better practices for SharePoint are probably a bit different than for CDS, but since I can't find anything specific, I'm not sure! Let's keep the two ideas separate for now; we can merge later if it seems like it makes sense.


convert fluxtoscp - Invalid rpm or tracklen

I have a flux file from an ADFS 800K disk, created as follows:
fluxengine read adfs -s :d=0 -o victorian-d1-hd.img --write-flux=victorial-d1-hd.flux --hd
This resulted in an img file that works correctly.
I need to use the flux data to ultimately produce an APD file (for use in ADFFS in RiscOS). My method to do this unfortunately involves several (potentially lossy!) conversions. The first is to use fluxengine to write an SCP file:
fluxengine.exe convert fluxtoscp victorian-d1-hd.flux victorian-d1-hd.scp

Writing 96 tpi double sided SCP file containing 160 SCP tracks
FE track 0.0, SCP track 0: 195.395 ms in 94524 bytes
FE track 0.1, SCP track 1: 195.755 ms in 85438 bytes
...
FE track 79.1, SCP track 159: 196.294 ms in 74558 bytes
Writing output file...

My next step is then to convert the SCP file to Kryoflux *.raw format using HxCFloppyEmulator.  However, when loading the SCP file, HxCFloppyEmulator complains about invalid data in the SCP file:

WARNING: Non-conventionnal index perdiod ! (39 ms)
ERROR  : Invalid rpm or tracklen (1571 RPM, 3818887)...
ERROR  : Invalid rpm or tracklen (4608 RPM, 750)...
ERROR  : Invalid rpm or tracklen (4608 RPM, 750)...
ERROR  : Invalid rpm or tracklen (4608 RPM, 750)...
ERROR  : Invalid rpm or tracklen (4608 RPM, 750)...

This is repeated for each track, ultimately completing with:

INFO 1 : track file successfully loaded and encoded!?

HxCFloppyEmulator does output the raw files, however they seem to be garbage (various tools fail to process them).
Are the warnings & errors to be expected when loading an SCP file output by fluxengine? I'm trying to determine if the problem I'm facing lies with the SCP file produced by fluxengine, or the Kryoflux RAW files produced by HxCFloppyEmulator.

Should have said, I'm using Windows client version 186.

I haven't had the chance to test the scp generator other than round-tripping it back through fluxengine, so I'm not particularly surprised the files are invalid. That said, they look much more invalid than I was really expecting (scptoflux can read third-party SCP files, so if it can read fluxtoscp's SCP files I don't expect them to be that wrong). OTOH there are problems with converting fluxengine to SCP due to semantic mismatches in the data format, so perhaps that's causing issues.
Sadly my time to investigate this will be limited until December due to other commitments, but if you're up to looking at it yourself, the conversion code's all in src/fe-fluxtoscp.cc.
What was the HxC tool you were using to convert SCP to Kryoflux?

Sadly my time to investigate this will be limited until December due to other commitments, but if you're up to looking at it yourself, the conversion code's all in src/fe-fluxtoscp.cc.

Thanks for even replying, really appreciated.

What was the HxC tool you were using to convert SCP to Kryoflux?

http://hxc2001.free.fr/floppy_drive_emulator/
Download link:
https://hxc2001.com/download/floppy_drive_emulator/HxCFloppyEmulator_soft.zip

I mean, what specific tool? I wasn't aware HxC had utilities that did this. (All I can find inside the zipfile is a pile of Windows GUI binaries.)

Inside the zip file I linked there's a "Windows" directory containing "HxCFloppyEmulator.exe".
Launching this allows you to open various different formats of source image (.e.g SCP/Kryoflux etc). To do this you use the "Load" button. Before loading, you can enable logging by using the Log option (Log -> Log, click "Info/Warning/Error" and "Debug") to get better visibility of what's going on.
Once loaded, you can use the "Track Analyzer" to visualise what's going on. You can also "Export" to convert to any number of formats by clicking the "Export" button. In my case, I'm selecting "KF Stream file (*.raw)", using the file name "track" and clicking "Save".
Of course, this would be needless of fluxengine could write KryoFlux files natively :)

Ugh, I was hoping for a command line tool and not a GUI --- they're so much harder to script...
KryoFlux export's a possibility, but the format's amazingly annoying to work with. Hopefully I'll be able to get back to this in December.

I believe this should be fixed now in the latest version; or at least, it should be better. If you're still working on this, PTAL?

Ugh, I was hoping for a command line tool and not a GUI --- they're so much harder to script...
KryoFlux export's a possibility, but the format's amazingly annoying to work with. Hopefully I'll be able to get back to this in December.

FYI The HxC Floppy Emulator tool is of course available in command line too :
https://hxc2001.com/download/floppy_drive_emulator/HxCFloppyEmulator_soft_beta.zip
This is the "hxcfe.exe" program, which is a pure command line version.
source available there :
https://sourceforge.net/p/hxcfloppyemu/code/HEAD/tree/HxCFloppyEmulator/HxCFloppyEmulator_cmdline/trunk/


Convert alvalue to int

I did not notice that the build failed, since my tests ran on the already existing (old) binaries.

this doesn't build either - at least on my machine.
Please cast also al_image[4] into an integer. Preferable use the cpp static_cast
this does build on my machine
image->header.stamp = ros::Time(static_cast<int>(al_image[4]), static_cast<int>(al_image[5]) * 1000);

There.
(feeling slightly embarrassed).

sorry, I just pushed it a bit earlier. But same code.
Thanks for noticing though.


test_extract_datatree_chunk_index fails with eccodes v2.38.0

As first noticed in https://github.com/fsspec/kerchunk/pull/506, a test is failing when eccodes v2.38.0 is installed.
Observed in CI:
>       assert (
            idx_df["typeOfLevel"][[42, 46, 49, 50]]
            == ["heightAboveGround", "isobaricInhPa", "surface", "heightAboveGround"]
        ).all()
E       AssertionError: assert False
E        +  where False = <bound method NDFrame._add_numeric_operations.<locals>.all of 42     True\n46     True\n49     True\n50    False\nName: typeOfLevel, dtype: bool>()
E        +    where <bound method NDFrame._add_numeric_operations.<locals>.all of 42     True\n46     True\n49     True\n50    False\nName: typeOfLevel, dtype: bool> = 42    heightA... dtype: object == ['heightAbove...tAboveGround']
E             Full diff:
E             - [
E             -  'heightAboveGround',
E             ? ^^                 --
E             + 42    heightAboveGround
E             ? ^^^^^^
E             -  'isobaricInhPa',...
E
E             ...Full output truncated (8 lines hidden), use '-vv' to show.all

Troubleshooting by @maresb:
idx_df.iloc[83]
varname                                                             wz
typeOfLevel                                              isobaricInhPa
stepType                                                       instant
name                                       Geometric vertical velocity
isobaricInhPa                                                    975.0
step                                                   0 days 06:00:00
time                                               2023-09-28 00:00:00
valid_time                                         2023-09-28 06:00:00
uri                            ~/repos/kerchunk/kerchunk/tests/gfs....
offset                                                        21234675
length                                                         1035696
inline_value                                                      None
surface                                                            NaN
heightAboveGround                                                  NaN
meanSea                                                            NaN
Name: 83, dtype: object

From @Anu-Ra-g with eccodes v2.36.0:
varname                                                           watr
typeOfLevel                                                    surface
stepType                                                         accum
name                                                      Water runoff
isobaricInhPa                                                      NaN
step                                                   0 days 06:00:00
time                                               2023-09-28 00:00:00
valid_time                                         2023-09-28 06:00:00
uri                  ./kerchunk/tests/gfs.t00z.pgrb2.0p25.f006.test...
offset                                                        59215098
length                                                          348767
inline_value                                                      None
surface                                                            0.0
heightAboveGround                                                  NaN
meanSea                                                            NaN
Name: 83, dtype: object

Even though the error is occuring, the remaining steps work fine.

@Anu-Ra-g , you already started to look into this, some details are in the linked thread.

Here is the test diff,

That's consistent with what I was seeing.

extract_datatree_chunk_index filters out the Series data which is empty. So what I observed after passing the same grib file through the function using eccodes v2.36.0 and v2.38.0 is that the former had 87 rows and the latter had 85 rows.
Below I've compared the two dataframes from the eccodes versions.
The first columns is produced using 2.36.0 and second using 2.38.0. I guess, eccodes v2.38.0 is not able to read couple of variables in the grib file.

Note: I've used index 85 and 86 to compare  the dataframes

        varname
        self	other
12	cprat	cpr
13	cprat	cpr
68	tmax	tp
69	tmin	u
70	tp	u
72	u	u10
73	u	v
74	u10	v
77	v	v10
78	v	w
79	v10	w
81	w	watr
82	w	wz
83	watr	wz
85	wz	ignore_values
86	wz	ignore_values

I don't know what eccodes might be doing, but for the sake of the test, I would compare absolute offsets for the messages we know should be there, rather by index value.
One alternative would be to add an empty row to the output when reading failed.

(or we could pin the version of eccodes, of course, but that's unfortunate)

I'm not so familiar with the intricacies of this GRIB, and I don't know if eccodes is using semver, but it seems to me like there's a breaking change in v2.38.0, perhaps a bug, especially since it's failing to read some of the variables.
Unless we're doing something sketchy in this test so that the variables aren't well-defined, perhaps we should temporarily pin eccodes<2.38 and report this as an issue to them?

I agree, if we can show a reproducer locally with different outputs for the new version of eccodes compared to the previous one, that would be a good issue to post.

Reproducing using the extract_datatree_chunk_index function?

No, with eccodes/cfgrib directly, not touching any of our code at all.

if we can show a reproducer locally with different outputs for the new version of eccodes compared to the previous one, that would be a good issue to post.

I believe that's exactly what @Anu-Ra-g constructed in https://github.com/fsspec/kerchunk/issues/508#issuecomment-2377236744.
I looked into pinning eccodes, and the situation is pretty messy. It's not a direct dependency of kerchunk, but rather transitive through cfgrib, and that itself is only an optional dependency in the kerchunk[grib] group.
There's an easy conda solution to this problem: we just need to add a run_constrained with eccodes <2.38 which does exactly what we want: "if eccodes is installed then constrain it to be <2.38." But as far as I know there's no such mechanism for pip. So the best we could do is add eccodes <2.38 under kerchunk[grib].
We could also add a warning when the user runs a grib function with v2.38.

But as far as I know there's no such mechanism for pip.

Correct, pip runs through the list of things to install in order. So if you include "eccodes<2.38" in your command after kerchunk (or as a separate command, or later in a pipenv file) all will be well.

We could also add a warning when the user runs a grib function with v2.38.

Let's make that issue and see if there's any immediate follow-up from them. Honestly, eccodes, changes slightly every release, and things break all the time. I can only assume that typical use via xarray/cfgrib doesn't touch those sharp edges.


Changes the client Tags All() method to follow links

This returns all tags even when the registry forces pagination.

Please sign your commits following these rules:
https://github.com/docker/docker/blob/master/CONTRIBUTING.md#sign-your-work
The easiest way to do this is to amend the last commit:
$ git clone -b "clientAllTagsFollowsLinks" git@github.com:BrianBland/distribution.git somewhere
$ cd somewhere
$ git commit --amend -s --no-edit
$ git push -f

Ammending updates the existing PR. You DO NOT need to open a new one.

[Current coverage][cc-pull] is 52.50%

Merging [#1808][cc-pull] into [master][cc-base-branch] will decrease coverage by 6.82%

@@             master      #1808   diff @@
==========================================
  Files           120        120
  Lines         10468      10473     +5
  Methods           0          0
  Messages          0          0
  Branches          0          0
==========================================
- Hits           6211       5499   -712
- Misses         3424       4233   +809
+ Partials        833        741    -92

[][cc-pull]

Powered by Codecov. Last updated by [5f7f871...f9fb9e9][cc-compare]
[cc-base-branch]: https://codecov.io/gh/docker/distribution/branch/master?src=pr
[cc-compare]: https://codecov.io/gh/docker/distribution/compare/5f7f871d8fb8af84fab624953a587c2b4140e920...f9fb9e9e4c0f2bfd3e5a6836dfad344e66d2bc22
[cc-pull]: https://codecov.io/gh/docker/distribution/pull/1808?src=pr

😸  hello Brian.
Any chance of a unit test?

Required some janky hacks, but sure thing 🍰

🎩

LGTM

LGTM

Is this PR can get image's "all" tags just sent one request without auth?


unable to upload video to youtube

Using this code:
  var google = require('googleapis'),
    fs = require('fs'),
    yt = google.youtube('v3'),
    OAuth2Client = google.auth.OAuth2;

    var oauth2Client = new OAuth2Client(CLIENT_ID, CLIENT_SECRET, REDIRECT_URL);

    oauth2Client.setCredentials({ access_token: TOKEN });

    yt.videos.insert({
        part: 'status, snippet',
        resource: {
            snippet: {
                title: 'title',
                description: 'description'
            },
            status: {
                privacyStatus: 'private'
            }
        },
        media: {
            body: fs.createReadStream(video_file)
        }
    }, function(err, response) {
      console.log('error:', err, 'updated:', response);
    });

... I'm getting no errors but response after a while returns null and video has not been uploaded.
Thanks.

OK. This is working the issue was with the refresh_token used. Video for reference https://www.youtube.com/watch?v=hfWe1gPCnzc


OnePlus 3T Support

Is there an ETA for OnePlus 3T support?
It doesn't look like the OP3 is available on their website.
Thanks,
Matt

Added now!