ISPN-14406 Synchronize the partial reindex with refresh and flush

https://issues.redhat.com/browse/ISPN-14406

Thanks @tristantarrant pushed the fix. Let me know if there is anything else we can improve here.

Thank for the idea @wburns. Tried to applied the change here. Let me know if we can do better...

Merged, thanks

can you backport to 14.0.x please _

can you backport to 14.0.x please _

sure!

can you backport to 14.0.x please _

https://github.com/infinispan/infinispan/pull/10542


V3: ref().push().set({}) does not mimic js sdk

Hi @Salakar, I noticed an inconsistency with the js sdk…
What I'm trying to do is to use push but save the uid that push generates within the object. With firebase js sdk, you would do it like this
// Create a new post reference with an auto-generated id
var newPostRef = postListRef.push();
newPostRef.set({
    // ...data goes here
    // now you can use the generated uid with newPostRef.key
});

see here: https://firebase.google.com/docs/database/web/lists-of-data
with firestack v3 this doesn't work, since you promisify the push() result regardless whether there is a server interaction or not. If I'm correct, than in firebase JS sdk a .push operation with an empty object is a synchronous, client-side only operation.

@florianbepunkt Currently, push returns a promise since it has to interact with native code to get the new Firebase ID. On Salakars local branch, there is a work around in place to mimic web functionality however there was a bit of a debate on Gitter about it.

@florianbepunkt @Ehesp - what Elliot said really, i've done quite a bit of work on getting this working as per js sdk on my local branch as well as getting SERVER_OFFSET working synchronously also, but it's not been pushed up yet as its a WIP - plus the whole debate about it.

@Salakar I really don't mind the promise way at all, so it's not really an issue for me, I just noticed it. But seems like you already tackled it.

I don't see any chance of firebase changing the algorithm due to the fact this would break a lot of core firebase functionality for everyone on top of every sdk out there

I agreee, at least I don't see a change like this coming in firebase v3 version cycle.


PRIMARY_KEY is missing in multiple tables in mysql

Describe the bug
Multiple tables have the PRIMARY_KEY missing in the mysql driver, which makes memos incompatible with DigitalOceans managed database. This is due to these databases having the variable sql_require_primary_key set to ON for replication purposes (so it's not just limited to DigitalOcean databases, but to all mysql databases that have this setting on).
The "correct" fix would probably be to just give out primary keys to all tables; a workaround might be to use
SET SESSION sql_require_primary_key = 'OFF'

before creating the tables.
Log excerpt from the docker compose:
memos  | mode: prod
memos  | driver: mysql
memos  | ---
memos  | 2024/07/21 13:53:10 ERROR failed to migrate database !BADKEY="failed to exec latest schema: Error 3750 (HY000): Unable to create or change a table without a primary key, when the system variable 'sql_require_primary_key' is set. Add a primary key to the table or unset this variable to avoid this message. Note that tables without a primary key can cause performance problems in row-based replication, so please consult your DBA before changing this setting.\ngithub.com/usememos/memos/store/db/mysql.(*DB).prodMigrate\n\t/backend-build/store/db/mysql/migrator.go:79\ngithub.com/usememos/memos/store/db/mysql.(*DB).Migrate\n\t/backend-build/store/db/mysql/migrator.go:30\nmain.init.func1\n\t/backend-build/bin/memos/main.go:53\ngithub.com/spf13/cobra.(*Command).execute\n\t/go/pkg/mod/github.com/spf13/cobra@v1.8.1/command.go:989\ngithub.com/spf13/cobra.(*Command).ExecuteC\n\t/go/pkg/mod/github.com/spf13/cobra@v1.8.1/command.go:1117\ngithub.com/spf13/cobra.(*Command).Execute\n\t/go/pkg/mod/github.com/spf13/cobra@v1.8.1/command.go:1041\nmain.Execute\n\t/backend-build/bin/memos/main.go:101\nmain.main\n\t/backend-build/bin/memos/main.go:190\nruntime.main\n\t/usr/local/go/src/runtime/proc.go:271\nruntime.goexit\n\t/usr/local/go/src/runtime/asm_amd64.s:1695"
memos exited with code 0

Steps to reproduce

Any mysql database with sql_require_primary_key set to ON
Simply start the Docker compose (without any previous data)

The version of Memos you're using.
latest
Screenshots or additional context
No response

This seems to fix the issue of starting up:
 git diff store/
diff --git a/store/db/mysql/migration/prod/LATEST__SCHEMA.sql b/store/db/mysql/migration/prod/LATEST__SCHEMA.sql
index 3a3fb7d0..7e21eec3 100644
--- a/store/db/mysql/migration/prod/LATEST__SCHEMA.sql
+++ b/store/db/mysql/migration/prod/LATEST__SCHEMA.sql
@@ -1,4 +1,5 @@
 -- migration_history
+SET SESSION sql_require_primary_key = 'OFF';
 CREATE TABLE `migration_history` (
   `version` VARCHAR(256) NOT NULL PRIMARY KEY,
   `created_ts` TIMESTAMP NOT NULL DEFAULT CURRENT_TIMESTAMP
@@ -130,3 +131,5 @@ CREATE TABLE `reaction` (
   `reaction_type` VARCHAR(256) NOT NULL,
   UNIQUE(`creator_id`,`content_id`,`reaction_type`)
 );
+
+SET SESSION sql_require_primary_key = 'ON';
\ No newline at end of file

But I get into trouble when trying to add a new memo, not sure if it is related though:
2024/07/21 15:30:03 ERROR server error method=/memos.api.v1.MemoService/CreateMemo error="Error 1054 (42S22): Unknown column 'COMMENT' in 'on clause'"

I am doing a fresh installation and I am getting a similar problem:
memos  | 2024/07/31 23:44:22 ERROR failed to migrate database error="disk I/O error (5386)\nfailed to find migration history\ngithub.com/usememos/memos/store/db/sqlite.(*DB).Migrate\n\t/backend-build/store/db/sqlite/migrator.go:49\nmain.init.func1\n\t/backend-build/bin/memos/main.go:60\ngithub.com/spf13/cobra.(*Command).execute\n\t/go/pkg/mod/github.com/spf13/cobra@v1.8.1/command.go:989\ngithub.com/spf13/cobra.(*Command).ExecuteC\n\t/go/pkg/mod/github.com/spf13/cobra@v1.8.1/command.go:1117\ngithub.com/spf13/cobra.(*Command).Execute\n\t/go/pkg/mod/github.com/spf13/cobra@v1.8.1/command.go:1041\nmain.main\n\t/backend-build/bin/memos/main.go:194\nruntime.main\n\t/usr/local/go/src/runtime/proc.go:271\nruntime.goexit\n\t/usr/local/go/src/runtime/asm_arm64.s:1222"
I am not sure why it's trying to migrate but I never changed the database on the docker compose. Do I have to delete something or is it a problem?
I have already done some prune on the system but it still has the same problem.


Fix sereral issues on Measure.

Codecov Report

Merging #406 into master will not change coverage.
The diff coverage is n/a.

@@            Coverage Diff            @@
##             master     #406   +/-   ##
=========================================
  Coverage     90.02%   90.02%
  Complexity      583      583
=========================================
  Files            98       98
  Lines          2036     2036
  Branches        210      210
=========================================
  Hits           1833     1833
  Misses          150      150
  Partials         53       53

Impacted Files
Coverage Δ
Complexity Δ

...ore/src/main/java/io/opencensus/stats/Measure.java
80% <ø> (ø)
1 <0> (ø)
:arrow_down:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 39ac27f...89882ca. Read the comment docs.

Thanks!


Implement db/memory/intervals.go behavior

Write an in-memory implementation of the DBClient interface for the file mentioned in this issue's title.  Include unit tests that cover the implementation.
This in-memory persistence implementation will be used for Golang-based acceptance tests.
Related to https://github.com/edgexfoundry/edgex-go/issues/2277 and https://github.com/edgexfoundry/edgex-go/issues/2273.

Decision made for v2 to have its own persistence implementation.  Closing this issue; it is no longer relevant.


formatter should not concatenate multiple strings on the same line

before
asdf(
    "asdf"
    "asdf"
)

after
actual
asdf("asdf" "asdf")

expected
it should either do this:
asdf("asdfasdf")

or just leave it as-is
asdf(
    "asdf"
    "asdf"
)

https://play.ruff.rs/55df5227-bc7a-45bb-8ae2-f1a8b7802221

I believe this is covered by https://github.com/astral-sh/ruff/issues/9457.


add CCC token

Please check the following to ensure a successful verification of Token Profile
.json and .png document checklists

[x] logo dimensions: 120*120 px
[x] logo background: Transparent
[x] At least one transaction on the token contract
[x] For ERC-20 project teams: Upper and lower capitalized alphabets in token address (For checksum purposes)
[x] Same document name for both .json and .png (Including capitalization)

Project background:
Official announcement:  https://twitter.com/CCCPROTOCOLUP/status/1697509616744342015?s=20
Project team background: Our core development team consists of a carefully selected group of highly skilled blockchain developers, software engineers, and cryptography experts. Not only do they possess a broad range of knowledge and experience, but they are also skilled in constructing secure and scalable decentralized systems. Their expertise is unrivaled in the field of blockchain technology, providing a solid guarantee for the smooth operation and continuous improvement of the CyberCrowdCoin protocol.
Known for their exceptional abilities and innovative thinking, our team members continue to push the boundaries of the industry. They explore the latest blockchain technologies and incorporate them into our protocol to ensure that we stay at the forefront of the industry. Their efforts enable us to stand out in this competitive industry and offer users exceptional blockchain protocols.
Project basic information: CyberCrowdCoin aims to build an open, inclusive, and innovative platform that provides users with a wide range of tools and resources to promote collaboration and creativity. By introducing Web3 technology, we believe we can revolutionize the way people collaborate and drive social progress and development.
Media publications:
Tradeable exchanges: P-Net
Suggested Gas limit setting (default is 60,000): 60000

what else can I do to help to merge my pull request?


Overriding a shape in defineShape seems to result in strange behavior

to overload some methods of Line, i copied the defineShape( 'Line', ... )  from literrallycanvas.js.
( is it the best way to overload methods of exist shapes? )
i didn't alter the code in defineShape except changing
createShape
to
LC.createShape.
run, i draw the solid or dash lines well. but once i select the arrow line and click to draw it, the canvas goes right quickly and soon out of the window. i can not pan it back.

Sorry for missing this. Could you include the source code that demonstrates the problem?

I'm guessing you didn't have lineEndCapShapes in scope, which is an internal object. So this isn't a bug, just an unsupported feature.


Fixing broken docker image prune cronjob

Related to : https://github.com/amazeeio/lagoon/issues/330

thanks @dasrecht <3

thanks @dasrecht <3


[ACCOUNTING] Outgoing Keysend Callback

[ ] Determine all side effects and add to this issue
[ ] Migrate legacy code to new accounting service controller
[ ] Identify all existing code that uses the legacy endpoint and create a follow up ticket to update the call sites to use the new endpoint

This callback route is called when an outgoing keysend payment is complete.
The controller logic looks up the keysend record in the external_payment table, marks it as is_pending false, and updates its status.
If the payment was successful, the sender's balance is adjusted accordingly. If unsuccessful, the sender's balance is left unchanged.

ZBD is the only consumer of this endpoint, there are no clients to update.


Creating a React app using Vite

We ask that you please be patient as our team works through approving and publishing all articles/tutorials in a timely manner. Allow 1-3 days for a topic to be reviewed and/or approved - allow 3-7 days for an articles to be reviewed and/or published.
Be sure to visit our Resources Page for tools, resources, and example articles to go over.
NOTE: (Please ensure that you have only one open issue + linked pull request at a time. This will ensure that we complete the article in a timely manner from inception to publishing.)
NOTE: We tend to stray away or tend not to publish reviews/comparisons of commercial product offerings.
We're looking for the first 2-3 paragraphs of the article that appropriately summarize what your article will be about.
Proposed title of article
Creating a React app using Vite
Introduction paragraph (2-3 paragraphs):
React is a front-end library used to create web applications user interfaces. To initialize a react project, one needs to set up the required packages and dependencies required to initialize and run the app using the "npx create-react-app app-name" command. This article, therefore, intends to teach an alternative of setting up a react project using Vite, a build tool instead of the normally used npx create-react-app app-name way.
Key takeaways:

Learn what Vite is.
Understand why it is efficient to use.
Learn how to set up a new react app with Vite

References:
N/A
Templates to use as guides

How To Guide Template
Software Review Template
Tutorial Template

@Neema-2016 Good afternoon and thank you for submitting your topic suggestion.
Your topic form has been entered into our queue and should be reviewed (for approval) as soon as a content moderator is finished reviewing the ones in the queue before it.

Great topic 🚀 , make sure it matches the following:

Adds value beyond what is in the official docs and what is covered in other blog sites.
To avoid any potential article closure, It should not overlap with any existing EngEd articles or incoming topic suggestions.

Please reference any relevant EngEd articles in yours and build a unique project - Approved. @Neema-2016


gitops run: If dev-ks never becomes healthy, then eventually it goes missing

If I:

Try to run gitops run against something broken - for example, point it at a directory with invalid yaml
Don't fix the reason it's breaking
Wait 5 minutes or so

Then the dev-ks will be completely deleted, and the only way to recreate it is to turn gitops run off and on again.
I expect that I will be able to work to fix the reason it's failing for as long as I want, and whenever I fix it, everything will start to work.

In good news, I have left a "healthy" gitops run running for days and it still works when I come back :)

@chanwit cool!

Fixed by #2970


update unit test for memory manager config options

What changes were proposed in this pull request?
add more unit test for memory manager config options
How was this patch tested?
N/A

LGTM +1


azcopy - copy from AWS S3 to Azure Blob Storage throws CannotVerifyCopySource Error

Which version of the AzCopy was used?
azcopy verison 10.8.0
Which platform are you using? (ex: Windows, Mac, Linux)
Windows
What command did you run?
azcopy cp "https://s3.amazonaws.com/[bucket]/" "https://[destaccount].blob.core.windows.net?[SAS]" recursive=true
What problem was encountered?
S3 bucket has multiple folders and sub folders with different types of files (such as text, gif, avro, parquet, etc).  Only few files were copied and failed with 1 file with below error
2021/01/18 03:30:42 ==> REQUEST/RESPONSE (Try=1/172.9497ms, OpTime=338.1054ms) -- RESPONSE STATUS CODE ERROR
PUT https://storageaccount.blob.core.windows.net//cwl/error/processing-failed/2020/10/23/02/filename...
Content-Length: [0]
User-Agent: [AzCopy/10.8.0 Azure-Storage/0.10 (go1.13; Windows_NT)]
X-Ms-Client-Request-Id: [9b71eda1-dadb-4d7a-5ca2-df2de62fe08d]
X-Ms-Copy-Source: [https://bucket.s3.dualstack.ap-southeast-2.amazonaws.com/cwl/error/processing-failed/2020/10/23/02/filename....
X-Ms-Source-Range: [bytes=0-4439]
X-Ms-Version: [2019-12-12]
RESPONSE Status: 403 Forbidden
Content-Length: [200]
Content-Type: [application/xml]
Date: [Mon, 18 Jan 2021 03:30:40 GMT]
Server: [Windows-Azure-Blob/1.0 Microsoft-HTTPAPI/2.0]
X-Ms-Client-Request-Id: [9b71eda1-dadb-4d7a-5ca2-df2de62fe08d]
X-Ms-Error-Code: [CannotVerifyCopySource]
X-Ms-Request-Id: [25ffb88f-a01e-00b4-6b4a-ed735b000000]
X-Ms-Version: [2019-12-12]
Response Details: CannotVerifyCopySourceForbidden
2021/01/18 03:30:42 ERR: [P#0-T#7] COPYFAILED: https://s3.ap-southeast-2.amazonaws.com/bucket/cwl/error/processing-failed/2020/10/23/02/filename : 403 : 403 Forbidden. When Staging block from URL. X-Ms-Request-Id: 25ffb88f-a01e-00b4-6b4a-ed735b000000
Dst: https://storageaccountname.blob.core.windows.net/ato-raw-pradeep/cwl/error/processing-failed/2020/10/23/02/filename?se=2021-01-18t11%3A27%3A06z&sig=-REDACTED-&sp=rwdlacupx&spr=https&srt=sco&ss=bfqt&st=2021-01-18t03%3A27%3A06z&sv=2019-12-12
2021/01/18 03:30:42 JobID=16f8c156-385c-4d4e-62c3-28b45b0a41cb, Part#=0, TransfersDone=56 of 56
2021/01/18 03:30:42 all parts of entire Job 16f8c156-385c-4d4e-62c3-28b45b0a41cb successfully completed, cancelled or paused
2021/01/18 03:30:42 all parts of entire Job 16f8c156-385c-4d4e-62c3-28b45b0a41cb successfully cancelled
2021/01/18 03:30:43 PERF: primary performance constraint is Unknown. States: W:  0, F:  0, S:  0, E:  0, T:  0, GRs: 32
2021/01/18 03:30:43
Diagnostic stats:
IOPS: 21
End-to-end ms per request: 283
Network Errors: 0.00%
Server Busy: 0.00%
Job 16f8c156-385c-4d4e-62c3-28b45b0a41cb summary
Elapsed Time (Minutes): 0.0334
Number of File Transfers: 56
Number of Folder Property Transfers: 0
Total Number of Transfers: 56
Number of Transfers Completed: 0
Number of Transfers Failed: 1
Number of Transfers Skipped: 0
TotalBytesTransferred: 0
Final Job Status: Cancelled
How can we reproduce the problem in the simplest way?
AWS
Set up an AWS account
configure Access and secret keys
create an s3 bucket with some files (source)
Azure
Set up an Azure account
Create storage account (destination)
Create a SAS for storage account
Azcopy
Use AzCopy to copy data from AWS to Azure using the azcopy command provided above
The files in the AWS buckets have exactly same permissions as others that were copied successfully.  But not sure what the issue was with this particular file.  So, i can only reproduce this issue with this particular file.
Have you found a mitigation/solution?
No solution found.
But i deleted the file that caused this error but the error was raised on a different file that is similar to the other.
I also tried executing the azcopy command just for this file (instead of the entire bucket) and the same error was thrown.

Hi @deep000, thanks for reaching out!
From the log, it looks like none of the files were copied:
Have you set the credentials for the source? Doc is here:
export AWS_ACCESS_KEY_ID=
export AWS_SECRET_ACCESS_KEY=

https://github.com/Azure/azure-storage-azcopy/issues/1323

https://github.com/Azure/azure-storage-azcopy/issues/446

https://github.com/Azure/azure-storage-azcopy/issues/957

Closing due to age of issue. The service and the tool have both evolved quite a bit. Please let us know if you still experience this.

I am experiencing this issue currently when trying to copy from S3 to Azure.  Azcopy will fail to copy a file and return 403 .  I can then immediately run the exact same copy command again on the same file and it might succeed (sometimes on the 4th or 5th attempt - it appears to be random).   There is no issue with metadata and the file ends in .csv.  I am logged into Azcopy, have valid credentials for AWS, have set the appropriate environment variables, and have applied the correct role to write to Azure storage.  Seems if there was an issue with authentication/permissions/filename/metadata/etc then the copy would always fail, but that is not what I am seeing.  Any insights here?

@BHC3-KevinFaneca could you please create a new issue with this information and include logs of failed copies?

Thank you @gapra-msft .  https://github.com/Azure/azure-storage-azcopy/issues/2422


Adding GitHub Action to run unit and system tests

To avoid stuff breaking silently, we will now use the GitHub CI to run both unit as well as system tests on various JDK distributions.

Hmm, it has the dependency check thing which sometimes works. I can move that action over and consolidate into one action.

I have reorganized and cleaned up the actions a bit.

It looks like the system tests are still a bit flakey.

Hmm, I activated some tests that did not work in past versions of Fontus in #21. Apparently, two rely on features semeru does not implement, namely CallerSensitive methods.
I do not think the tests are flakey, but those two might need some adaption for semeru. I'll add the flag to signal that they are expected to fail so the tests pass and open an issue to track progress on this.


Bug with World and Gravity Animation

2D World now pulls the 3D world after latest update, making it display the axis system, also when "no animation of gravity and "no gravity animation"

Now, there are two world models in order to solve this issue. The default planar world does not enable coupling to 3D. There is a second world model to do this.
If this is a permanent or temporary solution is not yet decided. Future will tell...


Comedy Central broken

i use youtube-dl to watch this show on a regular basis, so this change is new this week.  i'm in the US and can view it using flash but not with youtube-dl.  just to be sure, i cloned the latest source from github.
here's the output:
$ python -m youtube_dl http://www.cc.com/full-episodes/uj0i4w/the-daily-show-with-trevor-noah-march-7--2016---ilana-glazer-and-abbi-jacobson-season-21-ep-21073
[ComedyCentral] the-daily-show-with-trevor-noah-march-7--2016---ilana-glazer-and-abbi-jacobson-season-21-ep-21073: Downloading webpage
[ComedyCentral] 380afdff-96f1-48ac-96d3-535e5e601ecb: Downloading info
[ComedyCentral] d01e4924-d876-4162-908b-ea4d6eb7388b: Extracting information
[ComedyCentral] d01e4924-d876-4162-908b-ea4d6eb7388b: Downloading video urls
[ComedyCentral] 2e26eb8c-b862-4693-b0f2-740043f0bdbd: Extracting information
[ComedyCentral] 2e26eb8c-b862-4693-b0f2-740043f0bdbd: Downloading video urls
[ComedyCentral] df5399ce-0eb2-4f00-99ea-59b323ae263f: Extracting information
[ComedyCentral] df5399ce-0eb2-4f00-99ea-59b323ae263f: Downloading video urls
ERROR: ComedyCentral returned error: not_found -
      Sorry, this video is not found or no longer available due to date or rights restrictions.

The URL you provided redirects to the CC homepage. I looked at the info page of that show and was served the "Sorry, this video is not found or no longer available..." message in browser when trying to view a full episode.
Do you have any examples of working in browser links?

hmm... try this link directly in the browser then with youtube-dl.  http://www.cc.com/full-episodes/9cme4a/the-daily-show-with-trevor-noah-march-3--2016---bill-de-blasio-season-21-ep-21072
it's odd because the original video link worked previously.

Works fine for me:
>py26yt http://www.cc.com/full-episodes/uj0i4w/the-daily-show-with-trevor-noah-march-7--2016---ilana-glazer-and-abbi-jacobson-season
-21-ep-21073
[ComedyCentral] the-daily-show-with-trevor-noah-march-7--2016---ilana-glazer-and-abbi-jacobson-season-21-ep-21073: Downloading webpage
[ComedyCentral] 380afdff-96f1-48ac-96d3-535e5e601ecb: Downloading info
[ComedyCentral] d01e4924-d876-4162-908b-ea4d6eb7388b: Extracting information
[ComedyCentral] d01e4924-d876-4162-908b-ea4d6eb7388b: Downloading video urls
[ComedyCentral] 2e26eb8c-b862-4693-b0f2-740043f0bdbd: Extracting information
[ComedyCentral] 2e26eb8c-b862-4693-b0f2-740043f0bdbd: Downloading video urls
[ComedyCentral] df5399ce-0eb2-4f00-99ea-59b323ae263f: Extracting information
[ComedyCentral] df5399ce-0eb2-4f00-99ea-59b323ae263f: Downloading video urls
[ComedyCentral] 2859e93e-fdaf-4ef5-b892-b38baf5b3d07: Extracting information
[ComedyCentral] 2859e93e-fdaf-4ef5-b892-b38baf5b3d07: Downloading video urls
[download] Downloading playlist: None
[ComedyCentral] playlist None: Collected 4 video ids (downloading 4 of them)
[download] Downloading video 1 of 4
[download] Destination: The Daily Show with Trevor Noah_The Daily Show with Trevor Noah 21073 Act 1 d01e4924-d876-4162-908b-ea4d6eb7388b-d01e4924-d876-4162-908b
-ea4d6eb7388b.mp4
[download]   0.0% of 219.80MiB at 130.17KiB/s ETA 28:48
ERROR: Interrupted by user

how bizarre, it seems to be working now.  i'm assuming this was a server admin issue.


Improve CI: Speedup & more tests, and fixed one clippy warning

Speedup job os-check: Run on Linux Windows CI is just way too slow and this crate does not use anything that requires C/C++ compiler, so we can trivally cross-compile it.
Test features-powerset in job os-check
Turn warnings into errors
Add concurrency group to cancel CI for outdated commits
Make sure each job has its own unique cache key (for each matrix) and could restore from previous (Cargo.lock) or other jobs' cache as a fallback.
Fix docs.rs: Enable feature tracing
Speedup check.sh: Run fmt, clippy, doc once instead of multiple times

Signed-off-by: Jiahao XU<EMAIL_ADDRESS>

@silver-ymz Do you have any other PR?
I think we can cut a new release for openssh-sftp-client-lowlevel and openssh-sftp-client

I am working on exposing methods for extensions, which can complete tonight. Please wait a moment.

Sure!
Take your time, I'm not in a rush to cut new release.


Update on remove

Is there a way to remove 'removed' files?

I use https://github.com/johnagan/clean-webpack-plugin to avoid stale files.

The clean-webpack-plugin is a good recommendation. Thanks again @aj0strow !


(ADP-257) Change ByronMigration endpoints

Context

As an API Client,
I want to be able to empty a wallet and send all funds to a list of addresses,
So that I can easily move funds around and have the wallet dealing with fees for me.
Decision

We first add new migration endpoint that enables to transfer a given wallet to the addresses specified. The following cases are to be supported :
(a) byron wallet -> shelley addresses
(b) byron wallet -> byron addresses
Moreover, MigrationWalletInfo is to be operative
This is jormungandr context!
Acceptance Criteria

New endpoints in ByronWallet are changed in all needed places in codebase (swagger, API endpoint).
Needed unit tests for types are added.
Implementation is added and integration tests work

Development

QA

We changed how Byron migration endpoints work. Now they accept source wallet id and reciepent addresses. This gave rise to many changes in our codebase, from swagger up to Wallet core-integration tests. Would be worth at this changes
Added integration tests for checking address cycling https://github.com/input-output-hk/cardano-wallet/blob/master/lib/core-integration/src/Test/Integration/Scenario/API/Shelley/Wallets.hs#L1344
added a number of property tests for assignMigrationAddresses https://github.com/input-output-hk/cardano-wallet/blob/master/lib/core/test/unit/Cardano/Wallet/Primitive/CoinSelectionSpec.hs#L92-L101

What is the reason to not also support "Shelley wallet -> Shelley addresses"?

Because in this task I am after refactoring ByronMigration. In the next task I will add address shelley -> shelley in a sense that the endpoints will be added to shelley transactions endpoint family

Doing some exploratory testing and encountered this case on jormungandr. When trying to migrate to an address DdzFFzCqrhtCNjPk5Lei7E1FxnoqMoAYtJ8VjAWbFmDb614nNBWBwv3kt6QHJa59cGezzf6piMWsbK7sWRB5sv325QqWdRuusMqqLdMt I am getting 500.
To reproduce:

Launch Jorm:

cd /lib/jormungandr/test/data/jormungandr/test_scripts
./wallet_launch

:point_down:

Create byron wallet with funds:

arctic decade pink easy jar index base bright vast ocean hard pizza

curl  -vX POST http://localhost:8090/v2/byron-wallets/random \
  -H "Content-Type: application/json; charset=utf-8" \
  -d '{
"name": "Byron Faucet ",
"mnemonic_sentence": [ "arctic", "decade", "pink", "easy", "jar", "index", "base", "bright", "vast", "ocean", "hard", "pizza"],
"passphrase": "Secure Passphrase"
}' --http1.1  |  jq

Try to migrate to address: DdzFFzCqrhtCNjPk5Lei7E1FxnoqMoAYtJ8VjAWbFmDb614nNBWBwv3kt6QHJa59cGezzf6piMWsbK7sWRB5sv325QqWdRuusMqqLdMt

curl -vX POST http://localhost:8090/v2/byron-wallets/aa129a07d1ce083e67597348f1788747a034686e/migrations \
  -H "Content-Type: application/json; charset=utf-8" \
  -d '{
"passphrase": "Secure Passphrase",
"addresses": ["DdzFFzCqrhtCNjPk5Lei7E1FxnoqMoAYtJ8VjAWbFmDb614nNBWBwv3kt6QHJa59cGezzf6piMWsbK7sWRB5sv325QqWdRuusMqqLdMt"]
}' --http1.1  |  jq

Result:
Code = 500,
Message = Something went wrong

In the log there is:
[POST] /v2/byron-wallets/aa129a07d1ce083e67597348f1788747a034686e/migrations
ErrUnexpectedNetworkFailure (Link {_segments = ["api","v0","message"], _queryParams = []}) (FailureResponse (Request {requestPath = (BaseUrl {baseUrlScheme = Http, baseUrlHost = "<IP_ADDRESS>", baseUrlPort = 8080, baseUrlPath = ""},"/api/v0/message"), requestQueryString = fromList [], requestBody = Just ((),application/octet-stream), requestAccept = fromList [], requestHeaders = fromList []), requestHttpVersion = HTTP/1.1, requestMethod = "POST"} (Response {responseStatusCode = Status {statusCode = 500, statusMessage = "Internal Server Error"}, responseHeaders = fromList [("content-type","text/plain; charset=utf-8"),("content-length","54"),("date","Thu, 21 May 2020 15:01:27 GMT")], responseHttpVersion = HTTP/1.1, responseBody = "Internal server error: Structure invalid: transaction\n"}))

Added scenario to illustrate :point_up_2:  in https://github.com/input-output-hk/cardano-wallet/pull/1682.

Closing, there is still https://github.com/input-output-hk/cardano-wallet/issues/1675 in progress.


Brings the count from 452 to 368

#nochangelog

Warnings

:warning:

✅ No changelog changes

  Generated by :no_entry_sign: dangerJS against 8464c286b914686f7f21a3a5211013ee82882b4a


Add subcommand to the CLI

In this PR, we re-organize the CLI to allow subcommands, this is in order to be prepared for any future development if the util is meant to do more than collecting fingerprints.
What we have done :

Add a subcommand in the CLI
Modify README accordingly
Modify comment mentioning commands
Modify tests to use this command

@Walz, I took into account your changes thanks a lot ! Let me know if this looks good to you.


Fix some simple accessibility issues

These changes fix (most of*) the errors reported by the WAVE and Axe browser-based accessibility testing tools. Fortunately, there were few!
* Not fixed in this PR: Axe reports an issue with the search autocomplete box not having an ARIA role when it appears. Taking a look at the source of the autocompleter npm package that we use for this, there is not a simple fix. I also would like to do some manual testing on it to make sure it can be used with a keyboard only and is properly announced by a screen reader.
This also fixes #103, reworking the way that the header is laid out so that on mobile devices the menu button will stay to the right and the site title will break to multiple lines if necessary.

Before
After

Just pushed one more commit that may be worth calling out:
Testing on a different page revealed a color contrast issue with the color of inline code snippets (not Pygments-highlighted code blocks – those seem fine). I tried to keep it as close to the original and just darken it enough to hit a 4.5:1 contrast ratio to pass WCAG AA.
I think unless you look at them side by side, most folks probably won't notice, but I wanted to mention it in case we need to update a design spec anywhere or something.


Syncing saves causes the refresh button to appear, yet the UI has already been refreshed

Note that syncing should also clear the refresh button state


Replacing the ADAPT Vector geodata Model with GeoJson

The ADAPT Serialization Working Group is examining replacing ADAPT's vector geodata model with inline/externally referenced GeoJson.
Vector geodata is currently used in the following places in ADAPT:
FieldBoundary.SpatialData (Multipolygon)
Prescription.SpatialPrescriptionAttributes.VectorPrescriptionAttributes.RxShapeLookups[n].SpatialData (Multipolygon)
FieldBoundary.Headlands[n].SpatialData (Multipolygon)
CropZone.BoundingRegion (Multipolygon)
OperationGroup.Coverage (Multipolygon)
GuidanceGroup.GuidanceBoundary (Multipolygon)
GuidancePattern.GuidanceBoundary (Multipolygon)
Facility.Position.Coordinates (Point)
FieldBoundary.Obstacles[n].Shape (Polymorphic)
ReferenceLayer.ShapeReferenceLayerAttributes.ShapeLookups[n].Shape (Polymorphic)
Note.SpatialContext (Polymorphic)
GuidancePattern.ABCurveAttributes.Linestrings
GuidancePattern.APlusAttributes.A (Point)
GuidancePattern.ABLineAttributes.A (Point)
GuidancePattern.ABLineAttributes.B (Point)
GuidancePattern.PivotAttributes.CenterPoint (Point)
GuidancePattern.PivotAttributes.StartPoint(Point)
GuidancePattern.PivotAttributes.EndPoint(Point)
GuidancePattern.SpiralAttributes.LineStrings

Is there a precedent for referring to external component models within Score?:  There is no formal way, but we can address this as an exception to be incorporated into the automated JSON-schema generation process, and documentation-generation process. Then we can take the requirements to OAGi to be incorporated into Score. As an aside OAGi / NIST has implemented support for multiple namespaces in Score, and support for components defined in one namespace to specify child components specified in another namespace. (OAGi is developing a proof-of-concept exercise for HR Open Standards that will use this feature.) Where this may come in hand in the future is to leverage connectSpec (OAGIS) in ADAPT Standard and leverage ADAPT Standard in connectSpec.

@crutt @zwing99 Discussion in 15 Aug Serialization WG meeting that for the attributed data above (Vector Prescriptions and Vector Reference Layers), we should snap to the same GeoParquet pattern as the logged data, replacing the "Lookup" pattern of the earlier model.
In addition, we talked about the pros and cons of using WKT instead of GeoJson for the unattributed geometries, largely to prevent an implementer from going around the model and putting ad hoc GeoJson Features/FeatureCollections in the properties intended for simple geometries, omitting the properties intended for the data they put in the feature.

Hi Andres, we have been gravitating toward GeoParquet largely due to its small size and that several participants have been impressed by the speed and efficiency of working with this format.   There is support in gdal and data can be readily visualized in QGIS.
I personally hadn't looked into GeoPackage (others may have and already discounted it as an option for us), but I see a couple concerns.
A primary consideration for some of the participants has been that data can be mapped/processed as it is downloaded without having to wait for the completed file.  Unless I'm mistaken, this doesn't look possible with GeoPackage.
The thought of Vector and Raster data in a single format is appealing, and GeoTiff is clumsy and arguably overkill for our needs.   However, it appears GeoPackage requires raster data be in jpeg or png format?  Is that correct?   In most cases, ADAPT raster data is just a raster definition and array of attribute data.

Hi
Thanks for the answer.
As I am not really familiar with the intention of ADAPT my initial questions are:
Is ADAPT intended to be directly usably by end-users or ”only” as an interchange transfer standardized format?
Can not several storage mechanisms be considered/defined? (like IHO S-100 do)
Is really GeoParquet not planning to implement a spatial index? https://github.com/opengeospatial/geoparquet
For end-users, read access (using spatial index) is much more important than write performance of million of features.
A quite simple comparison column versus row https://medium.com/bluecore-engineering/deciding-between-row-and-columnar-stores-why-we-chose-both-3a675dab4087
cooking down to the use case - very simplified ”OLTP versus OLAP"
"mapped/processed as it is downloaded without having to wait for the completed file. Unless I'm mistaken, this doesn't look possible with GeoPackage."
as GeoPackage is SQLite I would just download a relevant number of features in a loop using standard SQL. This requires that the GPKG file is available from a service.
But is this really a consideration? Agriculture geodata is, AFAIK, quite limited in size - i.e. max Gb-level.
Measurements (sensors) may be another case.
And there is the vector tile extension https://gitlab.com/imagemattersllc/ogc-vtp2/-/blob/master/extensions/4-vtae.adoc
I would consider to do a test bench with real-world data and use cases, as e.g. OGC normally do.
GeoPackage as spec’ed only supports JPEG and PNG. But other formats may be implemented as extensions, see http://www.geopackage.org/spec/#extension_tiles_webp
Best regards
Andreas Oxenstierna
Dalen Hörbyvägen 53
243 94 Höör
0730-26 97 12
On 22 Aug 2023, 15:48 +0200, Kelly Nelson @.***>, wrote:

Hi Andres, we have been gravitating toward GeoParquet largely due to its small size and that several participants have been impressed by the speed and efficiency of working with this format. There is support in gdal and data can be readily visualized in QGIS.
I personally hadn't looked into GeoPackage (others may have and already discounted it as an option for us), but I see a couple concerns.
A primary consideration for some of the participants has been that data can be mapped/processed as it is downloaded without having to wait for the completed file. Unless I'm mistaken, this doesn't look possible with GeoPackage.
The thought of Vector and Raster data in a single format is appealing, and GeoTiff is clumsy and arguably overkill for our needs. However, it appears GeoPackage requires raster data be in jpeg or png format? Is that correct? In most cases, ADAPT raster data is just a raster definition and array of attribute data.
—
Reply to this email directly, view it on GitHub, or unsubscribe.
You are receiving this because you commented.Message ID: @.***>

@Andreasox  While ADAPT is not indeed intended for end users, but as you state a transfer mechanism between software systems, we have been making an effort to standardize on one way of doing things.
Re one party hosting a database and serving a subset of the data, while that could be possible, the primary use case is sending the dataset in its entirety.   In most cases, these datasets will represent one field's worth of data.

Thanks - this clarifies the ADAPT use case for me and mitigates my concerns.
Hälsningar
Andreas Oxenstierna
Dalen Hörbyvägen 53
243 94 Höör
0730-26 97 12
On 29 Aug 2023, 23:28 +0200, Kelly Nelson @.***>, wrote:

@Andreasox While ADAPT is not indeed intended for end users, but as you state a transfer mechanism between software systems, we have been making an effort to standardize on one way of doing things.
Re one party hosting a database and serving a subset of the data, while that could be possible, the primary use case is sending the dataset in its entirety. In most cases, these datasets will represent one field's worth of data.
—
Reply to this email directly, view it on GitHub, or unsubscribe.
You are receiving this because you were mentioned.Message ID: @.***>

In discussion with @crutt  and @zwing99  in yesterday's Serialization meeting, our recommended approach is to standardize on the following across the model.

For individual geometries where all metadata is specified on the ADAPT components, use WKT with WGS84 coordinates with seven decimal places on all points.   Using this vs. geojson prevents any implementer from varying from the standard by substituting data in geojson features where we intend only geometries with the data placed elsewhere in the standard.  WKT is defined in ISO/IEC 13249-3:2016.

For spatial layers (Spatial Records files, Vector Prescriptions, Vector Reference Layers), use Geoparquet with column ids that map to an index of variables with associated metadata as we have defined for Spatial Records within Operations.

With this, a serialized ADAPT dataset will include a primary json file with all non-layer components, n GeoParquet files for all vector layers, and n GeoTiff files for all raster layers.

Agreement in the 30 August 2023 meeting to accept the above proposal.


add_support_for_IKEA_LED1545G12

Hi @bramstroker , here is a LUT file for an Ikea lamp of mine. I have also added the lamp name to the lookup in Const.py. But to be honest, at least for me, the lamp is only displayed by Hue as an empty string without a name.
Should I still leave the lookup in Const.py, or would you prefer me to leave it out completely?

Thanks for the PR. It's fine to leave the entry in const.py. Maybe the Hue bridge will correctly identify things in the future, and than we don't have to do any modifications.

@CM000n
You could try to verify idetification by Hue bridge using this aplication:
https://www.hueessentials.com/

And one more important thing.
I'm sure that standby power draw is greater than 0W, so I can suggest to set it to 0.45W (it must be close to LED1546G12) or measure correctly real power.

@CM000n During inspection / analysing of the profile library I noticed this profile has incorrectly set the measure_device. It's either unknown of to generic model. Do you still remember which exact power meter model you used during measurements? That would help further improve the library quality also for future reference.

Hi @bramstroker. It was measured with one of these devices https://avm.de/produkte/smart-home/fritzdect-200/

Hi @bramstroker. It was measured with one of these devices https://avm.de/produkte/smart-home/fritzdect-200/

Thanks!


unclear buffersize

Hello,
In the documentation, in the generic API section, the _buffersize functions do not specify whether the buffer size is in bytes or in elements. Should I allocate buffersize or buffersize * sizeof(double) bytes of memory for the buffer?
Please clarify that in the docs.

Hello Jakub,
If unspecified, the buffer size is a number of bytes.
We will add a note.
Thank you


Merge pull request #938 from Aguafrommars/master

Duende fixes integration

:white_check_mark: Build TheIdServer 7.1.0+10.build.2916 completed (commit https://github.com/Aguafrommars/TheIdServer/commit/c3699d093d by @aguacongas)

:x: Build TheIdServer 7.1.1.build.2920 failed (commit https://github.com/Aguafrommars/TheIdServer/commit/5b7bd8eaa5 by @semantic-release-bot)

:white_check_mark: Build TheIdServer 7.1.1.build.2923 completed (commit https://github.com/Aguafrommars/TheIdServer/commit/ebd56911fe by @semantic-release-bot)


Introspect dependency needs an update

Introspect 0.1.2 is not working for ScrollView, see following thread: https://github.com/siteline/SwiftUI-Introspect/issues/55
Could you update Introspect package version to 0.1.3, in the dependencies?
Thanks :)

Hey, could you open a PR for this? And maybe test if everything works with the new Introspect version? I'm not at my Mac this week.

Hi, sorry I was away from the computer as well. I'll take a look this week at some point when I have time. Thanks for the swift answer!

Hi, did some testing after updating the Introspect dependency, but it did not solve my problem so I'm gonna do some more digging...
The problem is that on line 158 the ´introspectScrollView´ block is not called in some cases, so the scrolling does not happen when entering the view the first time.

Could you post some code for context on what you are trying to do?


Better readme

I spent 45 minutes figuring out how to patch this. This tutorial will greatly reduce the time to patch for people without experience.

Thanks

I think spicetify -c prints the correct path

I think spicetify -c prints the correct path

what do you mean? Is there anything that can be simplified in the Readme?

Yeah the patching part. I didn't find the file using those instructions, but then I found this command which basically gives you the file path.
Also, doesn't the file get patched automatically with the installer? It was patched already for me. Brw great theme.

You added it, great :)


JPEG-XL support

FFMPEG now supports JPEG-XL: https://ffmpeg.org/ffmpeg-codecs.html#libjxl
I'm already using AB-AV1 to to crf-search a target vmaf for avif images. It would be nice to have this support for JPEG-XL, too - even though unlike AV1, JPEG-XL is an image-only codec.
Since JPEG-XL uses FFMPEG just like AVIF, adding JPEG-XL should probably not be complex?
I know it could be already be done using the 'ab-av1 vmaf' command and encoding to JPEG-XL until it reaches the target vmaf - but 'ab-av1 crf-search" would save a lot of hassle.

I don't know how this would be useful. The internal encoder of jxl already has the option for distance=1, which is THE visually lossless mode like VMAF95.
cjxl --distance=1 --lossless_jpeg=0 inputfile.xxx output.jxl

I don't know how this would be useful. The internal encoder of jxl already has the option for distance=1, which is THE visually lossless mode like VMAF95. cjxl --distance=1 --lossless_jpeg=0 inputfile.xxx output.jxl

It's about vmaf targets that are NOT virtually lossless - I´m using vmaf 85 or 90 to get optimum file size for still reasonable visual loss.

I recommend that you try it out. --distance 2 or --distance 3 really makes small files. -d3 is definitely NOT 97% of original file size, if you have that in mind.

Ok, if you say that xl's distance param is about the same as vmaf then it's not necessary to add it to abc-av1. I faintly remember that vmaf was removed from xl some time ago, maybe that was the reason.

It is not exact the same as VMAF (well, -distance 1 would be VMAF100), but see it from this point: with the example-picture you're with -distance 3 already at ~50% of original file size. Do you see the quality differences between them? If not, you can use -distance 3 for everything.
It is not exactly correct (my guess), but orient yourself like this:
VMAF100=distance 1, VMAF95=distance 2, VMAF90=distance 3 ...etc.
Btw. expecting the picture coming out with -distance 4 at ~400KB it's unlikely that anybody will need/use -distance 5,6,7


Create HelloWOrld.cs

Added a program to print HelloHacktoberfest using C#

@gkanishk - Nice work, thank you! 🙌


[SPARK-50659][SQL] Move Union-related errors to QueryCompilationErrors

What changes were proposed in this pull request?
Move Union-related NUM_COLUMNS_MISMATCH and INCOMPATIBLE_COLUMN_TYPE errors to QueryCompilationErrors.
Why are the changes needed?
To improve the code health and to reuse those in the single-pass Analyzer.
Does this PR introduce any user-facing change?
No.
How was this patch tested?
Existing tests.
Was this patch authored or co-authored using generative AI tooling?
No.

LGTM

thanks, merging to master!


Mention how to configure general Python app

At https://docs.microsoft.com/en-us/azure/developer/python/tutorial-deploy-app-service-on-linux-04 you explain how to configure startup for Django and Flask.
In my case I'd e.g. like to run FastAPI.
Could you please add an example how to start any WSGI or ASGI app, maybe using FastAPI as an example?

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: ca484d54-3c17-221d-f751-b3ae55e0c70d
Version Independent ID: 5c59d1fc-a585-46c5-0cff-d474ded58c04
Content: Step 4: Configure a custom startup file for Python apps on Azure App Service on Linux
Content Source: articles/python/tutorial-deploy-app-service-on-linux-04.md
Product: azure-python
GitHub Login: @kraigb
Microsoft Alias: kraigb

I'd be happy to update the article, but I would need a little help with the details (otherwise it's going to be a low-priority item on my backlog). My experience with WSGI/ASGI matters is somewhat limited.
In general, I would expect you could launch a FastAPI or any other app with gunicorn using the same $(MODULE_NAME):$(VARIABLE_NAME) format as shown for Flask. According to https://docs.gunicorn.org/en/stable/run.html, "The module name can be a full dotted path. The variable name refers to a WSGI callable that should be found in the specified module."
Would that not be the case? I would expect that starting a FastAPI app or something using another framework is going to look similar to what the article shows for Flask. In that case, perhaps all that the article needs here is to generalize the Flask section and mention the bit from the gunicorn docs?

@kraigb  - Thanks for the quick reply!
I'm also new to web development and deployment, so I probably won't be very helpful.

In that case, perhaps all that the article needs here is to generalize the Flask section and mention the bit from the gunicorn docs?

Yes, I think what that is correct. Basically in Python thanks to WSGI one can run most Python web apps in the same way, never mind the framework (Flask, FastAPI, ...).
E.g. note how the equivalent thing is explained here:

https://devcenter.heroku.com/articles/getting-started-with-python?singlepage=true#define-a-procfile
https://docs.aws.amazon.com/elasticbeanstalk/latest/dg/python-configuration-procfile.html

Just now I also found this which has a lot of infos, maybe you could link to there.

https://docs.microsoft.com/en-us/azure/app-service/containers/how-to-configure-python#container-startup-process

But even after that it's still not really clear to me how to me how I can set that command. Is it possible to pass the command directly to the --startup-file option? Or do I always have to put it in startup.txt?
https://docs.microsoft.com/en-us/cli/azure/webapp?view=azure-cli-latest#az-webapp-create
Here's the command that should work with fastapi:
https://fastapi.tiangolo.com/deployment/#alternatively-deploy-fastapi-without-docker

Yes, you can put the command directly into the startup setting; a separate file isn't required, but is generally recommended because it can then be included in the app's source repository rather than being a bit of information that exists only in Azure.
From the links you gave (thank you!), I would think you can just refer to the appropriate module:app for most frameworks other than Django, in which case yes, generalizing this article as well as the how-to-configure-python one (which I also wrote originally), would be more inclusive. I'll put that on my backlog.

Following this and this I tried this startup.txt
gunicorn --bind=<IP_ADDRESS> application:app -w 4 -k uvicorn.workers.UvicornWorker

with a getting started fastapi example application.py
import logging
from fastapi import FastAPI

logging.basicConfig(level=logging.INFO)

app = FastAPI()

logging.info("test1")

@app.get("/")
def read_root():
    logging.info("test2")
    return {"Hello": "World"}

@app.get("/items/{item_id}")
def read_item(item_id: int, q: str = None):
    logging.info("test3")
    return {"item_id": item_id, "q": q}

Getting this error:
/appsvctmp/volatile/logs/runtime/02cc3a0a08b4ccc93b1321a5da88925f720cdb5ade2bd2b29b427184713845de.log
2020-05-06T20:36:21.605028366Z: [INFO]  Using packages from virtual environment antenv located at /antenv.
2020-05-06T20:36:21.610171700Z: [INFO]  Updated PYTHONPATH to ':/antenv/lib/python3.7/site-packages'
2020-05-06T20:36:22.803184886Z: [ERROR]  [2020-05-06 20:36:22 +0000] [41] [INFO] Starting gunicorn 20.0.4
2020-05-06T20:36:22.804109792Z: [ERROR]  [2020-05-06 20:36:22 +0000] [41] [INFO] Listening at: http://<IP_ADDRESS>:8000 (41)
2020-05-06T20:36:22.804515295Z: [ERROR]  [2020-05-06 20:36:22 +0000] [41] [INFO] Using worker: sync
2020-05-06T20:36:22.814369161Z: [ERROR]  [2020-05-06 20:36:22 +0000] [44] [INFO] Booting worker with pid: 44
2020-05-06T20:36:25.148299083Z: [INFO]  <IP_ADDRESS> - - [06/May/2020:20:36:25 +0000] "GET /robots933456.txt HTTP/1.1" 404 232 "-" "-"
2020-05-06T20:39:07.528669765Z: [INFO]  <IP_ADDRESS> - - [06/May/2020:20:39:07 +0000] "GET / HTTP/1.1" 200 0 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_4) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/81.0.4044.129 Safari/537.36"
2020-05-06T20:40:07.675102253Z: [INFO]  <IP_ADDRESS> - - [06/May/2020:20:40:07 +0000] "GET / HTTP/1.1" 304 0 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_4) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/81.0.4044.129 Safari/537.36"
2020-05-06T20:40:09.174358904Z: [INFO]  <IP_ADDRESS> - - [06/May/2020:20:40:09 +0000] "GET / HTTP/1.1" 304 0 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_4) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/81.0.4044.129 Safari/537.36"

/appsvctmp/volatile/logs/runtime/3150ab424b266685b788620ad895c0698a738343adfe3c5ede12ea168b666eb9.log
2020-05-06T21:43:14.658206972Z: [ERROR]  [2020-05-06 21:43:14 +0000] [45] [INFO] Booting worker with pid: 45
2020-05-06T21:43:15.079905797Z: [ERROR]  INFO:root:test1
2020-05-06T21:43:15.119061959Z: [ERROR]  [2020-05-06 21:43:15 +0000] [45] [ERROR] Error handling request /robots933456.txt
2020-05-06T21:43:15.119084460Z: [ERROR]  Traceback (most recent call last):
2020-05-06T21:43:15.119089860Z: [ERROR]    File "/opt/python/3.7.5/lib/python3.7/site-packages/gunicorn/workers/sync.py", line 134, in handle
2020-05-06T21:43:15.119100660Z: [ERROR]      self.handle_request(listener, req, client, addr)
2020-05-06T21:43:15.119104860Z: [ERROR]    File "/opt/python/3.7.5/lib/python3.7/site-packages/gunicorn/workers/sync.py", line 175, in handle_request
2020-05-06T21:43:15.119108860Z: [ERROR]      respiter = self.wsgi(environ, resp.start_response)
2020-05-06T21:43:15.119112760Z: [ERROR]  TypeError: __call__() missing 1 required positional argument: 'send'
2020-05-06T21:43:15.121617477Z: [INFO]  <IP_ADDRESS> - - [06/May/2020:21:43:15 +0000] "GET /robots933456.txt HTTP/1.1" 500 0 "-" "-"

@kraigb  - if you manage to get FastAPI to run, please let me know.

Found this: https://github.com/microsoft/cookiecutter-spacy-fastapi/blob/master/{{cookiecutter.project_slug}}/main.py
Will try tomorrow.

I did manage to run my FastAPI app by putting this in my startup.sh:
python -m uvicorn application:app --host <IP_ADDRESS>

Looks like one can put any startup command one likes in that file, it's just executed like a bash command?
There were two gotchas for me:

When creating the resource, I forgot to declare --startup-file startup.sh, so yesterday while I was trying out things, it was never used.
Just putting uvicorn in requirements.txt means that it'll be installed, but for some reason it won't be on the path. So one has to put python -m uvicorn instead of just uvicorn as command in startup.sh.

I'm so happy it's working!
@kraigb - I think if you do find the time to adjust the tutorial, it'll be really nice for Python devs to learn that they can use any Python web app, not just Flask or Django. Especially for REST APIs, things like FlaskAPI or Django REST framework are really popular, and Azure is a nice way to deploy it, if one can make it over the initial hump to get it to run.

Thanks for reporting back! I'm glad you got it working, and I appreciate the details you've found. With uvicorn, requirements are always installed in a virtual environment and aren't assumed to be executable tools like uvicorn. So python -m is exactly the right answer.
Good note about including --startup-file; that would certainly matter! And yes, you can put any command in the startup file; I think you can even put in multiple lines if needed. In whatever case, I like using the file because you can have it in source control rather than a hard-coded command in the service.
I should have time to update the article in the next week or two. Thanks again!


Does not work for query.

I'm using a simple 'API' (basically just json files) which I query using query. When I go offline there is only a 404 request and no data gets loaded although it seems to be saved to the local storage. Here is how my service looks like:
angular.module('myMod')
    .service('Responses', function ($cachedResource, cacheKey, apiUrl) {
        'use strict';

        return $cachedResource(cacheKey, apiUrl + 'data/responses.json', {id: '@id'});
    });

Do I do something wrong?

Ok the issue was, that I was using the same cacheKey for all my Services.


Updating Teacher Intro

Update code blocks for teacher example on the introductory workflow page

We're using the European employment data instead. This can be closed.


[Request] CSV disk and path configuration

The CSV file location should be more flexible, by specifying a storage disk (s3, etc) and a path.

2.0 allows the creation of custom CSV resolvers to provide more flexibility.


Modification to handle wasm build

Since ahash changed its features set structure, more stuff is required in order to compile for wasm.
[dependencies]
rhai = { version = "1.10.0", default-features = false, features = [ "only_i64", "no_optimize", "internals", "wasm-bindgen" ] }

# getrandom/js must be added manually to make sure it compiles since ahash/runtime-rng requires a random number source
getrandom = { version = "0.2", features = ["js"] }

I'm fixing some of these inconsistencies with the upcoming release, but there doesn't seem to be a way to avoid setting default-features = false so it is breaking for wasm builds.

The ahash problem is resolved now.


Searchlight service

Signed-off-by: Mateusz Blaszkowski<EMAIL_ADDRESS>

Please add information to README that horizon docker image required plugin to use searchlight.


Update some inat table charsets & collations

Changes some iNat table charsets and collations as follows:

Loaded 20241006 snapshot to my local (laptop) db
migrated
committed the changed schema
I hope this will fix the schema differences I keep seeing when I download a db snapshot, then migrate.

coverage: 93.47%. remained the same
when pulling 6b9daf3aaa10ff5315162f08f453967dcf778700 on jdc-inat-import-collation
into 42dd7eb514966678d6c307669bcb108e250f6559 on main.


Toro's Friend Network [PCSA00112]

Game summary

Game name: Toro's Friend Network
Game serial: PCSA00112

Vita3K summary

Version: v0.1
Build number: 311-e4d7a67
Commit hash: https://github.com/vita3k/vita3k/commit/e4d7a67

Test environment summary

Tested by: HorrorTroll
OS: Windows 8.1
CPU: Intel Core i5-4200H
GPU: Nvidia Geforce GTX 950M
RAM: 6 GB DDR3

Issues

No audio. mssing shader
Screenshots

Log
vita3k.log
Recommended labels

Missing shader
Audio bug

Vita3K v0.1.5 2578-9889c472
cannot sign in to the network
vita3k.log

as of https://github.com/Vita3K/Vita3K/commit/4280bea5906fdabf90cbb8493a31cf33c96b0b9b, the game can go to menus in offline before the terms of service screen showed. It crashed on a exception violation.
Screenshots

Logs
vita3k.log
Recommended Labels

Menu
crash

no longer crashes as of https://github.com/Vita3K/Vita3K/commit/ca92b35e3bf2024a1e0b08580a1a65f2f47a3078. Now displays network error and eventually a dialog about network problems (3rd image). Selected the HTTP status to "Online", but still nothing changed.
Screenshots

Logs
vita3k.log
Recommended Labels

Menu
networking bug


Problem with insert menu in IE

Confession: Have noticed this for a while but thought it might just be my setup as not mentioned by anyone else but have just re-tested with latest code and Win 7 IE10 and Win 8.1 IE 11 and same thing on both...
Try inserting a new page to an LO and the 3rd menu panel with buttons and thumbnail either closes or seems to display transparent and moving mouse almost seems to redraw the buttons. I know that sounds like a display issue but two separate machines and OS/IE versions and only seems to happen in IE? Easier explained via a screencast:
https://drive.google.com/file/d/0B4t6SSPcAW7MY3o0QkkxSHdGT2s/view?usp=sharing

This seems to be 'kind-of'fixed when using the latest jquery, but I am not thrilled by that....
I'll check the other IE issues first.

@ronm123 if you inspect the element in the debugger and watch the live html as you hover over the menu item do you see any of the css classes appear and disappear in apparent time to the flickering? It looks very much like a css issue to me but might indeed be causes by jquery doing stuff wrongly in ie

Hi John I'm probably doing it wrong - not sure how to watch the live html?

Yeah, I'm not sure if you can or not in IE, I never use it because I have a mac...
On Chrome though if you open the menu and right click on something and select inspect element then the inpector shows the html of the element. With that in view if you hover back over the webpage view thennyou can often see that the html is having css classes etc switched in and out of the code as you hover over things. I just wondered whether any odd css classes were being switched in, out when it fades away...
Sometimes though you just need to add a tag specifically for ie10 to override one of the other css commands... any screenshots though may be helpful in debugging...
Sorry I can't be more help. If its still there on Tuesday then I'll try to get hold of a windows machine and try ie.

This seems to be fixed by using latest jquery and jquery ui, but not sure we blindly should upgrade to latest jquery

I agree... How many major versions are we moving? They often deprecare stuff in one version then remove in the next... when Dave Goodwin did this last year it broke a number of things that we didnt notice for a while...
That said, this is a major release and if we get to the latest version if jQuery it buys us a lot of time... my only worry would be what else should we/will we need to update on the back of this...
We really need IE working though so it may be only way!!!

From 1.9.1 -> 1.11.3 for jQuery itself,
From 1.10.4 -> 1.11.4 for jQuery UI
Although I must admit, that I didn't try updating jQuery UI only. Will try that first.

That seems to work fine as well, and that's a lot safer....

Sounds good. Once we create 3.0 release we can upgrade everything to latest and then work through issues in dev branch.

Thanks @torinfo I can confirm this fixes the issue on my Win7 IE10.

@torinfo not sure this is directly related or whether to open as a separate issue but have just tested latest code on iPad too and although the issue with display of panels and projects on iPad seems resolved now it seems the insert menu doesn't work on iPad now :-(
Can select insert and choose the page required but the third menu with the buttons and thumbnails etc doesn't open so can't add pages.
Tested on a different iPad too so it's not a caching issue.


Unable to reach cluster on AKS

When I follow instructions to install via helm on either 1.94.3 or 1.94.2 I find the webpage will load, but it is unable to find my cluster. Navigating to /model directly reports a 502 gateway error from nginx. Health check is also failing.
There are no errors in cost model logs. Front-end logs show
2022/06/18 05:58:19 [error] 28#28: *14 open() "/var/www/healthz" failed (2: No such file or directory), client: <IP_ADDRESS>, server: _, request: "GET /healthz HTTP/1.1", host: "<IP_ADDRESS>:9090"
2022/06/18 05:52:51 [error] 24#24: *4 connect() failed (111: Connection refused) while connecting to upstream, client: <IP_ADDRESS>, server: _, request: "GET /model/clusterInfo?req=228790 HTTP/1.1", upstream: "http://<IP_ADDRESS>:9003/clusterInfo?req=228790", host: "<IP_ADDRESS>:9090", referrer: "http://<IP_ADDRESS>:9090

gz#2010(related to Zendesk ticket #2010)

It loaded after 40 readiness failures.


Starfinder (simple) Character sheet

Major edit and rework of the Pathfinder (old) character sheet to provide and simple and useful character sheet for Starfinder RPG.

You've got merge conflicts and I cannot complete the PR. You need to make sure that your local branch is up to date before making changes. You can do this by either pulling from the master branch or deleting and re-forking before you do your work. Please fix these conflicts and reopen the PR and I will merge it.


Packmol with Virtual Sites FF leads to KeyError when writing out interchange gromacs topology

Description
Trying to use Interchange and packmol to write out a solvated gromacs topology.
Using the same code as the minimally reproducible example below but changing out the FF for sage 2.0, 2.1 or 2.2 I have no issues.
I also have no issues if you replace solv_top = solvate_topology(mol.to_topology()) with just solv_top = mol.to_topology().
I believe the issue has to do with the combination of the virutal sites forcefield and packmol.
Reproduction
example-sigma-hole-bromine.offxml.zip
from openff.toolkit import Molecule, ForceField
from openff.interchange.components._packmol import solvate_topology

# create molecule with virtual site
mol = Molecule.from_smiles("CBr")
mol.generate_conformers()

# assign parameters using openff toolkit -> openff interchange

ff = ForceField("openff-2.0.0.offxml", "example-sigma-hole-bromine.offxml")
solv_top = solvate_topology(mol.to_topology())
ic = ff.create_interchange(topology=solv_top)

ic.to_top("cbr.top")
ic.to_gro("cbr.gro")

Output
---------------------------------------------------------------------------
KeyError                                  Traceback (most recent call last)
Cell In[34], line 3
      1 # write out to gromacs with default 5 nm box
----> 3 ic.to_top("cbr.top")
      4 ic.to_gro("cbr.gro")

File ~/mambaforge/envs/openff-toolkit/lib/python3.12/site-packages/openff/interchange/components/interchange.py:493, in Interchange.to_top(self, file_path, hydrogen_mass, _merge_atom_types)
    489 from openff.interchange.interop.gromacs.export._export import GROMACSWriter
    490 from openff.interchange.smirnoff._gromacs import _convert
    492 GROMACSWriter(
--> 493     system=_convert(self, hydrogen_mass=hydrogen_mass),
    494     top_file=file_path,
    495 ).to_top(_merge_atom_types=_merge_atom_types)

File ~/mambaforge/envs/openff-toolkit/lib/python3.12/site-packages/openff/interchange/smirnoff/_gromacs.py:143, in _convert(interchange, hydrogen_mass)
    140 topology_index = particle_map[interchange.topology.atom_index(atom)]
    141 key = TopologyKey(atom_indices=(topology_index,))
    142 vdw_parameters = vdw_collection.potentials[
--> 143     vdw_collection.key_map[key]
    144 ].parameters
    145 charge = electrostatics_collection.charges[key]
    147 # Build atom types

KeyError: TopologyKey with atom indices (1300,)

Software versions

Which operating system and version are you using?

Sonoma 14.2.1 on M1 Mac

How did you install Interchange?

mamba create -n openff-toolkit -c conda-forge openff-toolkit

What is the output of running conda list?

openeye-toolkits          2024.1.0                py312_0    openeye
openff-amber-ff-ports     0.0.4              pyhca7485f_0    conda-forge
openff-forcefields        2024.07.0          pyhff2d567_0    conda-forge
openff-interchange        0.3.28             pyhd8ed1ab_0    conda-forge
openff-interchange-base   0.3.28             pyhd8ed1ab_0    conda-forge
openff-models             0.1.2              pyhca7485f_0    conda-forge
openff-toolkit            0.16.2             pyhd8ed1ab_0    conda-forge
openff-toolkit-base       0.16.2             pyhd8ed1ab_0    conda-forge
openff-units              0.2.2              pyhca7485f_0    conda-forge
openff-utilities          0.1.12             pyhd8ed1ab_0    conda-forge
openmm                    8.1.2           py312hacce00b_2_khronos    conda-forge

Thanks for the thorough reproduction - this is legit and I can reproduce this on my machine as well.

This should be included in 0.3.29 - please let me know if something looks fishy


[Bug] macos，dmg客户端更新为2.15.6，azure接口无法使用

📦 部署方式
官方安装包
📌 软件版本
2.15.6
💻 系统环境
macOS
📌 系统版本
12.6.3
🌐 浏览器
Other
📌 浏览器版本
0
🐛 问题描述
您好，非常谢谢您的工作。
我更换api接口的时候，出现了"message": "empty response from server"的问题。
📷 复现步骤
修改前可用的api接口设置为:

服务商:azure
接口： https://xxx.openai.azure.com/openai/deployments/gpt4o
接口版本: 2023-03-15-preview
自定义模型：gpt4o
选择模型:gpt4o。

使用curl测试成功api接口：
curl https://kehua-m2ymeoeu-eastus2.openai.azure.com/openai/deployments/gpt4o/chat/completions?api-version=2024-08-01-preview \
  -H "Content-Type: application/json" \
  -H "api-key: xxxxx" \
  -d '{"messages":[{"role": "system", "content": "你是谁？"}]}'

根据接口，按照上面方法在2.15.6版本进行设置，依次为

服务商: azure
接口：https://kehua-m2ymeoeu-eastus2.openai.azure.com/openai/deployments/gpt4o
接口版本：2024-08-01-preview
自定义模型：gpt4o
选择模型：gpt4o
运行结果为：

{
  "error": true,
  "message": "empty response from server"
}

我测试了非常多的方法，依旧无法顺利进行chat，请问应该如何设置？
是否有debug模式，可以看到发送的url地址，谢谢。
🚦 期望结果
无
📝 补充信息
无

#5001

把接口改成 https://kehua-m2ymeoeu-eastus2.openai.azure.com/openai

把接口改成 https://kehua-m2ymeoeu-eastus2.openai.azure.com/openai

Hello, thank you for your suggestion.
I change the interface as your said, but it report another error.
The configuration of NextChat:

Interface: https://kehua-m2ymeoeu-eastus2.openai.azure.com/openai
key: from azure
azure api version: 2024-08-01-preview
custom model: gpt4o

The error report:
{
  "error": true,
  "message": "empty response from server"
}

Your configuration is false by current code logic.
Please follow my steps below:

make sure your deployment name as gpt-4o

from the setting, leave the custom models as blank, setup model as gpt-4o(azure), summary model as gpt-4o(azure)

Your configuration is false by current code logic. Please follow my steps below: 0. keep your endpoint as ending with "/openai"

make sure your deployment name as gpt-4o

from the setting, leave the custom models as blank, setup model as gpt-4o(azure), summary model as gpt-4o(azure)

Thank you so much for your advice, the interface finally work. I wonder to known that it is possible use different interface at some time. For example, I configure gpt4-o--> 2024-08-01-preview and gpt-35-turbo --> 0301. How can i modify the configuration(azure api version,custom model) for different model ? Thank you so much.

I don't actually contribute to this project. But I leveraged this project and modified the code a bit for my personal usage. So from my perspective, you are unable to specify different configurations for different models at the same time. If you still want to do so, you may need to download the source code and modify it by yourself.


Revert "Revert "back to original""

[APPROVALNOTIFIER] This PR is NOT APPROVED
This pull-request has been approved by:
To complete the pull request process, please assign salaboy
You can assign the PR to them by writing /assign @salaboy in a comment when ready.
The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

OWNERS

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

[APPROVALNOTIFIER] This PR is NOT APPROVED
This pull-request has been approved by:
To complete the pull request process, please assign salaboy
You can assign the PR to them by writing /assign @salaboy in a comment when ready.
The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

OWNERS

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

:star: PR built and available in a preview environment salaboy-fmtok8s-api-gateway-pr-10 here


New version: Tencent.QQ version <IP_ADDRESS>280

This pull request is automatically generated by 🥟 Dumplings in #2992
Microsoft Reviewers: Open in CodeFlow

12/29/2023 9:16:25 AM
Installer Verification Analysis Context Information:
Installer https://dldir1v6.qq.com/qqfile/qq/PCQQ9.7.21/QQ<IP_ADDRESS>280.exe
Scan request id: 'b73a82f6-8afa-45f1-aca1-839a0e46b861'
Error information: BlockingDetectionFound


[WIP] Task tracking

What is this PR trying to achieve?
We want to be notified of tasks that fail, this PR will provide a dynamo table from which that stream of events can emanate.
Who is this change for?
💻
Have the following been considered/are they needed?

[ ] Deployed new versions
[ ] Run terraform apply.

For https://github.com/wellcometrust/platform/issues/1005

Doesn't update properly when the item already exists.

Closing as not needed.


Question: documentation of new user_type registration

Hi, first thanks a lot for sol3!
I'm currently updating my code from sol2 to sol3 and I'm especially making use of the new user_type implementation being just a regular metatable, as mentioned here: https://thephd.github.io/sol3-feature-complete, so you don't have register everyhing inside the new_usertype<Foo> call.
The code examples in the examples/ folder already make use of this (showing both the old and new way) but it doesn't really show up in the official docs, see for example: https://sol2.readthedocs.io/en/latest/tutorial/cxx-in-lua.html
From what I understand, one should generally prefer the new way (unless the class is very small) to reduce compile times and there is no difference in runtime speed, but this doesn't seem to be mentioned anywhere in the docs.
Also, I've stumbled across the following warning in https://sol2.readthedocs.io/en/latest/usertypes.html:

Note that to use many of sol3’s features, such as automatic constructor creation, sol::property, and similar, one must pass these things to the usertype as part of its initial creation and grouping of arguments. Attempting to do so afterwards will result in unexpected and wrong behavior, as the system will be missing information it needs. This is because many of these features rely on __index and __newindex Lua metamethods being overridden and handled in a special way!

Is this still true?
Best, Christof

Oh, that's no longer true. Gotta blow up that warning.
.... But it's writing docs aaaaaahhh....... I can feel it. The laziness, sinking into my bones, even as I open up the editor... !

thanks!

.... But it's writing docs aaaaaahhh.......

I feel you :-)

Fixed. https://github.com/ThePhD/sol2/releases/tag/v3.0.3


feat/FAT-723 Provide support for CLS graphical assets on LLD

📝 Description
Remove the placeholder graphical assets for the custom lockscreen flows and integrate the lotties and frames like on LLM. Also introduces a tool for testing these assets without having to go through the normal flow.
❓ Context

Impacted projects: ledger-live-desktop
Linked resource(s): https://ledgerhq.atlassian.net/browse/FAT-723

✅ Checklist

[ ] Test coverage
[ ] Atomic delivery
[x] No breaking changes

📸 Demo

https://user-images.githubusercontent.com/4631227/219055028-b8fd1f27-19c9-4c72-9de6-1d528247e37d.mov

🚀 Expectations to reach
Please make sure you follow these Important Steps.
Pull Requests must pass the CI and be internally validated in order to be merged.

/generate-screenshots


Slack website is down

I'm trying to join the Apex Slack workspace, but I get the message that the website is down ("403 - This web app is stopped").

Ah bummer I'll fix that soon. I heard something about Slack having official invite page support or something too, need to look into it :D

Great!! 🙂
On Fri, Sep 22, 2017, 17:28 TJ Holowaychuk<EMAIL_ADDRESS>wrote:

Ah bummer I'll fix that soon. I heard something about Slack having
official invite page support or something too, need to look into it :D
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/apex/up/issues/344#issuecomment-331479687, or mute
the thread
https://github.com/notifications/unsubscribe-auth/AARK1_X6qLuPy1rmIFngcliNGthaWxG5ks5sk9ISgaJpZM4Pgrq-
.

Up seems great so far btw, just started using it!
On Fri, Sep 22, 2017, 17:30 Arve Knudsen<EMAIL_ADDRESS>wrote:

Great!! 🙂
On Fri, Sep 22, 2017, 17:28 TJ Holowaychuk<EMAIL_ADDRESS>wrote:

Ah bummer I'll fix that soon. I heard something about Slack having
official invite page support or something too, need to look into it :D
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/apex/up/issues/344#issuecomment-331479687, or mute
the thread
https://github.com/notifications/unsubscribe-auth/AARK1_X6qLuPy1rmIFngcliNGthaWxG5ks5sk9ISgaJpZM4Pgrq-
.

https://apex-slackin.herokuapp.com/ should work!

Great, works perfectly! Thank you!
On Fri, Sep 22, 2017, 18:32 TJ Holowaychuk<EMAIL_ADDRESS>wrote:

https://apex-slackin.herokuapp.com/ should work!
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/apex/up/issues/344#issuecomment-331496356, or mute
the thread
https://github.com/notifications/unsubscribe-auth/AARK19a6nh5IJktEzqL90ypXcJxOVCkRks5sk-EvgaJpZM4Pgrq-
.

i figured you'd dogfood up and host slackin with it :P

too lazy to chance it with node apps haha, who knows it if it builds correctly

This is also down:


Refactor for bundling

Bundling. Because some components fetch their styling/html from external files, this is not trivial. Trying to provide completely bundled versions, where the bundle includes de css and html (full, self containing).
Not sure if it's needed. We'll see.

Ok,  a lot of path misery whilst rewriting files on build, but all seems to work.


Add global:: to generated models

First of all; thanks for creating this nice tool, it's great :-)
I ran into an issue with the default umbracoFile property inside the generated Image class:
///<summary>
/// Upload image
///</summary>
[ImplementPropertyType("umbracoFile")]
public Umbraco.Web.Models.ImageCropDataSet UmbracoFile
{
	get { return this.GetPropertyValue<Umbraco.Web.Models.ImageCropDataSet>("umbracoFile"); }
}

We have used the namespace 'Infocaster.Umbraco' a lot and so the compiler thinks Umbraco.Something means Infocaster.Umbraco.Something.
To fix this we need global::Umbraco.Something. Could you add this to the generated models?

Mmm... weird: we do have some code that manages "ambiguous symbols" and is supposed to prepend global:: to types that would otherwise be ambiguous. Can you give me the entire list of 'using' clauses that come at top of the generated file?

using System;
using System.Collections.Generic;
using System.Linq.Expressions;
using System.Web;
using Umbraco.Core.Models;
using Umbraco.Core.Models.PublishedContent;
using Umbraco.Web;
using Umbraco.ModelsBuilder;
using Umbraco.ModelsBuilder.Umbraco;

Wondering why the compiler would thing Umbraco.Something is Infocaster.Umbraco.Something if there is no using clause for Infocaster - how would the compiler know about it? (or am I missing something obvious)?

I think because I'm inside the namespace 'InfoCaster.Something' ;-)

Aha - probably overlooked that one. So your models' namespace would be eg Infocaster.Models, right? OK, looking into it.

Exactly :-) Great!

Reproduced, fixed in 3.0.1.

Thanks, nice work! :+1:


Failed to handle 403 Forbidden error on config server composite setup

Describe the bug
I have 3 configurations for the vault repository and 1 for git setup under spring.cloud.config.server.composite.*. Client microservice passes multiple profiles while invoking the config server. The flow goes as below.
public class CompositeEnvironmentRepository implements EnvironmentRepository {
public Environment findOne(String application, String profile, String label, boolean includeOrigin) {
		Environment env = new Environment(application, new String[] { profile }, label, null, null);
		if (this.environmentRepositories.size() == 1) {
			Environment envRepo = this.environmentRepositories.get(0)
				.findOne(application, profile, label, includeOrigin);
			env.addAll(envRepo.getPropertySources());
			env.setVersion(envRepo.getVersion());
			env.setState(envRepo.getState());
		}
		else {
			for (EnvironmentRepository repo : environmentRepositories) {
				try {
					env.addAll(repo.findOne(application, profile, label, includeOrigin).getPropertySources());
				}
				catch (Exception e) {.  // ****************EXCEPTION GET CAUGHT HERE****************
					if (failOnError) {
						throw e;
					}
					else {
						log.info("Error adding environment for " + repo);
					}
				}
			}
		}
		return env;
	}

}
public abstract class AbstractVaultEnvironmentRepository implements EnvironmentRepository, Ordered {
  @Override
 public Environment findOne(String application, String profile, String label) {
				if (ObjectUtils.isEmpty(profile)) {
					profile = DEFAULT_PROFILE;
				}
				if (ObjectUtils.isEmpty(label)) {
					label = defaultLabel;
				}

			var environment = new Environment(application, split(profile), label, null, getWatchState());

			var profiles = normalize(profile, DEFAULT_PROFILE);
			var applications = normalize(application, this.defaultKey);

			for (String prof : profiles) {
				for (String app : applications) {
					var key = vaultKey(app, prof, label);
					// read raw 'data' key from vault
					String data = read(key); // EXCEPTION GET PROPOGATE HERE AND ENTIRE LOOP IS SKIPPED INSTEAD OF CONTINUE
					if (data != null) {
						// data is in json format of which, yaml is a superset, so parse
						var yaml = new YamlPropertiesFactoryBean();
						yaml.setResources(new ByteArrayResource(data.getBytes()));
						var properties = yaml.getObject();

						if (properties != null && !properties.isEmpty()) {
							environment.add(new PropertySource("vault:" + key, properties));
						}
					}
				}
			}
			return environment;
	}

}
public class SpringVaultEnvironmentRepository extends AbstractVaultEnvironmentRepository {
protected String read(String key) {
		VaultResponse response = this.keyValueTemplate.get(this.path + key); // 403 EXCEPTION NOT HANDLER HERE
		if (response != null) {
			try {
				return objectMapper.writeValueAsString(response.getData());
			}
			catch (JsonProcessingException e) { // BUG HERE
				throw new RuntimeException("Error creating Vault response", e);
			}
		}
		return null;
	}
}

}
abstract class VaultKeyValueAccessor implements VaultKeyValueOperationsSupport {
	@Nullable
	    <T> T doRead(Function<RestOperations, ResponseEntity<T>> callback) {
	        return (T)this.vaultOperations.doWithSession((restOperations) -> {
	            try {
	                return ((ResponseEntity)callback.apply(restOperations)).getBody();
	            } catch (HttpStatusCodeException e) {
	                if (HttpStatusUtil.isNotFound(e.getStatusCode())) { // RETURN NULL ONLY FOR NOT FOUND ERROR
	                    return null;
	                } else {
	                    throw VaultResponses.buildException(e, this.path);  // THROWS EXCEPTION FOR OTHER
	                }
            }
        });
	}

}
Sample
Whenever a 403 Forriben error is sent, SpringVaultEnvironmentRepository-> read() couldn't handle it as it only handles JsonProcessException. This issue is causing a loss of the response received from the earlier executed repository. Can be reproduced on the latest version of the below jars

org.springframework.cloud
spring-cloud-config-server
4.2.0

org.springframework.cloud
spring-cloud-starter-vault-config
4.2.0

See the notes on failures when using a composite environment repository here.
https://docs.spring.io/spring-cloud-config/reference/server/environment-repository/composite-repositories.html
You can set a property to allow things to continue when one environment repository has a failure.

Yes, this flag is already set to false spring.cloud.config.server.failOnCompositeError to false. The client doesn't get an error response, but the response is partially missing.

Can you provide a complete, minimal, verifiable sample that reproduces the problem? It should be available as a GitHub (or similar) project or attached to this issue as a zip file.

If you would like us to look at this issue, please provide the requested information. If the information is not provided within the next 7 days this issue will be closed.

Closing due to lack of requested feedback. If you would like us to look at this issue, please provide the requested information and we will re-open the issue.


Failure to launch, loadConfigFile error

Seemingly out of nowhere MercuryTrade stopped launching correctly. Here is the error from app.log:
2017-05-18 00:42:21.772 [main] ERROR com.mercury.platform.shared.ConfigManager - Error in loadConfigFile:
org.json.simple.parser.ParseException: null
	at org.json.simple.parser.JSONParser.parse(JSONParser.java:257) ~[MercuryTrade.jar:?]
	at org.json.simple.parser.JSONParser.parse(JSONParser.java:92) ~[MercuryTrade.jar:?]
	at com.mercury.platform.shared.ConfigManager.loadConfigFile(ConfigManager.java:177) [MercuryTrade.jar:?]
	at com.mercury.platform.shared.ConfigManager.load(ConfigManager.java:171) [MercuryTrade.jar:?]
	at com.mercury.platform.core.AppStarter.startApplication(AppStarter.java:41) [MercuryTrade.jar:?]
	at com.mercury.platform.AppMain.main(AppMain.java:20) [MercuryTrade.jar:?]

Full app.log, app-config.json, and configuration.json files:
MercuryTrade.zip
It seems that app-config got corrupted somehow? Dunno. I fixed it by just deleting the two config files but figured it might be of some use to make an issue for it.

At the moment I'm very busy but I recently started to rewrite the configuration code, and possibly may appear such bugs, I'm glad you were able to decide for himself. Thanks for report


Out-of-bound exception on MacOS dylib binaries

Hi,
I have found that these https://github.com/Vector35/workflow_objc/blob/master/Core/AnalysisProvider.cpp#L22-L23 two analyzers raise out-of-bound exceptions.
Used LaunchServices binary extracted using https://github.com/keith/dyld-shared-cache-extractor from arm64 cache.
Will dig into it tomorrow and update the ticket.

The output of that tool is not valid/parseable objc and can't be supported in this tool

The output of that tool is not valid/parseable objc and can't be supported in this tool

I see, in my case if was interested to parse cfstrings, and disabling SelectorAnalyzer/ClassAnalyzer helped there.
You could close it in case it's intended behaviour.


non-linear increase of computation time for AssociateGitLogJob with increasing number of commits

When submitting a large project with many commits to coderadar, the AssociateGitLogJob runs longer for each commit until it is unacceptably long.
Analyze the cause of this.

also see comment from pschild on issue #117.
I tested it, too, with junit4 with the result that the file association indeed took longer the more data was in the database. However at the end it took only 3 seconds for each commit, which is acceptable in my opinion, since it should only be done once for each repo.
30 seconds as measured by @pschild is not acceptable, however. That may be caused by different hardware. What database did you use?
The most time-consuming step is inserting the unchanged files for each commit at CommitToFileAssociator#associateWithUnchangedFiles(). We should check http://blog.jhades.org/performance-tuning-of-spring-hibernate-applications/ for some improvements when doing a lot of inserts into the database.

I ran the test with junit4 again, but this time I used a different MySQL database: in the first run, I used a MySQL on a webserver (XAMPP and phpMyAdmin) - now I used a MySQL 5.7.15 which I installed on my Windows machine (without a webserver). The performance is much better now, it took only 3 secs/commit at the end for me as well.

This should be fixed with the switch to Neo4j. Evaluate again after the switch.

AssociateGitLogJob is no longer in the project after the refactoring. The size of the project now lineary increases the save/computation time.


dotnet core 3 support

I did some testing and this library works seamlessly (in my limited use cases) with dotnet core 3.  I had updated the library and multi targeted it so it supported by the .NET Framework 4.x versions and dotnet core 3.
If you have interest I can put a pull request in for your review if that's something you want to support.

I've updated the library project for .NET Core 3 / .NET 4.6.1 (leaving the old Framework target for 4.5.2 in place also).  I additionally added a .NET Core 3 WPF demo project that's identical to the original demo project but using the new bits.  I've put a pull request with these changes for your review if you find them acceptable.
https://github.com/MrDaedra/WPFSplitView/pull/2


New-RsFolder Description

Do you want to request a feature or report a bug?
Feature
What is the current behavior?
The property value for new-rsfolder is set to $null. Adding descriptions would be useful.

Sounds like a great improvement, I would like to invite you to send a pull request with the modification

In attempting to do this, I'm running into the following issue:

New-RsWebServiceProxyHelper : The term 'New-RsWebServiceProxyHelper' is not recognized as the name of a cmdlet

I'm unable to find any reference to this cmdlet anywhere.

Did you check the instructions for local development under Local Testing and Development

I'm failing miserably at getting things to work in my favor. This is the code I've been using to add descriptions using the API.
    $Proxy = New-WebServiceProxy -Uri $RSUri -UseDefaultCredential     $type = $Proxy.GetType().Namespace     $datatype = ($type + '.Property')     $property = New-Object ($datatype);     $property.Name = "Description"     $property.Value = $Description     $Proxy.CreateFolder($name, $path, $property)

Hi cruncyguy,
I think either you pasted the code incorrectly or you simply need to use some the ENTER key and you are all set.

It doesn't format correctly with line breaks

Noticed this issue was a little stale, so I submitted a PR with some code based off of another cmdlet in this module with a Description parameter.


List docs clarification: does .mdl-list__item-secondary-content do anything?

On this page: http://www.getmdl.io/components/#lists-section
it's not clear exactly what "secondary" classes are required, or what they do.
In the "Avatars and actions" example, one example has  around the secondary actions, and the other two have  directly under the
.
The table of "Configuration Options" at the end isn't terribly helpful, either:

".mdl-list__item-secondary-content" -> "Defines the secondary content sub-division"
".mdl-list__item-secondary-info" -> "Defines the information sub-division"
".mdl-list__item-secondary-action" -> "Defines the Action sub-division"

Can I just use ...-secondary-info or ...-secondary-action on their own?  Does ...-secondary-content do anything?

The doc is incorrect. It says the secondary content/action requires 2 or 3 lines, but its not the case.
About the missing secondary-content in one of the demos, I think it's an oversight (based on what I see in the css).

The examples are also not as helpful as they could be, because

they only show single actions, which misses out the concept that secondary-action seems to be a container for all the secondary actions, not a single one
they don't use actual buttons, making them have that bright coloring that isn't seen in many places that use secondary actions

Here's something I managed to put together, that looks a bit more like the gmails and inboxes and whatnot:

                            person
                            John Doe

                            <button class="mdl-button mdl-button--icon mdl-js-button">
                              done
                            </button>
                            <button class="mdl-button mdl-button--icon mdl-js-button">
                              delete
                            </button>


ci: Add slack notification step to GH actions

Please merge this after https://github.com/cilium/cilium-cli/pull/212 is merged, this will probably end up having conflicts, and 212 had it's share of them.
This change is pretty similar to https://github.com/cilium/cilium/pull/16218

Marking as draft until https://github.com/cilium/cilium-cli/pull/212 is merged. Please leave draft mode if you want reviews even before https://github.com/cilium/cilium-cli/pull/212 is merged.

test-gke

This code should be covered by @cilium/ci-structure and @cilium/github-sec. I'm a part of both, so marking as ready to merge.


[Text Translation] Add support for mocking models via a model factory

I noticed that the client library currently does not have a model factory. Here is more information about what this is and the requirements involved as per our guidelines:
🔗 .NET Azure SDK Design Guidelines | Azure SDKs
The expectation is that the model factory is automatically generated by the emitter, but I see that there is this open issue in the autorest.csharp repo:
🔗 Generate ModelFactory for mocking, from Cadl · Issue #2461 · Azure/autorest.csharp (github.com)
In other words, this is not specific to Text Translation; all the client libraries generated from TypeSpec (e.g. OpenAI) are on the same boat. So I talked with @m-nash, and we discussed the possibility of hand-writing the model factory versus auto-generating it once the issue mentioned above is resolved. His recommendation below:

"I think we can hand write this but probably shouldn't GA with the model factory until the generator handles it so we don't accidentally end up with incorrect signatures.  The dependent issues linked in issue #2461 deal with some consolidation work in model generation that is happening right now so that there are no differences for each library type.  Once this is done we will get model factory generation for free.  This work is changing the signatures which is where we could run into issues for GA."

@ArcturusZhang I believe this is dependent on your consolidation work you are doing can you list what issues need to go in first and track this as closure once its all done?

As part of this are we updating all current DPG SDKs too?

@pallavit yes turning this on should be for everyone.  I believe only DPG is off right now due to the consolidation work will let @ArcturusZhang reply with details.

@joseharriaga Hi sorry I just notice this issue.
Now Azure.AI.Translation.Text has a model factory. Therefore I believe this has been resolved.

You're correct, @ArcturusZhang! Thank you!


Enhanced spotlight volume

Added basic support for light shafts or god-rays for spot-lights.
Created a duplicate pillars scene for light-shafts.

Hi Videep! Apologies for the late reply. Thanks again for making this pull request.
So, in principle, a spot light already can create light shafts like that. Lights shafts are just a consequence of the light an it's shadowmap.
However, as the shadowmaps on spotlights can be quite finnicky, it does seem like this custom approach can create higher quality lightshafts in some cases - so I'm open to including this. However, some general notes:

I think "LightShaft" is a confusing name. I think VaporCustomLight would be better. In fact, would it maybe not even be possible to just add a custom ShadowMap field to existing VaporLight? Or am I missing something about the funcionality here of this class? Let me know what you think!
It's not really appropriate to change code style in pull request, please leave tangential code untouched.
Please keep pull requests to do one thing, don't include misc bug fixes

I've left some details in the actual review. I know it's a lot of comments, not meant to be discouraging at all, but figured it's a good oppurtunity to show some stuff I frequently see come up in code reviews! Best of luck, thanks :)

Hi Videep, Thanks for making those changes! Def thinks it looks more solid now. There's some issues left here and there but I'll adress those in a few commits after this - easier that way; but keep an eye out for them!


Search filter with comma

Hi,
I perform an LDAP search with:
Filter filter = Filter.equals("roleOccupant", userDN);
await connection.search(setting.groupDN, filter, attrs);

Everything works fine, except if the userDN contains a comma, e.g.:
cn=Markus Proeller,ou=people,dc=pieye,dc=org   works
cn=Testuser, test,ou=people,dc=pieye,dc=org  doesn't work.
I have already tried some escaping:
cn=Testuser\, test,ou=people,dc=pieye,dc=org
cn=Testuser\5c, test,ou=people,dc=pieye,dc=org
cn=Testuser\2c test,ou=people,dc=pieye,dc=org
Nothing worked. Do you have any hint?

Not sure..
When you say "not works", does it throw an error, or just return 0 results?  Can you confirm the exact same search works with a cli tool, say ldapsearch.
I assume this is Windows Active Directory?

Relevant?
https://stackoverflow.com/questions/49177729/how-to-use-a-dn-containing-commas-as-the-attribute-value-in-an-ldap-search-filte

I think the sdk is not properly escaping the string.  I'll take a look at it.
This discussion is relevant:  https://github.com/pingidentity/ldapsdk/issues/10

Not sure.. When you say "not works", does it throw an error, or just return 0 results? Can you confirm the exact same search works with a cli tool, say ldapsearch.

With ldapsearch it works when escaping the comma with \5c,
The entry looks like:
# admin, leakageRoles, pieye.org
dn: cn=admin,ou=leakageRoles,dc=pieye,dc=org
cn: admin
objectClass: organizationalRole
objectClass: top
roleOccupant: cn=Markus Proeller,ou=people,dc=pieye,dc=org
roleOccupant: cn=Test\2C TestUser,ou=people,dc=pieye,dc=org

With the following ldapsearch filter I get the entry:
(roleOccupant=cn=Test\5c, TestUser,ou=people,dc=pieye,dc=org)

I assume this is Windows Active Directory?

The example above is with an OpenLDAP server (https://hub.docker.com/r/bitnami/openldap). We have a customer who has Active Directory who is facing the same problem.
Please also note, that when I use the query function, I get a filter error:
var searchResult = await connection.query(setting.personDN, r"(roleOccupant=cn=Test\5c, TestUser,ou=people,dc=pieye,dc=org)", attrs);
flutter: error Cant parse filter '(roleOccupant=cn=Test\5c, TestUser,ou=people,dc=pieye,dc=org)'. Error is ")" expected

OK - I think I'm getting a handle on the issue. It's not going to be a quick fix, as some things need to be refactored.
Per that java example, escaping in DNs is not the same as escaping in search strings.   The best solution is to properly implement DN and RDN code as right now they are basically treated as plain old Dart strings.

There's some ancient (but the logic's OK) filter parsing code at https://github.com/ForgeRock/opendj-community-edition/blob/master/src/server/org/opends/server/types/SearchFilter.java

I pushed  0.7.3-dev.1 to pub. This is a band-aid to get you a bit further.  Query still does not work, but this does:
 test('search for role with escaped comma using equals', () async {
    final userDN = r'cn=fred\2c smith,ou=users,dc=example,dc=com';
    final dn = 'cn=adminRole,dc=example,dc=com';
    final filter = Filter.equals("roleOccupant", userDN);

    var r = await ldap.search(dn, filter, []);
    await for (final e in r.stream) {
      print(e);
    }
  });

Note this is done by NOT escaping the backslash. So if you have legit backslashes in the directory, this will cause problems.
The proper fix is more involved - so I'll keep this open for now.

There's some ancient (but the logic's OK) filter parsing code at https://github.com/ForgeRock/opendj-community-edition/blob/master/src/server/org/opends/server/types/SearchFilter.java

4300 lines of code to parse a string. Man I love ldap 🤦

@Coimbra1984  I think I fixed filters with a backslash with 0.7.3.  You should be able to do
(roleOccupant=cn=Test\5c, TestUser,ou=people,dc=pieye,dc=org)
can you try it and LMK.

@Coimbra1984 I think I fixed filters with a backslash with 0.7.3. You should be able to do
(roleOccupant=cn=Test\5c, TestUser,ou=people,dc=pieye,dc=org)
can you try it and LMK.

Hi, I can confirm, that 0.7.3 works!