Remove FFaker gem

Since Solidus 2.7 does not need ffaker gem anymore
and Solidus 2.6 will not be supported from 2019.12.16 (see here), we should remove it.

Agreed, we should remove FFaker once we update the orb to build with Solidus 2.7+.


question: status bar explanation

Would you be able to provide info on what the status bar data means? Thanks.
Example:

It should be intuituve I guess. ;-)

Updated the bar. Does it make sense now? Also added an explanation to the readme.

Great. Makes perfect sense now!! Thanks!


Array validation function is getting a nuimber instead of an array

Bug Report
When an array is nested in a tab, validation is broken while creating/editing.
The array value is passed as a number probably its size.
If this is a real issue, it might trigger a breaking change with its fix
Steps to Reproduce
There is a demo repo where this is reproduced.
navigate to http://localhost:3300

Have a top-level Tab structure
Have an Array as a field in a Tab
Have a dummy field inside the array
The array validation gets a value of either undefined/(potentially array size as number)

Other Details
Payload v1.4.1
Firefox v108.0

Hey @ahmedHusseinF — this is indeed deliberate. The array field itself validates based on how many rows it has, although we could potentially update this in the future like you've mentioned.
In the meantime, the validate field does indeed accept siblingData as a prop, so you should be able to access the data for the entire array and still write a custom validation function that is based on the array's data in its entirety.
Would that solve for what you're looking to do? I will bump this over to a feature request and we can keep the conversation going there!


Improve commands

What changes?

Change namespace Console to Commands
Use beautiful command components
Instead return 0, 1 we return constant FAILURE, SUCCESS from base extend class

Before:

After:

Before:

After:

I don't think it's wise to use the $components property as it's marked as @internal. While I would probably be fine using this in a project, I don't think it's wise to do the same in a library like this.
Also, the fresh Artisan look wasn't introduced until Laravel 9.21, which means this will not be backward compatible with older Laravel versions that are supported by this package.

Hey thanks @datlechin and @rojtjo! That's super helpful.
@datlechin would you mind updating this PR to only include the namespace fixes, method return types, and improved responses, but remove the components stuff? 🙏

@datlechin Thanks!


Show Testbed Activity on Portal Homepage

Testbed Activity
UI -> merged to Resources:

Hover on a site -> show site data;
Not hover on a specific site -> show overall testbed activity data.

Data: comes from a file re-generated periodically.

The requirements are updated as: add a dynamic metric box on Portal homepage to show overall testbed activity.


[Feature] - Allow more control over core logging to file/syslog

It would be useful to have the ability to define/control the log level of JIMIs daemons and have that log to file with built in log rotations and/or log to remote syslog servers. Such as logging just severe errors to file will help debug core/custom plugin failures.

Logging level can be set by changing jimi_core.py

Agreed that it would be great to add some CLI options to control these settings

@z1pti3 We should probably also look at building in some UI log settings in the admin page? We can then add some nice features around this like exporting logs/dumps when raising bugs etc.

That would be great so you can turn it up and download without having to modify the code :)


Problems generating the Hello-World-Project von ESP32

@tensorflow/micro
System information

Host OS Platform and Distribution (e.g., Linux Ubuntu 16.04): Linuxmint in VirtualBox
TensorFlow installed from (source or binary): viva git clone https://github.com/tensorflow/tensorflow.git
Tensorflow version (commit SHA if source):
Target platform: ESP32

Describe the problem
Hello guys,
I can't generate projects for ESP32 using make. If  I run:
make -f tensorflow/lite/micro/tools/make/Makefile TARGET=esp generate_hello_world_esp_project
I get:
tensorflow/lite/micro/tools/make/Makefile:418: warning: overriding recipe for target 'tensorflow/lite/micro/tools/make/downloads/person_model_int8'
tensorflow/lite/micro/tools/make/Makefile:418: warning: ignoring old recipe for target 'tensorflow/lite/micro/tools/make/downloads/person_model_int8'
tensorflow/lite/micro/tools/make/Makefile:378: tensorflow/lite/micro/tools/make/targets/esp_makefile.inc: No such file or directory
make: *** No rule to make target 'tensorflow/lite/micro/tools/make/targets/esp_makefile.inc'. Stop.
Maybe this issue is alrady fixed:
https://github.com/tensorflow/tensorflow/pull/44316
If this is so, a big "Thank you!" do the person how did this!
Where do I get the fixed version? (Sry, I'm new to this topic)
Thank you for all attempts!
Please provide the exact sequence of commands/steps when you ran into the problem
make -f tensorflow/lite/micro/tools/make/Makefile TARGET=esp generate_hello_world_esp_project
after clone git:
git clone https://github.com/tensorflow/tensorflow.git

I tried out the Fix attempted of https://github.com/tensorflow/tensorflow/pull/44316 but it has the same error.
I changed tensorflow/lite/micro/tools/make/targets/esp32_makefile.inc to tensorflow/lite/micro/tools/make/targets/esp_makefile.inc
annd the containt of the Makefile from:
Settings for Espressif ESP32
ifeq ($(TARGET), esp)
TARGET_ARCH := xtensa-esp32
CCFLAGS := $(filter-out -std=c11,$(CCFLAGS))
CFLAGS += -std=c11
endif
to:
Settings for Espressif ESP32
TARGET_ARCH := xtensa-esp32
CCFLAGS := $(filter-out -std=c11,$(CCFLAGS))
CFLAGS += -std=c11
So that doesn't help me. But that file could be the problem, it is defintily named wrong.
Greetings,
Jan

@Jan08
Please refer to this comment and let us know if it helps, a;so please let us know the tf version used.

Hi,
I followed the Link nur that has no solution...
The Problem is realy Connect to: https://github.com/tensorflow/tensorflow/pull/44316
The Makefile is Named esp32_makefile.inc
Mit esp_makefile.inc,  Like the Error response to.
But simply rename it dont fix the Problem.
Greetings

Hello again...
Did you solve your problem?
Update TensorFlow repo to newest and try the build.
It might be that simply picking up the fix doesn't work on some particular commit.
Also, can you please share new logs that you see?

This is still a problem in v2.4.0-rc1 that was just created.  Is a new bug report required to get it fixed in 2.4 before final 2.4 release?  I am manually renaming the .inc file to keep working but prefer it be checked in properly to the repo. Thanks.

Hello, I've just checked with version 2.5.0 and ci_build/test_esp32.sh. I got :
tensorflow/lite/micro/tools/ci_build/helper_functions.sh: line 31: ./install.sh: No such file or directory
IDF_PATH variable is in fact empty line 36 : 'cd $IDF_PATH'
Notice also that you cannot run the test_esp32.sh twice because the '/tensorflow/lite/micro/tools/ci_build/../../../../../esp-idf
' directory is not removed/cleaned.

@evaderan-lab
Thanks for reporting.
This is something because of readable_run export  command not working as expected.
Fixed this with following PR: https://github.com/tensorflow/tensorflow/pull/45334

@Jan08,
Related PR #45334 was merged. Could you please take a look at the comments from the developer and the community that the issue got resolved.
Also please take a look at this file for the reference.

name: ESP32

# https://docs.github.com/en/actions/reference/workflow-syntax-for-github-actions#onschedule
on:
  schedule:
    # 10am UTC is 3am or 4am PT depending on daylight savings.
    - cron: '0 10 * * *'

  # Allow manually triggering of the workflow.
  workflow_dispatch: {}

jobs:
  esp32_daily:
    runs-on: ubuntu-latest

    if: |
      github.event_name == 'workflow_dispatch' ||
      (github.event_name == 'schedule' && github.repository == 'tensorflow/tflite-micro')
    name: ESP32 Continuous Builds
    steps:
      - uses: actions/checkout@v2
      - name: Test
        run: |
          tensorflow/lite/micro/tools/ci_build/test_esp32.sh


Add alternate zonal bands

our default includes
'NHEX' : {'domain':cdutil.region.domain(latitude=(30.,90,'ccb'))},
'SHEX' : {'domain':cdutil.region.domain(latitude=(-90.,-30,'ccb'))},
'TROPICS': {'domain':cdutil.region.domain(latitude=(-30.,30,'ccb'))},
which is good but there are several other common definitions, one will be added here

@gleckler1 #399 adds the regions but not in the default list. Is this correct?


[Bug] flinksql executes normally in flink sql-client, but when creating a job, there is no log after init to run, and database changes cannot be captured

Search before asking

[X] I had searched in the issues and found no similar issues.

What happened
oracle-cdc 同步oracle数据到mysql，sql在sql-client执行正常，但是创建作业进行执行时，没有错误信息也没有能获取到源库数据。
对比flink后台日志，发现dinky作业运行到init to run；sql-client运行到init to run后有获取到数据变更的后续；具体如下：
1 dinky运行flink日志：
2023-12-30 16:18:45,647 INFO  org.apache.flink.runtime.dispatcher.StandaloneDispatcher     [] - Received JobGraph submission '4006' (9e77913b3a45376cff0401274de2ad8b).
2023-12-30 16:18:45,650 INFO  org.apache.flink.runtime.dispatcher.StandaloneDispatcher     [] - Submitting job '4006' (9e77913b3a45376cff0401274de2ad8b).
2023-12-30 16:18:45,651 INFO  org.apache.flink.runtime.jobmaster.JobMasterServiceLeadershipRunner [] - JobMasterServiceLeadershipRunner for job 9e77913b3a45376cff0401274de2ad8b was granted leadership with leader id 00000000-0000-0000-0000-000000000000. Creating new JobMasterServiceProcess.
2023-12-30 16:18:45,660 INFO  org.apache.flink.runtime.rpc.akka.AkkaRpcService             [] - Starting RPC endpoint for org.apache.flink.runtime.jobmaster.JobMaster at akka://flink/user/rpc/jobmanager_6 .
2023-12-30 16:18:45,661 INFO  org.apache.flink.runtime.jobmaster.JobMaster                 [] - Initializing job '4006' (9e77913b3a45376cff0401274de2ad8b).
2023-12-30 16:18:45,662 INFO  org.apache.flink.runtime.jobmaster.JobMaster                 [] - Using restart back off time strategy NoRestartBackoffTimeStrategy for 4006 (9e77913b3a45376cff0401274de2ad8b).
2023-12-30 16:18:45,663 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       [] - Created execution graph 2ca6183395ad44758a1a3859164ef9bf for job 9e77913b3a45376cff0401274de2ad8b.
2023-12-30 16:18:45,663 INFO  org.apache.flink.runtime.jobmaster.JobMaster                 [] - Running initialization on master for job 4006 (9e77913b3a45376cff0401274de2ad8b).
2023-12-30 16:18:45,663 INFO  org.apache.flink.runtime.jobmaster.JobMaster                 [] - Successfully ran initialization on master in 0 ms.
2023-12-30 16:18:45,845 INFO  org.apache.flink.runtime.scheduler.adapter.DefaultExecutionTopology [] - Built 1 new pipelined regions in 0 ms, total 1 pipelined regions currently.
2023-12-30 16:18:45,846 INFO  org.apache.flink.runtime.jobmaster.JobMaster                 [] - No state backend has been configured, using default (HashMap) org.apache.flink.runtime.state.hashmap.HashMapStateBackend@59d76d5b
2023-12-30 16:18:45,846 INFO  org.apache.flink.runtime.state.StateBackendLoader            [] - State backend loader loads the state backend as HashMapStateBackend
2023-12-30 16:18:45,846 INFO  org.apache.flink.runtime.jobmaster.JobMaster                 [] - Checkpoint storage is set to 'jobmanager'
2023-12-30 16:18:45,846 INFO  org.apache.flink.runtime.checkpoint.CheckpointCoordinator    [] - No checkpoint found during restore.
2023-12-30 16:18:45,846 INFO  org.apache.flink.runtime.jobmaster.JobMaster                 [] - Using failover strategy org.apache.flink.runtime.executiongraph.failover.flip1.RestartPipelinedRegionFailoverStrategy@651c9530 for 4006 (9e77913b3a45376cff0401274de2ad8b).
2023-12-30 16:18:45,847 INFO  org.apache.flink.runtime.jobmaster.JobMaster                 [] - Starting execution of job '4006' (9e77913b3a45376cff0401274de2ad8b) under job master id<PHONE_NUMBER>0000000000000000000000.
2023-12-30 16:18:45,848 INFO  org.apache.flink.runtime.source.coordinator.SourceCoordinator [] - Starting split enumerator for source Source: foc_t4006[31].
2023-12-30 16:18:45,858 INFO  org.apache.flink.runtime.jobmaster.JobMaster                 [] - Starting scheduling with scheduling strategy [org.apache.flink.runtime.scheduler.strategy.PipelinedRegionSchedulingStrategy]
2023-12-30 16:18:45,858 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       [] - Job 4006 (9e77913b3a45376cff0401274de2ad8b) switched from state CREATED to RUNNING.
2023-12-30 16:18:45,858 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       [] - Source: foc_t4006[31] -> DropUpdateBefore[32] -> ConstraintEnforcer[33] -> Sink: data_foc_t4006[33] (1/1) (2ca6183395ad44758a1a3859164ef9bf_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CREATED to SCHEDULED.
2023-12-30 16:18:45,859 INFO  org.apache.flink.runtime.jobmaster.JobMaster                 [] - Connecting to ResourceManager akka.tcp://flink@localhost:6123/user/rpc/resourcemanager_*(00000000000000000000000000000000)
2023-12-30 16:18:45,860 INFO  org.apache.flink.runtime.jobmaster.JobMaster                 [] - Resolved ResourceManager address, beginning registration
2023-12-30 16:18:45,860 INFO  org.apache.flink.runtime.resourcemanager.StandaloneResourceManager [] - Registering job manager<PHONE_NUMBER>0000000000000000000000@akka.tcp://flink@localhost:6123/user/rpc/jobmanager_6 for job 9e77913b3a45376cff0401274de2ad8b.
2023-12-30 16:18:45,862 INFO  org.apache.flink.runtime.resourcemanager.StandaloneResourceManager [] - Registered job manager<PHONE_NUMBER>0000000000000000000000@akka.tcp://flink@localhost:6123/user/rpc/jobmanager_6 for job 9e77913b3a45376cff0401274de2ad8b.
2023-12-30 16:18:45,862 INFO  org.apache.flink.runtime.jobmaster.JobMaster                 [] - JobManager successfully registered at ResourceManager, leader id:<PHONE_NUMBER>0000000000000000000000.
2023-12-30 16:18:45,863 INFO  org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager [] - Received resource requirements from job 9e77913b3a45376cff0401274de2ad8b: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
2023-12-30 16:18:45,948 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       [] - Source: foc_t4006[31] -> DropUpdateBefore[32] -> ConstraintEnforcer[33] -> Sink: data_foc_t4006[33] (1/1) (2ca6183395ad44758a1a3859164ef9bf_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from SCHEDULED to DEPLOYING.
2023-12-30 16:18:45,948 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       [] - Deploying Source: foc_t4006[31] -> DropUpdateBefore[32] -> ConstraintEnforcer[33] -> Sink: data_foc_t4006[33] (1/1) (attempt #0) with attempt id 2ca6183395ad44758a1a3859164ef9bf_cbc357ccb763df2852fee8c4fc7d55f2_0_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to localhost:15450-b61652 @ localhost (dataPort=25399) with allocation id 02f62d76d26950f278b2b9ec203d1770
2023-12-30 16:18:45,965 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       [] - Source: foc_t4006[31] -> DropUpdateBefore[32] -> ConstraintEnforcer[33] -> Sink: data_foc_t4006[33] (1/1) (2ca6183395ad44758a1a3859164ef9bf_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from DEPLOYING to INITIALIZING.
2023-12-30 16:18:46,164 INFO  org.apache.flink.runtime.source.coordinator.SourceCoordinator [] - Source Source: foc_t4006[31] registering reader for parallel task 0 (#0) @ localhost
2023-12-30 16:18:46,174 INFO  org.apache.flink.runtime.source.coordinator.SourceCoordinator [] - Source Source: foc_t4006[31] received split request from parallel task 0 (#0)
2023-12-30 16:18:46,175 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       [] - Source: foc_t4006[31] -> DropUpdateBefore[32] -> ConstraintEnforcer[33] -> Sink: data_foc_t4006[33] (1/1) (2ca6183395ad44758a1a3859164ef9bf_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from INITIALIZING to RUNNING.
2023-12-30 16:18:46,794 INFO  io.debezium.connector.oracle.OracleConnection                [] - Database Version: Oracle Database 11g Enterprise Edition Release <IP_ADDRESS>.0 - 64bit Production
2023-12-30 16:18:46,806 INFO  io.debezium.jdbc.JdbcConnection                              [] - Connection gracefully closed
2023-12-30 16:18:46,810 INFO  com.ververica.cdc.connectors.base.source.enumerator.IncrementalSourceEnumerator [] - Assign split StreamSplit{splitId='stream-split', offset={commit_scn=0, lcr_position=null, scn=25009795672}, endOffset={commit_scn=0, lcr_position=null, scn=-9223372036854775808}} to subtask 0
2.sql-client执行日志：
3-12-30 16:28:06,549 INFO  org.apache.flink.runtime.dispatcher.StandaloneDispatcher     [] - Received JobGraph submission 'insert-into_default_catalog.default_database.data_foc_t4006' (4abef95a1a2a22a976d43f3236b428c4).
2023-12-30 16:28:06,550 INFO  org.apache.flink.runtime.dispatcher.StandaloneDispatcher     [] - Submitting job 'insert-into_default_catalog.default_database.data_foc_t4006' (4abef95a1a2a22a976d43f3236b428c4).
2023-12-30 16:28:06,550 INFO  org.apache.flink.runtime.jobmaster.JobMasterServiceLeadershipRunner [] - JobMasterServiceLeadershipRunner for job 4abef95a1a2a22a976d43f3236b428c4 was granted leadership with leader id 00000000-0000-0000-0000-000000000000. Creating new JobMasterServiceProcess.
2023-12-30 16:28:06,552 INFO  org.apache.flink.runtime.rpc.akka.AkkaRpcService             [] - Starting RPC endpoint for org.apache.flink.runtime.jobmaster.JobMaster at akka://flink/user/rpc/jobmanager_7 .
2023-12-30 16:28:06,552 INFO  org.apache.flink.runtime.jobmaster.JobMaster                 [] - Initializing job 'insert-into_default_catalog.default_database.data_foc_t4006' (4abef95a1a2a22a976d43f3236b428c4).
2023-12-30 16:28:06,553 INFO  org.apache.flink.runtime.jobmaster.JobMaster                 [] - Using restart back off time strategy NoRestartBackoffTimeStrategy for insert-into_default_catalog.default_database.data_foc_t4006 (4abef95a1a2a22a976d43f3236b428c4).
2023-12-30 16:28:06,554 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       [] - Created execution graph 86baaef636bac1732f3e69a4b5e78778 for job 4abef95a1a2a22a976d43f3236b428c4.
2023-12-30 16:28:06,555 INFO  org.apache.flink.runtime.jobmaster.JobMaster                 [] - Running initialization on master for job insert-into_default_catalog.default_database.data_foc_t4006 (4abef95a1a2a22a976d43f3236b428c4).
2023-12-30 16:28:06,555 INFO  org.apache.flink.runtime.jobmaster.JobMaster                 [] - Successfully ran initialization on master in 0 ms.
2023-12-30 16:28:06,570 INFO  org.apache.flink.runtime.scheduler.adapter.DefaultExecutionTopology [] - Built 1 new pipelined regions in 0 ms, total 1 pipelined regions currently.
2023-12-30 16:28:06,571 INFO  org.apache.flink.runtime.jobmaster.JobMaster                 [] - No state backend has been configured, using default (HashMap) org.apache.flink.runtime.state.hashmap.HashMapStateBackend@673a0b57
2023-12-30 16:28:06,571 INFO  org.apache.flink.runtime.state.StateBackendLoader            [] - State backend loader loads the state backend as HashMapStateBackend
2023-12-30 16:28:06,571 INFO  org.apache.flink.runtime.jobmaster.JobMaster                 [] - Checkpoint storage is set to 'jobmanager'
2023-12-30 16:28:06,571 INFO  org.apache.flink.runtime.checkpoint.CheckpointCoordinator    [] - No checkpoint found during restore.
2023-12-30 16:28:06,571 INFO  org.apache.flink.runtime.jobmaster.JobMaster                 [] - Using failover strategy org.apache.flink.runtime.executiongraph.failover.flip1.RestartPipelinedRegionFailoverStrategy@7891aa36 for insert-into_default_catalog.default_database.data_foc_t4006 (4abef95a1a2a22a976d43f3236b428c4).
2023-12-30 16:28:06,572 INFO  org.apache.flink.runtime.jobmaster.JobMaster                 [] - Starting execution of job 'insert-into_default_catalog.default_database.data_foc_t4006' (4abef95a1a2a22a976d43f3236b428c4) under job master id<PHONE_NUMBER>0000000000000000000000.
2023-12-30 16:28:06,573 INFO  org.apache.flink.runtime.source.coordinator.SourceCoordinator [] - Starting split enumerator for source Source: foc_t4006[1].
2023-12-30 16:28:06,620 INFO  io.debezium.connector.oracle.OracleConnection                [] - Database Version: Oracle Database 11g Enterprise Edition Release <IP_ADDRESS>.0 - 64bit Production
2023-12-30 16:28:07,393 INFO  com.ververica.cdc.connectors.oracle.source.utils.OracleConnectionUtils [] - 	 including 'orcl.YGFOC.T4006' for further processing
2023-12-30 16:28:07,396 INFO  io.debezium.jdbc.JdbcConnection                              [] - Connection gracefully closed
2023-12-30 16:28:07,436 INFO  io.debezium.connector.oracle.OracleConnection                [] - Database Version: Oracle Database 11g Enterprise Edition Release <IP_ADDRESS>.0 - 64bit Production
2023-12-30 16:28:07,438 INFO  io.debezium.jdbc.JdbcConnection                              [] - Connection gracefully closed
2023-12-30 16:28:07,441 INFO  org.apache.flink.runtime.jobmaster.JobMaster                 [] - Starting scheduling with scheduling strategy [org.apache.flink.runtime.scheduler.strategy.PipelinedRegionSchedulingStrategy]
2023-12-30 16:28:07,441 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       [] - Job insert-into_default_catalog.default_database.data_foc_t4006 (4abef95a1a2a22a976d43f3236b428c4) switched from state CREATED to RUNNING.
2023-12-30 16:28:07,441 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       [] - Source: foc_t4006[1] -> DropUpdateBefore[2] -> ConstraintEnforcer[3] -> Sink: data_foc_t4006[3] (1/1) (86baaef636bac1732f3e69a4b5e78778_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CREATED to SCHEDULED.
2023-12-30 16:28:07,442 INFO  org.apache.flink.runtime.jobmaster.JobMaster                 [] - Connecting to ResourceManager akka.tcp://flink@localhost:6123/user/rpc/resourcemanager_*(00000000000000000000000000000000)
2023-12-30 16:28:07,442 INFO  org.apache.flink.runtime.jobmaster.JobMaster                 [] - Resolved ResourceManager address, beginning registration
2023-12-30 16:28:07,442 INFO  org.apache.flink.runtime.resourcemanager.StandaloneResourceManager [] - Registering job manager<PHONE_NUMBER>0000000000000000000000@akka.tcp://flink@localhost:6123/user/rpc/jobmanager_7 for job 4abef95a1a2a22a976d43f3236b428c4.
2023-12-30 16:28:07,443 INFO  org.apache.flink.runtime.resourcemanager.StandaloneResourceManager [] - Registered job manager<PHONE_NUMBER>0000000000000000000000@akka.tcp://flink@localhost:6123/user/rpc/jobmanager_7 for job 4abef95a1a2a22a976d43f3236b428c4.
2023-12-30 16:28:07,444 INFO  org.apache.flink.runtime.jobmaster.JobMaster                 [] - JobManager successfully registered at ResourceManager, leader id:<PHONE_NUMBER>0000000000000000000000.
2023-12-30 16:28:07,444 INFO  org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager [] - Received resource requirements from job 4abef95a1a2a22a976d43f3236b428c4: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
2023-12-30 16:28:07,522 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       [] - Source: foc_t4006[1] -> DropUpdateBefore[2] -> ConstraintEnforcer[3] -> Sink: data_foc_t4006[3] (1/1) (86baaef636bac1732f3e69a4b5e78778_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from SCHEDULED to DEPLOYING.
2023-12-30 16:28:07,522 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       [] - Deploying Source: foc_t4006[1] -> DropUpdateBefore[2] -> ConstraintEnforcer[3] -> Sink: data_foc_t4006[3] (1/1) (attempt #0) with attempt id 86baaef636bac1732f3e69a4b5e78778_cbc357ccb763df2852fee8c4fc7d55f2_0_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to localhost:15450-b61652 @ localhost (dataPort=25399) with allocation id cd740cb5458285911b8817df9d49f155
2023-12-30 16:28:07,728 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       [] - Source: foc_t4006[1] -> DropUpdateBefore[2] -> ConstraintEnforcer[3] -> Sink: data_foc_t4006[3] (1/1) (86baaef636bac1732f3e69a4b5e78778_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from DEPLOYING to INITIALIZING.
2023-12-30 16:28:07,869 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       [] - Source: foc_t4006[1] -> DropUpdateBefore[2] -> ConstraintEnforcer[3] -> Sink: data_foc_t4006[3] (1/1) (86baaef636bac1732f3e69a4b5e78778_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from INITIALIZING to RUNNING.
2023-12-30 16:28:07,869 INFO  org.apache.flink.runtime.source.coordinator.SourceCoordinator [] - Source Source: foc_t4006[1] registering reader for parallel task 0 (#0) @ localhost
2023-12-30 16:28:07,870 INFO  org.apache.flink.runtime.source.coordinator.SourceCoordinator [] - Source Source: foc_t4006[1] received split request from parallel task 0 (#0)
2023-12-30 16:28:07,900 INFO  io.debezium.connector.oracle.OracleConnection                [] - Database Version: Oracle Database 11g Enterprise Edition Release <IP_ADDRESS>.0 - 64bit Production
2023-12-30 16:28:07,900 INFO  com.ververica.cdc.connectors.oracle.source.assigner.splitter.OracleChunkSplitter [] - Start splitting table orcl.YGFOC.T4006 into chunks...
2023-12-30 16:28:07,987 INFO  com.ververica.cdc.connectors.oracle.source.assigner.splitter.OracleChunkSplitter [] - Use unevenly-sized chunks for table orcl.YGFOC.T4006, the chunk size is 8096
2023-12-30 16:28:07,992 INFO  com.ververica.cdc.connectors.oracle.source.assigner.splitter.OracleChunkSplitter [] - Split table orcl.YGFOC.T4006 into 1 chunks, time cost: 92ms.
2023-12-30 16:28:07,997 INFO  io.debezium.jdbc.JdbcConnection                              [] - Connection gracefully closed
2023-12-30 16:28:08,001 INFO  com.ververica.cdc.connectors.base.source.enumerator.IncrementalSourceEnumerator [] - Assign split SnapshotSplit{tableId=orcl.YGFOC.T4006, splitId='orcl.YGFOC.T4006:0', splitKeyType=[ROWID STRING], splitStart=null, splitEnd=null, highWatermark=null} to subtask 0
2023-12-30 16:28:29,209 INFO  com.ververica.cdc.connectors.base.source.enumerator.IncrementalSourceEnumerator [] - The enumerator receives finished split offsets FinishedSnapshotSplitsReportEvent{finishedOffsets={orcl.YGFOC.T4006:0={commit_scn=0, lcr_position=null, scn=25009796633}}} from subtask 0.
2023-12-30 16:28:29,209 INFO  com.ververica.cdc.connectors.base.source.assigner.SnapshotSplitAssigner [] - Snapshot split assigner received all splits finished and the job parallelism is 1, snapshot split assigner is turn into finished status.
2023-12-30 16:28:29,210 INFO  org.apache.flink.runtime.source.coordinator.SourceCoordinator [] - Source Source: foc_t4006[1] received split request from parallel task 0 (#0)
2023-12-30 16:28:29,213 INFO  com.ververica.cdc.connectors.base.source.enumerator.IncrementalSourceEnumerator [] - Assign split StreamSplit{splitId='stream-split', offset={commit_scn=0, lcr_position=null, scn=25009796633}, endOffset={commit_scn=0, lcr_position=null, scn=-9223372036854775808}} to subtask 0
What you expected to happen
同sql-client一样获取到数据。
How to reproduce
dinky 0.7.5 flink17 flink oracle-cdc3
Anything else
No response
Version
0.7.5
Are you willing to submit PR?

[ ] Yes I am willing to submit a PR!

Code of Conduct

[X] I agree to follow this project's Code of Conduct

Provide steps to reproduce
and please please read: https://github.com/tvvocold/How-To-Ask-Questions-The-Smart-Way


Dont use same event handler for notifications as for read

In our application the value received by an update/notification is not the same as the value read.
So in some cases while we´re doing a read we receive an update and both returns the notification value.
We previously used cordova-plugin-ble-central and they seems to handle reads and notifications differently.

Merged. Thanks for the contribution!


Create power-bi-streaming-datasets.ipynb

(default - no company specified) I have sole ownership of intellectual property rights to my Submissions and I am not making Submissions in the course of work for my employer.

@robfarley please read the following Contributor License Agreement(CLA). If you agree with the CLA, please reply with the following information.
@microsoft-github-policy-service agree [company="{your company}"]

Options:

(default - no company specified) I have sole ownership of intellectual property rights to my Submissions and I am not making Submissions in the course of work for my employer.
(when company given) I am making Submissions in the course of work for my employer (or my employer has intellectual property rights in my Submissions by contract or applicable law). I have permission from my employer to make Submissions and enter into this Agreement on behalf of my employer. By signing below, the defined term “You” includes me and my employer.

Contributor License Agreement

@microsoft-github-policy-service agree [company="no company specified"]

@microsoft-github-policy-service agree

@robfarley please read the following Contributor License Agreement(CLA). If you agree with the CLA, please reply with the following information.
@microsoft-github-policy-service agree [company="{your company}"]

Options:

(default - no company specified) I have sole ownership of intellectual property rights to my Submissions and I am not making Submissions in the course of work for my employer.
(when company given) I am making Submissions in the course of work for my employer (or my employer has intellectual property rights in my Submissions by contract or applicable law). I have permission from my employer to make Submissions and enter into this Agreement on behalf of my employer. By signing below, the defined term “You” includes me and my employer.

Contributor License Agreement

@microsoft-github-policy-service agree [company="no company specified"]

@microsoft-github-policy-service agree


Loading not working properly in container and using refs

Loading not working in Button in Popup, it will be fullscreen instead of in the button.
Loading container using refs will not work on vs-button, browser return

[Vue warn]: Error in v-on handler: "SyntaxError: Failed to execute 'querySelector' on 'Document': '[object Object]' is not a valid selector.

Def a problem.

Please check #633


Add select vehicle menue

The tourManagement page schould ave  a dropdown menue, wehren you coud select
My Citybike
My MTB
My lovely DB5
My allday Golf
Always late train
Add new vehicle. -> which leds to a vehicle configuration page.


Drift detection is reporting non-drifting modules

See notifications posted to our Slack below:

Workfow:
name: Digger Drift Detection

on:
  # workflow_dispatch:
  # schedule: ## 12am daily.
  #   - cron: '0 0 * * *'
  push:
    branches:
      - drift

permissions:
  contents: read
  id-token: write # for aws oidc

jobs:
  detect-drift:
    runs-on: ubuntu-latest
    steps:
    - name: digger drift detection
      uses: diggerhq/digger@vLatest
      with:
        mode: drift-detection
        no-backend: true
        cache-dependencies: true
        setup-aws: true
        aws-role-to-assume: <my-role-arn>
        aws-region: eu-west-2
        drift-detection-slack-notification-url: ${{ secrets.DRIFT_DETECTION_SLACK_NOTIFICATION }}

        setup-opentofu: true
        opentofu-version: v1.6.2

        setup-terragrunt: true
        terragrunt-version: 0.66.3
      env:
        GITHUB_CONTEXT: ${{ toJson(github) }}
        GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }}

CC @motatoes

Hi @noisyscanner thanks for reporting, looks like a bug in our cleanup functino that needs to be addressed


[RTDB] Use NSURLSessionWebSocket instead of SocketRocket where possible

Use the previously implemented NSURLSessionWebSocket for all platforms that support it instead of only watchOS where it was only previously used.
Fix #12883

It should also allow socks proxying of the websocket connection which the used version of SocketRocket did not, so huge thumbs up from here! 😊👍🏻

I suspect the frequent, but not always, integration test failure in testDeepUpdatesWork is specific to Arm macs versus Intel macs.

cc: @maneesht


Is relabelling of Slakh dataset required when combining with MUSDB18 dataset?

Sorry, but i am new to this topic. Can i ask if I would want to use MUSDB 18 and Slakh dataset together for my model, does that mean I have to manually relabel all the tracks for Slakh? This is because MUSDB 18 labelled their tracks as follows.
0 - The mixture,
1 - The drums,
2 - The bass,
3 - The rest of the accompaniment,
4 - The vocals
However, for Slakh since there are many instruments, it is labelled differently as shown in this link https://github.com/ethman/slakh-utils/blob/master/midi_inst_values/general_midi_inst_0based.txt
Since Slakh has a large number of tracks, I would like to ask if there is any efficient way to go about relabeling the tracks? Or there is already a full combine set available (i couldn't find it).  If there isn't, is it possible to provide an instruction guide to teach how I could actually relabel the tracks in Slakh to be like MUSDB18? Do I have to download the stem creator tool used in MUSDB18 by Native Instruments  ( https://www.stems-music.com/stem-creator-tool/ ) and rearrange the tracks into the 4 different types of categories?

Hello! Thanks for reaching out! First let me talk about the general case for combining different instrument tracks in Slakh (called submixing), then I'll talk about how this fits together with MUSDB18.
Submixing
If you want to combine certain instrument types (called submixing) check out the instructions here: https://github.com/ethman/slakh-utils/tree/master/submixes. The basic idea is that you can define which instrument types get mixed together to make each stem.
For example, let's say there's a song with three isolated tracks: 1) a Rhodes electric piano, 2) an acoustic piano, and 3) an (acoustic) upright bass guitar. There's a few ways to combine these tracks: we can mix them like "pianos vs. bass" where the acoustic  & electric piano are submixed together and the bass isn't submixed with anything, or we can mix them like "acoustic vs. electric" where the acoustic piano and upright bass are submixed together, and the electric piano isn't submixed with anything. How these tracks get combined into submixes depends on your use case. This is a decision that you make (in this case, the decision was either to do "piano vs. bass" submixing or to do "acoustic vs. electric" submixing).
How do you figure out which audio files correspond to which instrument types? Well, they're all labeled in the metadata (detailed here). This metadata tells you exactly what type of instrument each file is. So: no, you do not need to manually label anything.
This is what the submixing code linked above does, it allows you to define which tracks get submixed together. Read the directions on the page to understand how to set up the code to make submixes.
Combining Slakh2100 & MUSDB18
Okay, so now we understand how to create submixes in Slakh, how do I make that compatible with MUSDB18? The bad news is that there's not a perfect match between how the instruments tracks are defined in MUSDB18 and how they're defined in Slakh. For instance, because Slakh data is all synthesized with VSTs, there are no vocal tracks, unlike MUSDB18 in which vocals is one of the four instrument tracks.
However, 3 of the 4 instrument tracks in MUSDB18 overlap with the type of instruments available in Slakh; the three non-Vocals tracks overlap with Slakh. That would be Bass, Drums, and Other. So it's possible to make Bass, Drums, and Other submixes that match MUSDB18's definition of those submixes.
In order to do that, you can just define submixes and run the submixing script as described in the linked docs above. You'll define a Bass instrument and a Drums instrument. Every other type of instrument (aka MUSDB18's Other instrument) will get created automatically in a file called residuals.wav. This is precisely what we did when comparing MUSDB18 and Slakh2100 in this paper (see table 2 for the clearest example).

I hope this helped! Let me know if you have any more questions; I'm happy to help!

Hi, Sorry for the late reply. I tried to follow the instructions under the submixes link you have given. However, it seems like i am still stuck. This are the following steps that i have done.

I create a new folder named "submixes_relabel" that consists of 3 files. band.yaml, drums.yaml and bass.yaml
These 3 files are copied from the examples. Just that i removed piano and guitar from the original band.yaml
After installing the requirement.txt and convert flac files to wav format and label the folder as slakh2100_wav
For the submixing, i followed the code format and typed the following:

python submixes.py -submix-definition-file ""D:\slakh-utils-master\submixes\submixes_relabel" -i "D:\datasets\slakh2100_wav"

However, i got the following error:
Traceback (most recent call last):
File "submixes.py", line 118, in
parser.add_argument('-src-dir', '-s', type=str, required=False,
File "C:\Users\jasli\anaconda3\lib\argparse.py", line 1386, in add_argument
return self._add_action(action)
File "C:\Users\jasli\anaconda3\lib\argparse.py", line 1749, in _add_action
self._optionals._add_action(action)
File "C:\Users\jasli\anaconda3\lib\argparse.py", line 1590, in _add_action
action = super(_ArgumentGroup, self)._add_action(action)
File "C:\Users\jasli\anaconda3\lib\argparse.py", line 1400, in _add_action
self._check_conflict(action)
File "C:\Users\jasli\anaconda3\lib\argparse.py", line 1539, in _check_conflict
conflict_handler(action, confl_optionals)
File "C:\Users\jasli\anaconda3\lib\argparse.py", line 1548, in _handle_conflict_error
raise ArgumentError(action, message % conflict_string)
argparse.ArgumentError: argument -src-dir/-s: conflicting option string: -s
Thus, I would like to know if i made any errors anywhere. There are also some questions i have while doing the submixing

Do i still need the band.yaml file if i already define a Bass instrument and a Drums instrument as bass.yaml and drums.yaml respectively?
How do i know that the drums,bass and others are labelled as 1,2 and 3 respectively (like MUSDB18 dataset).
When using both datasets togehter, do I need to follow MUSDB18, to have a mixture labelled as 0 for Slakh files? If yes, how do i approach to do it?
In the submixing instructions, you mention the following:

python submixes.py [-h] -submix-definition-file SUBMIX_DEFINITION_FILE
[-input-dir INPUT_DIR] [-src-dir SRC_DIR]
[-num-threads NUM_THREADS]

  -submix-definition-file SUBMIX_DEFINITION_FILE

What i type: -submix-definition-file "D:\slakh-utils-master\submixes\submixes_relabel"
I put the dir of the folder where the 3 yaml file exit. Am i doing it right or must it be individual bass.yaml file? drums.yaml file or a combination of both as band.yaml file?

  -i INPUT_DIR

What i type: -i "D:\datasets\slakh2100_wav"
I put the dir of folder where the folder contains 3 sub folders: test, validation and train. When I proceed with the submixing, do I have to do the sub folders individually (ie. D:\datasets\slakh2100_wav\test) or i can do all at once (ie.D:\datasets\slakh2100_wav). I am confirming this because as I did the conversion from flac to wav, i had to do it individually, so i am not sure if it is the same for submixing.

   -src-dir SRC_DIR

For this, i initially did not type anything as it seems like it is to create a submix for individual tracks. However, since i want to relabel the whole Slakh audio files, I thot that providing the input dir is sufficient.
However, i did try to type  -src-dir "D:\datasets\slakh2100_wav\submix" to see what results i am suppose to have, but all i got was the error stated above.

   -num-threads NUM_THREADS

I did not type this as well as I have no idea what does: Number of threads to spwan to do the submixing means? If i want to relabel all the files to use it together with MUSDB18, what is the number of threads needed to spawn?

I apologize if there are some basic points that I could not understand as I am quite new to doing this for a school project. It would be great if it is possible to do a short instructional video to better understand the text instructions. Thank you very much for your time.

Hey, it looks like the error you've encountered was fixed in some pull requests (see here or here. So pull one of those two and the script should work.

Hi, i run the script that you mentioned and manage to run the script and manage to get a folder that has all the bass instruments to be under bass.wav, all the drums under drums.wav, and the rest under residuals.wav.
However, i did have the following warning while running the code:

submixes.py:34: YAMLLoadWarning: calling yaml.load() without Loader=... is deprecated, as the default Loader is unsafe. Please read https://msg.pyyaml.org/load for full details.
self.submix_data = yaml.load(open(submix_file, 'r'))
submixes.py:69: YAMLLoadWarning: calling yaml.load() without Loader=... is deprecated, as the default Loader is unsafe. Please read https://msg.pyyaml.org/load for full details.
src_metadata = yaml.load(open(os.path.join(srcs_dir, 'metadata.yaml'), 'r'))

Now that i manage to have a folder that has drums and bass, how do i know that the drums.wav, bass.wav and residuals.wav are labeled as 1, 2 and 3 respectively (like in MUSDB18)? Do i need to label the mix files as 0? If yes, how do i do so.

MUSDB18 labeling
0 - The mixture,
1 - The drums,
2 - The bass,
3 - The rest of the accompaniment,
4 - The vocals

Hello!
Don't worry about those warnings. I can update the code to get rid of them soon, but they're not a problem for you at all.
There is a mix.wav audio file included in all of the Track folders when you download Slakh2100. So the mixtures are ready to go when you download it. See the documentation here for details about what's included when you download Slakh2100. The mixes included with Slakh2100 have all of the instrument tracks summed together to make the mix (i.e., all of the files in Track00001/stems/SXX.wav are added together to make Track00001/mix.wav).
In your case, the mixes are going to be mix.wav = bass.wav + drums.wav + residuals.wav. That's what the submixes script does: it aggregates all of the audio files in Track00001/stems/ into bass submixes (bass.wav) and drum submixes (drums.wav) and everything else that isn't bass or drums (residuals.wav).
So if you want mixes with just bass and drums, just add together bass.wav and drums.wav. But because you have omitted residuals.wav this mixture won't equal the mixture that came with the downloaded version of Slakh2100.
I think this is what you're asking. But if you're asking about how to get the audio into the stempeg format, then that is outside of the scope of this project. For more information on how to do that see this library and its documentation.

Taking a step back:
What is your ultimate goal?
Are you trying to train a model on both MUSDB18 and Slakh2100 data? If so, then you probably don't want to put your data back into the stempeg format. The stempeg format is used to store and transport all audio stems so they stay together and have the same metadata, but you can't actually train on the stempeg data without decompressing them to arrays. (See how the read_stems() function here actually returns a 3D array of shape shape=(stem x samples x channels)? That's the decompressed, raw audio arrays from the stem file.)
If this is your goal, then convert all of the MUSDB18 files to arrays using that library and simultaneously read the Slakh2100 audio tracks as you normally would. You'll have to be keeping tabs on the audio from the different datasets to make sure you get the mixing and track labels sorted correctly for your use case.

Hi, thank you for taking the time to explain to me but I think I may not have expressed my questions properly or i may not have understood your replies entirely.
My main goal is to use both MUSDB18 and Slakh2100 data together to train my model. However, I was confused on how to start as both datasets have different instruments and labels assigned. Thus, I opened this issue so that I can learn how to use both datasets together like how you did in the paper.
From your advice, I should make use of submixing to achieve my goal. While submixing did provide me a new bass.wav, drums.wav and residuals.wav, it occurred to me that I do not know what are the new labels assigned to them. For example, given that the following is my yaml file, after submixing them, how do I know what is the new label assigned to drums and bass ? Because I did not state that the new label of drums is 1 nor did I state that the new label of bass is 2.

Mixing key: "program_num"
Recipes:
Drums:

- 128

Bass:
- 32
- 33
- 34
- 35
- 36
- 37
- 38
- 39
From your latest reply, you mention that I have to convert all of the MUSDB18 files to arrays and simultaneously read the Slakh2100 audio tracks while making sure that the mixing and track labels sorted correctly.

But I do not know whether the new bass.wav, drums.wav, and residuals.wav are being newly labeled so how do I even make sure that both are sorted correctly.
As MUSDB18 dataset combines the stem and puts them together using Native instruments, if I am using both datasets together, do I also need to do this process for Slakh2100 audio tracks? Else, how am I supposed to train the model with the format being different.

If it seems to you that I am off-track from my goal, would it be possible for you to state how you manage to use both datasets together and put them to train in the model like how you did in the paper. All I manage to do so far is submixing as seen above as well as converting flac to wav.

Hi, thank you for taking the time to explain to me but I think I may not have expressed my questions properly or i may not have understood your replies entirely.
My main goal is to use both MUSDB18 and Slakh2100 data together to train my model. However, I was confused on how to start as both datasets have different instruments and labels assigned. Thus, I opened this issue so that I can learn how to use both datasets together like how you did in the paper.
From your advice, I should make use of submixing to achieve my goal. While submixing did provide me a new bass.wav, drums.wav and residuals.wav, it occurred to me that I do not know what are the new labels assigned to them. For example, given that the following is my yaml file, after submixing them, how do I know what is the new label assigned to drums and bass ? Because I did not state that the new label of drums is 1 nor did I state that the new label of bass is 2.

Mixing key: "program_num"
Recipes:
Drums:

- 128

Bass:
- 32
- 33
- 34
- 35
- 36
- 37
- 38
- 39
From your latest reply, you mention that I have to convert all of the MUSDB18 files to arrays and simultaneously read the Slakh2100 audio tracks while making sure that the mixing and track labels sorted correctly.

But I do not know whether the new bass.wav, drums.wav, and residuals.wav are being newly labeled so how do I even make sure that both are sorted correctly.
As MUSDB18 dataset combines the stem and puts them together using Native instruments, if I am using both datasets together, do I also need to do this process for Slakh2100 audio tracks? Else, how am I supposed to train the model with the format being different.

If it seems to you that I am off-track from my goal, would it be possible for you to state how you manage to use both datasets together and put them to train in the model like how you did in the paper. All I manage to do so far is submixing as seen above as well as converting flac to wav.

Hi again!
Labeling of Instrument Tracks

From your advice, I should make use of submixing to achieve my goal. While submixing did provide me a new bass.wav, drums.wav and residuals.wav, it occurred to me that I do not know what are the new labels assigned to them. For example, given that the following is my yaml file, after submixing them, how do I know what is the new label assigned to drums and bass ? Because I did not state that the new label of drums is 1 nor did I state that the new label of bass is 2.

Those numbers come from the official MIDI specification, which is reproduced here. Let's look at the example you posted (I've reordered it to explain it better). I'll annotate the file excerpt below to explain what's happening when it gets passed into submixes.py:
Mixing key: "program_num"     # This tells submixes to look at MIDI instrument program numbers.

Recipes:                      # This defines which instruments get mixed together as one submix.

  Bass:                       # This is the first submix, called "Bass".
    - 32                      # These numbers are all a list of MIDI instrument program numbers.
    - 33                      # These are interpreted as MIDI instrument program numbers because
    - 34                      #     "Mixing key" in line 1 is set to "program_num".
    - 35                      # Any instrument track in Slakh that has a "program_num" in this list
    - 36                      #      will be summed together to a submix file called "bass.wav"
    - 37
    - 38
    - 39
  Drums:                      # This is the second submix, called "Drums".
    - 128                     # This is another list of MIDI program_nums for "drums.wav".

So if you ran the submixes.py code with the above recipe (which it sounds like you did), you would have three submixes in each Slakh track (one bass.wav, one drums.wav, and one residuals.wav).
Matching to MUSDB18
How does this match up with MUSDB18? Well let's look at MUSDB18's instrument labels:

0 - The mixture
1 - The drums
2 - The bass
3 - The rest of the accompaniment
4 - The vocals

So it looks like the Slakh submix bass.wav matches with MUSDB's label 2 (bass), the Slakh submix drums.wav matches with MUSDB's label 1 (drums), and the Slakh submix residual.wav` matches MUSDB's label 3 (rest of accompaniment). (Notice there is no singing in Slakh, so no matching data for MUSDB's label 0, the vocals.)
So this is how the instrument labels match up. But before you dive into training, let's discuss a few things...
Training a network: .wav vs. .stempeg
As you mentioned, Slakh and MUSDB are both shipped with different data formats. So how are we supposed to train a model? Well, we simply have to convert one of the datasets to the other format. Which dataset should we convert? Well, if your ultimate goal is to train a model on both datasets, you want the data to be uncompressed (i.e., all your files should be .wav files, not .stempeg files).
The Native Instruments tool that you linked turns a set of .wav files into one .stempeg file; this is the opposite of what you want. You want to convert MUSDB18's stempeg files to a set of wav files.
(I'll note that Slakh also comes in a compressed format too, as .flac files. You probably already converted Slakh to .wav files. Converting MUSDB18 from .stempeg to .wav is an analogous process: compressed --> decompressed.)
Aside: On compressed audio signals
Why do we want our audio as wav files (uncompressed) rather than stempeg files (compressed)? stempeg files are compressed to save space in storage and transit (they're pretty much .mp4 files). But in order to actually access the data, you need to decompress it (sometimes called "decoding"). For listening to a song just once through Spotify or YouTube, this decompression step is quick enough to happen faster than real time so we can enjoy a song without even hearing this decompression happening. But when we're training a neural network, the network has to "hear" the audio many, many times faster than real time; it needs to "listen" to ~30-45 seconds of audio every second (note: this is a back-of-the-envolope calculation. Don't quote me on it 😅). That's just too much data to wait for it to be decompressed for every second of audio. (Not only that, but the data needs to be moved from the CPU to the GPU, which can be another huge bottleneck in the training process.) So this means that it's prudent to decompress your data to .wav files all before you start training.
Why .wav files? Well, as I've been alluding to, .wav files are uncompressed, which means that we can load them as numpy arrays very easily (or pytorch/tensorflow Tensors). They're pretty much numpy arrays stored to disk (*not exactly, but look into hdf5 or zarr for actually saving tensors to disk).
The Bottom Line
Convert all of your audio files to .wav files and save them to disk ahead of training. You will need access to a lot of storage (recall that Slakh is ~500Gb of data by itself). This will make training much faster.
Training with nussl and a tutorial
Okay, so how can you train a network using these datasets? Well, if you have any questions about any steps in the training process, I invite you to check out a tutorial my colleagues and I gave at ISMIR this year. All of the material is available here. It includes info on how to get your data set up, as well as practical tips and tricks for ensuring your project is successful.
The tutorial uses nussl, which already has a MUSDB18 dataset hook here (in depth details on how to use MUSDB18 are in the tutorial). There's also a Slakh2100 dataset hook in development here. It's not production ready yet, but feel free to look at it to see how you can use it for your project.
How do you combine them? Well that depends on how you're training and that's up to you. The way we did it in the paper was to train a model on one instrument in one dataset, and test the same instrument on the other dataset. But there are tons of ways to do it. So that's a decision you'll have to make as part of your experimental design process. The building blocks are all here ready to be used.
Best of luck!

Hi again!
Labeling of Instrument Tracks

From your advice, I should make use of submixing to achieve my goal. While submixing did provide me a new bass.wav, drums.wav and residuals.wav, it occurred to me that I do not know what are the new labels assigned to them. For example, given that the following is my yaml file, after submixing them, how do I know what is the new label assigned to drums and bass ? Because I did not state that the new label of drums is 1 nor did I state that the new label of bass is 2.

Those numbers come from the official MIDI specification, which is reproduced here. Let's look at the example you posted (I've reordered it to explain it better). I'll annotate the file excerpt below to explain what's happening when it gets passed into submixes.py:
Mixing key: "program_num"     # This tells submixes to look at MIDI instrument program numbers.

Recipes:                      # This defines which instruments get mixed together as one submix.

  Bass:                       # This is the first submix, called "Bass".
    - 32                      # These numbers are all a list of MIDI instrument program numbers.
    - 33                      # These are interpreted as MIDI instrument program numbers because
    - 34                      #     "Mixing key" in line 1 is set to "program_num".
    - 35                      # Any instrument track in Slakh that has a "program_num" in this list
    - 36                      #      will be summed together to a submix file called "bass.wav"
    - 37
    - 38
    - 39
  Drums:                      # This is the second submix, called "Drums".
    - 128                     # This is another list of MIDI program_nums for "drums.wav".

So if you ran the submixes.py code with the above recipe (which it sounds like you did), you would have three submixes in each Slakh track (one bass.wav, one drums.wav, and one residuals.wav).
Matching to MUSDB18
How does this match up with MUSDB18? Well let's look at MUSDB18's instrument labels:

0 - The mixture
1 - The drums
2 - The bass
3 - The rest of the accompaniment
4 - The vocals

So it looks like the Slakh submix bass.wav matches with MUSDB's label 2 (bass), the Slakh submix drums.wav matches with MUSDB's label 1 (drums), and the Slakh submix residual.wav` matches MUSDB's label 3 (rest of accompaniment). (Notice there is no singing in Slakh, so no matching data for MUSDB's label 0, the vocals.)
So this is how the instrument labels match up. But before you dive into training, let's discuss a few things...
Training a network: .wav vs. .stempeg
As you mentioned, Slakh and MUSDB are both shipped with different data formats. So how are we supposed to train a model? Well, we simply have to convert one of the datasets to the other format. Which dataset should we convert? Well, if your ultimate goal is to train a model on both datasets, you want the data to be uncompressed (i.e., all your files should be .wav files, not .stempeg files).
The Native Instruments tool that you linked turns a set of .wav files into one .stempeg file; this is the opposite of what you want. You want to convert MUSDB18's stempeg files to a set of wav files.
(I'll note that Slakh also comes in a compressed format too, as .flac files. You probably already converted Slakh to .wav files. Converting MUSDB18 from .stempeg to .wav is an analogous process: compressed --> decompressed.)
Aside: On compressed audio signals
Why do we want our audio as wav files (uncompressed) rather than stempeg files (compressed)? stempeg files are compressed to save space in storage and transit (they're pretty much .mp4 files). But in order to actually access the data, you need to decompress it (sometimes called "decoding"). For listening to a song just once through Spotify or YouTube, this decompression step is quick enough to happen faster than real time so we can enjoy a song without even hearing this decompression happening. But when we're training a neural network, the network has to "hear" the audio many, many times faster than real time; it needs to "listen" to ~30-45 seconds of audio every second (note: this is a back-of-the-envolope calculation. Don't quote me on it 😅). That's just too much data to wait for it to be decompressed for every second of audio. (Not only that, but the data needs to be moved from the CPU to the GPU, which can be another huge bottleneck in the training process.) So this means that it's prudent to decompress your data to .wav files all before you start training.
Why .wav files? Well, as I've been alluding to, .wav files are uncompressed, which means that we can load them as numpy arrays very easily (or pytorch/tensorflow Tensors). They're pretty much numpy arrays stored to disk (*not exactly, but look into hdf5 or zarr for actually saving tensors to disk).
The Bottom Line
Convert all of your audio files to .wav files and save them to disk ahead of training. You will need access to a lot of storage (recall that Slakh is ~500Gb of data by itself). This will make training much faster.
Training with nussl and a tutorial
Okay, so how can you train a network using these datasets? Well, if you have any questions about any steps in the training process, I invite you to check out a tutorial my colleagues and I gave at ISMIR this year. All of the material is available here. It includes info on how to get your data set up, as well as practical tips and tricks for ensuring your project is successful.
The tutorial uses nussl, which already has a MUSDB18 dataset hook here (in depth details on how to use MUSDB18 are in the tutorial). There's also a Slakh2100 dataset hook in development here. It's not production ready yet, but feel free to look at it to see how you can use it for your project.
How do you combine them? Well that depends on how you're training and that's up to you. The way we did it in the paper was to train a model on one instrument in one dataset, and test the same instrument on the other dataset. But there are tons of ways to do it. So that's a decision you'll have to make as part of your experimental design process. The building blocks are all here ready to be used.
Best of luck!

Hi,
Thank you for your clarification and explanation. I think understand the situation slightly better :)

Hi,
Thank you for your clarification and explanation. I think understand the situation slightly better :)

Closing due to lack of activity. Feel free to reopen if you have more questions.


Missing text mesh pro dependency in examples.

Sorry for the PR's on individual files...I'm just using the github web-based file editor to make patches.
My dependency walker found several issues such as:
Examples contains asset Common\Prefabs\HandMenu_Large_AutoWorldLock_On_HandDrop.prefab, that depends on Packages/com.unity.textmeshpro/Scripts/Runtime/TextMeshPro.cs, but package dependency is missing.
The asmdef does contain the reference, but that doesn't guarantee they have the package reference.

This will ultimately be resolved by a dependency of TMP on the standard assets package (#8761) as all other MRTK packages contain a dependency to that one.

sorry this is so fragmented...if I knew ahead of time I was going to be making several PR's I wouldn't have used the web-based file patcher.
re: gettting TMP from standard assets, see my comment here https://github.com/microsoft/MixedRealityToolkit-Unity/pull/8759#issuecomment-704396342

Replaced by #8764


Disabling cache?

Hi everyone,
When I open a PDF file with the viewer, then destroy the file on the server, and refresh the viewer... The PDF file still can be oppened.
How can I disable this? With disabling the cache I assume, but how ?
Thanks for any help.
Bruno

PDF.js does not store any files and relies on browser to provide the data. In most cases it's either browsers cache (erase browser's cache) or your hosting aggressive caching (disable that or just wait couple of days). Closing as answered.

I'm using pdf.js to have an overview of a PDF file while creating it online... So I must have an overview refreshing everytime... Do I have to rename the file everytime with a random name?

Do I have to rename the file everytime with a random name?

Too little information is provided about a problem. If the issue with the hosting site, please consult with them to provide more efficient solution.

I asumed it was an issue with the viewer and not the host since if I open the PDF file directly in the browser (with Chrome for example), it is correctly refreshed.

You can disable cache by making changes in pdf.js file under defaultPreferences
Open  your pdf.js file and update as follow -
Set showPreviousViewOnLoad = false,
defaultPreferences = Promise.resolve({       "showPreviousViewOnLoad": false,        ....


Remove faulting property location from azapi_resource

Overview/Summary
Corrects the property bag for the azapi_resource that creates diagnostic settings on management groups. It doesn't support a location property.
This PR fixes/adds/changes/removes

#1052

Breaking Changes
N/A
Testing Evidence
N/A
As part of this Pull Request I have

[x] Checked for duplicate Pull Requests
[x] Associated it with relevant issues, for tracking and closure.
[x] Ensured my code/branch is up-to-date with the latest changes in the main branch
[x] Performed testing and provided evidence.
[ ] Updated relevant and associated documentation.

This might also finally close #672 ?

please can this be merged? also facing this issue

/azp run unit


keynav: use correct ExecStart command

Fixes issue #1177
Description
When the change requested in https://github.com/rycee/home-manager/pull/1082#discussion_r392715440 was applied, the service ExecStart attribute was not updated to use pkgs.keynav.
Checklist

[x] Code formatted with ./format.

[x] Code tested through nix-shell --pure tests -A run.all.

[ ] Test cases updated/added. See example.

No test case exist for this service.

[x] Commit messages are formatted like
{component}: {description}

{long description}

See CONTRIBUTING for more information and recent commit messages for examples.

Thanks for the fix! Rebased to master in ee1c40e5c52e5eb32d7a4ffb9dbfe838644a64ea.


The ability to set a minimum \ maximum size of the cropped image

+1

+1

+1

+1

+1

Hi,
Sorry for late response.
Version 1.1.0 has been released.
SimpleCropView now supports maximum output width and height.


fix(cli): properly exit with code 1 on panic when running with bun

Found out about this when testing #10569 (maybe bun handles this differently when using NAPI?)

do we really need to do anything about it? sounds like a bug in bun and we should just report it to bun instead of adding a workaround?

I'm not even sure if it's really a bug in bun, or just a ""feature"" of Node.js 😂 makes sense anyway for us to catch_unwind here, we're running Rust from another language


sync hash api with ark-sponge

Description

closes: #15

Before we can merge this PR, please make sure that all the following items have been
checked off. If any of the checklist items are not applicable, please leave them but
write a little note why.

[x] Targeted PR against correct branch (main)
[x] Linked to GitHub issue with discussion and accepted design OR have an explanation in the PR that describes this work.
[x] Wrote unit tests
[x] Updated relevant documentation in the code
[ ] Added a relevant changelog entry to the Pending section in CHANGELOG.md
[x] Re-reviewed Files changed in the GitHub PR explorer

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

flavoring #146


Fix: use full paths with .js extension on esm mode

As explained on Discord:
When using<EMAIL_ADDRESS>and<EMAIL_ADDRESS>the SSR build fails with these kind of errors:
Error [ERR_MODULE_NOT_FOUND]: Cannot find module '/{pnpm path}/node_modules/naive-ui/es/alert/src/Alert' imported from /{pnpm path}/node_modules/naive-ui/es/alert/index.js

This is not the first error, I've modified many places inside the compiled naiveui package, like this:
 // example
 // When dealing with files, vite-ssg only finds them if I add the extension:
-export { default as dateNbNO } from './date/nbNO';
+export { default as dateNbNO } from './date/nbNO.js';
 // When dealing with directories, I must add the index file path:
-export { createLocale } from './utils';
+export { createLocale } from './utils/index.js';

Related:
https://github.com/antfu/vite-ssg/issues/201
https://github.com/antfu/vite-ssg/issues/205
This PR add a post-build step with Babel to automatically resolve all relative file imports, adding the .js extension or /index.js when importing from a directory. (obs: it's also necessary to change the locale import from date-fns to date-fns/locales/en-US/index.js)
As discussed on discord, I don't expect this PR to be merged, but would like to have a solution to be able to use the latest vite-ssg. Thank you very much.

This is not the only package I had to modify to get the build running - I also applied this solution to vueuc and css-render.

Related: https://github.com/antfu/vite-ssg/discussions/217


Optional chaining barks an error ...

I thought this may have been tied to this issue (https://github.com/babel/babel-eslint/issues/511), but it does not happen in Atom's eslint package (https://github.com/AtomLinter/linter-eslint).

This error doesn't come from ESLint. It has [ts] in front. You can disable JS/TS checking using the TS language server in VS Code.
I am closing the issue. If you think this is a bug in VS Code please report the issue in the vscode repository.

@dbaeumer, that sounds totally reasonable ... but, I have this in my user settings:
"typescript.validate.enable": false,

And if I uninstall this extension the error goes away.

This is very wired since the error clearly has [ts] in its message. If it would be an eslint generated messages it would be [eslint]. Can you provide me with a GitHub repository I can clone that demos this?

The @ryanpcmcquen I see the errors but they clearly come from the TS compiler. They are still there even if I disable ESLint for that workspace. Please report the problem aginst the TS support in VS Code.

Thanks @dbaeumer. Will do.


Fixed missing PRs in the changelog

Doesn't have to be now, but we should switch to sphinx-issues at some point, it's a lot less typing.

I did not know sphinx-issues, it looks great!


feat: watchlist for videos

🛠 Fixes Issue: #113
👨💻 Changes proposed:
I have added the watchlist feature to add a video to the watchlist and also created a separate watchList section where you can see the watchlisted videos as we see on youtube
📝 Additional Notes
There are many issues and code repetition in the codebase, which initially created some errors in my setup. Since there is no live URL for this project so I didn't conclude if the issues are showing only for my setup or not. I have raised an issue about that.
Discord username
Vizard#6025
Link to any external resources

📷 Screenshots

✔ Check List (Check all the applicable boxes)

[x] My code follows the code style of this project.
[x] The title of my pull request is a short description of the requested changes.
[x] I am a participant of GSSOC23

@Fenrir-04 you have mistakenly added 2 labels(level2 and level3) in this pr.

@suzy-g38 I removed it earlier but I guess my wifi was not working, thanks anyway 👍

@suzy-g38 I removed it earlier but I guess my wifi was not working, thanks anyway 👍

@Fenrir-04 no issue...thank you


Messes up quoted text

Issue Type: Bug
While editing HTML code, when you try to correct some quoted text, by removing or adding a double quote it messes up all quoted string below that edit point. IT ADDS A SINGLE SPACE BEFORE END QUOTE  - THIS MESSES UP THE NAMES AND IDS AND PROGRAM STARTS CRASHING.

I may not have configured my auto formating, but no matter what, the above behavious is very bad and should not happen.
VS Code version: Code 1.56.2 (054a9295330880ed74ceaedda236253b4f39a335, 2021-05-12T17:13:13.157Z)
OS version: Windows_NT x64 10.0.19042

System Info

Item
Value

CPUs
Intel(R) Core(TM) i5-8400 CPU @ 2.80GHz (6 x 2808)

GPU Status
2d_canvas: enabledgpu_compositing: enabledmultiple_raster_threads: enabled_onoop_rasterization: enabledopengl: enabled_onrasterization: enabledskia_renderer: enabled_onvideo_decode: enabledvulkan: disabled_offwebgl: enabledwebgl2: enabled

Load (avg)
undefined

Memory (System)
7.87GB (4.33GB free)

Process Argv
--crash-reporter-id e1abad41-da77-4e73-8b8b-ed9adf154fe1

Screen Reader
no

VM
0%

Extensions (11)

Extension
Author (truncated)
Version

vscode-eslint
dba
2.1.20

vscode-html-css
ecm
1.10.2

php-debug
fel
1.15.1

php-intellisense
fel
2.3.14

php-pack
fel
1.0.2

node-module-intellisense
lei
1.5.0

vscode-JS-CSS-HTML-formatter
lon
0.2.3

csharp
ms-
1.23.11

cpptools
ms-
1.3.1

powershell
ms-
2021.2.2

pdf
tom
1.1.0

A/B Experiments
vsliv368:30146709
vsreu685:30147344
python383:30185418
pythonvspyt678:30270856
pythonvspyt602:30300191
vspor879:30202332
vspor708:30202333
vspor363:30204092
pythonvspyt639:30300192
pythontb:30283811
vspre833cf:30267465
pythonptprofiler:30281270
vshan820:30294714
pythondataviewer:30285071
vscus158:30286553
vscgsv2:30307504
vscorehovct:30302760
bridgeflight:30302069
vscod805:30301674

Can you add a small code sample an steps to illustrate that? Also check whether it reproduces with extensions disabled.

Thanks @isambi
I think I understand the problem, but not sure how this should be tackled. Yes, formatting incomplete may result in strange formats. It depends on the actual formatter and how the formatter deals with incomplete code.
I tried to reproduce it with the built-in HTML formatter but was not able to get extra spaces. Which formatter do you use for HTML? Maybe

Hi Martin:
I had reset all my settings by editing the settings.json and now it is not
happening.
It is something to do with a combination of settings. The frustrating part
was that even if I removed the space manually, it was putting it back right
away !!!
I will keep an eye and if it happens again, I will send you more info.
Sorry, I wasn't much help.
Inderjit
On Mon, May 31, 2021 at 8:20 AM Martin Aeschlimann @.***>
wrote:

Thanks @isambi https://github.com/isambi
I think I understand the problem, but not sure how this should be tackled.
Yes, formatting incomplete may result in strange formats. It depends on the
actual formatter and how the formatter deals with incomplete code.
I tried to reproduce it with the built-in HTML formatter but was not able
to get extra spaces. Which formatter do you use for HTML? Maybe
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/microsoft/vscode/issues/124540#issuecomment-851453222,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AMQ5LVS6JLVAZNMLMMWHJU3TQN5KFANCNFSM45OK2VTA
.

Thanks
On Fri, Aug 20, 2021 at 9:09 AM Martin Aeschlimann @.***>
wrote:

Closed #124540 https://github.com/microsoft/vscode/issues/124540.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/microsoft/vscode/issues/124540#event-5186741259, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/AMQ5LVUUFG7EMB5CFPF5SJTT5ZHYRANCNFSM45OK2VTA
.
Triage notifications on the go with GitHub Mobile for iOS
https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675
or Android
https://play.google.com/store/apps/details?id=com.github.android&utm_campaign=notification-email
.


Fixed #25349 - ModelForm bug that occurs when saving None value to a ForeignKey with null=True, blank=False and required=False.

https://code.djangoproject.com/ticket/25349

buildbot, add to whitelist.

Ready for a rebase after 04e13c89138d48c20e774a2b6bf06796f73ac0fe

updated and merged in 375e1cfe2b2e1c3c57f882147c34902c6e8189ac, thanks!


Parse SPARQL QL Queries in ANTLR

Complete the last two pieces of query parsing in ANTLR: ConstructQuery and Query.
TODO:

[x] Tests
[ ] resolve the introduced Todos

https://github.com/ad-freiburg/qlever/blob/0692f13182647a27cadd22b6e4421765a57afb72/src/parser/SparqlParser.cpp#L18-L20
The lexer is now only used in SparqlParser::parseFilter and SparqlParser::parseFilter. The creation of the lexer could maybe be postponed to a later time.

Another thing that may be worth testing for in the future is the visible variables. They are now in every parsed query and use in quite some places. I'm currently trying if that can be done easily.


Fix .form-control-plaintext for select, textarea

hide select "arrow" (icon at right center) and textarea "resizer" (icon at right bottom)

@ffoodd

BTW would you mind adding selet and textarea examples to the Readonly plain text docs part?

ok!


Nodejs wrapper layer not producing traces for basic lambda

Describe the bug
The instrumentation layer for Nodejs does not seem to produce a trace when a HTTP request is received by the lambda
Steps to reproduce

Create a new lambda
Add nodejs instrumentation layer (compiled from this repo)
Set environment variable to point to wrapper (AWS_LAMBDA_EXEC_WRAPPER)
issue request to lambda

What did you expect to see?
Expected to see a trace in the Cloudwatch logs
What did you see instead?
Function Logs
Registering OpenTelemetry
@opentelemetry/api: Registered a global for diag v1.4.1.
AwsLambdaDetector found resource. Resource {
_attributes: {
'cloud.provider': 'aws',
'cloud.platform': 'aws_lambda',
'cloud.region': 'us-west-2',
'faas.name': 'sid-otel-nodejs',
'faas.version': '$LATEST'
},
}
... snip ...
@opentelemetry/api: Registered a global for trace v1.4.1.
@opentelemetry/api: Registered a global for context v1.4.1.
Applying patch for net module
2023-05-12T20:50:10.319Z	undefined	DEBUG	@opentelemetry/instrumentation-http Applying patch for<EMAIL_ADDRESS>START RequestId: 6ac876c6-8496-49bc-a1a1-4daf8eaf3445 Version: $LATEST
< Should be trace logs here?>
END RequestId: 6ac876c6-8496-49bc-a1a1-4daf8eaf3445
REPORT RequestId: 6ac876c6-8496-49bc-a1a1-4daf8eaf3445	Duration: 6.42 ms	Billed Duration: 7 ms	Memory Size: 128 MB	Max Memory Used: 114 MB	Init Duration: 1165.34 ms

What version of collector/language SDK version did you use?
Latest version compiled from codebase
What language layer did you use?
Nodejs 18

Cc @martinkuba

@sgracias1 Make sure that X-Ray is enabled for your function, otherwise no traces will be sampled. Or, you can override the sampler using the OTEL_TRACES_SAMPLER env variable.

@martinkuba I did get the sample app in the repo uploaded through terraform working, so this seems like an issue with my application. I will close this ticket out and investigate the difference


update meshery architecture diagrams

Signed-off-by: lolyparty<EMAIL_ADDRESS>Description
This PR fixes #1615
Notes for Reviewers
Signed commits

[x] Yes, I signed my commits.

Can you please explain how to download them as svg?  Because the files in the drive are all PNG

For posterity -


Fixed Header Navbar Shadow on Mobile

The header navbar shadow seems to be there as a UX hint to indicate mobile users that there's more content and they can scroll to view that.
Unfortunately it's kind of broken now and looks really bad both on Android and iOS and even just viewing the website in narrow browser widths. The shadows on both sides are always there and don't really work well for the thing they are supposed to help with and look plain ugly and broken.
I've added a little bit of spacing inside the navbar on both sides to make shadow go away and look like it's not there when it reaches the ends of the scrollable container and there's nothing else to scroll to.
Here's the before and after screenshots:

And here's an ZIP archive with two quick screen recordings of the scrolling behavior before and after the change.
This is a pretty minor change and shouldn't affect anything, but actually not sure if I've organized the CSS right and it's consistent throughout the codebase. Let me know if there's anything that needs to be tweaked. Thanks!

Happy to revisit this if you can rebase and confirm it's still alright?

@threepointone rebased and tested again. Thank you!


feat: parser to parse test files and load testcases

There are a large number of positive paths in visitor.go without test coverage.

Fixed most of them. Rest of them need a grammar change, I missed few literal types for test cases.


There is no existing directory at "/var/log/app_engine" and its not buildab

This error when deploying an symfony 4 to app engine using memorystore to system cache
cache and monolog config
framework:
        cache:
                app: cache.adapter.redis
                system: cache.adapter.redis
                default_redis_provider: "redis://%env(resolve:REDIS_HOST)%:%env(resolve:REDIS_PORT)%"
monolog:
    handlers:
        main:
            type: fingers_crossed
            action_level: error
            handler: nested
            excluded_404s:
                # regex: exclude all 404 errors from the logs
                - ^/
        nested:
            type: stream
            path: "%kernel.logs_dir%/%kernel.environment%.log"
            level: debug
        console:
            type:   console
            process_psr_3_messages: false
            channels: ["!event", "!doctrine"]
        cloud:
            type: service
            id: 'Google\Cloud\Core\Logger\AppEngineFlexHandler'
            level: debug

Step #1: ocramius/package-versions: ...done generating version class
Step #1: Executing script cache:clear [KO]
Step #1:  [KO]
Step #1: Script cache:clear returned with error code 1
Step #1: !!
Step #1: !!  In StreamHandler.php line 171:
Step #1: !!
Step #1: !!    There is no existing directory at "/var/log/app_engine" and its not buildab
Step #1: !!    le: Permission denied
Step #1: !!
Step #1: !!
Step #1: !!
Step #1: Script @auto-scripts was called via post-install-cmd
Step #1: The command '/bin/sh -c /build-scripts/composer.sh' returned a non-zero code: 1
Finished Step #1
ERROR
ERROR: build step 1 "gcr.io/cloud-builders/docker@sha256:9635fb8af170fc70187d1ce23155ad5c45aa7b12840505c8d988a65c1640d027" failed: exit status 1
Step #1:

may relate to this, at least the error seems to be equal
https://github.com/GoogleCloudPlatform/google-cloud-python/pull/3410
https://github.com/GoogleCloudPlatform/google-cloud-python/issues/2997

I do not know if it's really on docker or php cloud package


UAC management for an app build with electron-packager

Hi
I used the winreg npm package for my app and I need elevated privileges for the uses I have.
I would like to associate a manifest file with an app build with electron (atom-shell) and packaged on windows with electron-packager but I can not find any way to do it easily.
An old app of mine was made with cx_freeze and and it sufficed to put the file with the name app.exe.manifest in the same directory.
I can't understand why it doesn't work this time.

Check node-runas

Hi,
I solved this problem.
So first to know is an external manifest won't count if an embedded manifest is already present. (see answer to http://superuser.com/questions/905103/what-does-it-mean-to-enable-windows-to-prioritise-external-manifests)
And it turns out that the electron.exe has already a manifest embedded and the package done with electron-package is mostly a rename of the electron executable.
So in order to embed a news manifest with the right privileges needed, I took the manifest in the electron repo (https://github.com/atom/electron/blob/master/atom/browser/resources/win/atom.manifest), edited the security section and used the mt.exe tool to add the new manifest https://msdn.microsoft.com/en-us/library/aa375649(v=vs.85).aspx
And tadaa !


Star Rail Player.log file not populating when launched via Collapse

I am unsure if this is a launcher issue or not however when launching the game via Collapse the Player.log file in the %appdata%\..\LocalLow\Cognosphere\Star Rail\ directory is not being populated. The file is populated when running via the official launcher and via starting the StarRail.exe directly which gives me the reason to believe its the way the launcher is launching the game exe. Other files in the same directory are being populated such as the output_log.txt.
This file is being used by one of the only wish counters available currently to find the game directory.
https://gist.github.com/Star-Rail-Station/2512df54c4f35d399cc9abbde665e8f0

Cannot reproduce this issue on <IP_ADDRESS> (currently only available on Stable channel)

both files were deleted prior to launching with Collapse
Can you send Collapse log when its starting a game?

Yes it seems to only populate the file when show console is turned on in the launcher settings.
When the console is not shown the file does not seem to populate for me.
Console log doesn't show anything useful, but here it is.

Console Log
There is more but its trimmed down to save space, the continued part is just normal stuff that I get when I launch normally.
[Schm]  Running Collapse Launcher [1.69.15], [Stable], under Windows 11 (build: 22621.0), as jonat
[Schm]  Runtime: .NET 7.0.2 - WindowsAppSDK 1.3
[Schm]  Locale file: en-us.json loaded as English by neon-nyan, CryoTechnic
[Schm]  Locale file: id-id.json loaded as Bahasa Indonesia by neon-nyan
[Schm]  Locale file: ko-kr.json loaded as 한국어 by despenser08
[Schm]  Locale file: pt-pt.json loaded as Português (Portugal) by gablm
[Schm]  Locale file: vi-vn.json loaded as Tiếng Việt by kleqing
[Schm]  Locale file: zh-cn.json loaded as 简体中文 by misaka10843
[Info]  Discord Presence DLL: C:\Program Files\Collapse Launcher\app-1.69.15\Lib\discord_game_sdk.dll doesn't exist! The Discord presence feature could not be used.
[Info]  Welcome to Collapse Launcher v1.69.15 - Windows 11 (build: 22621.0)
[Info]  Application Data Location:
      C:\Users\jonat\AppData\LocalLow\CollapseLauncher
[Info]  Getting CDN Content from: GitHub at URL: https://github.com/neon-nyan/CollapseLauncher-ReleaseRepo/raw/main/notification_stable.json
[Info]  Getting CDN Content from: GitHub at URL: https://github.com/neon-nyan/CollapseLauncher-ReleaseRepo/raw/main/squirrel/stable/RELEASES?arch=x64&os=windows
[Schm]  Initializing Honkai: Star Rail - Global...
[Schm]  Initializing Region Honkai: Star Rail (Global) Done!
[Info]  Getting CDN Content from: GitHub at URL: https://github.com/neon-nyan/CollapseLauncher-ReleaseRepo/raw/main/stable/fileindex.json
[Info]  Getting CDN Content from: GitHub at URL: https://github.com/neon-nyan/CollapseLauncher-ReleaseRepo/raw/main/metadata/metadatav2_stablestamp.json
[Schm]  Page changed to App Settings
[Schm]  Page changed to Launcher
[Info]  Running game with parameters:

[Warn]  ================================================ GAME STARTED ================================================
[Game]  Loading player data from C:/Program Files/Star Rail/Games/StarRail_Data/data.unity3d
[Game]  Initialize engine version: 2019.4.34f1 (e38ae60407)
[Game]  [Subsystems] Discovering subsystems at path C:/Program Files/Star Rail/Games/StarRail_Data/UnitySubsystems
[Game]  GfxDevice: creating device client; threaded=1
[Game]  Direct3D:
[Game]      Version:  Direct3D 11.0 [level 11.1]
[Game]      Renderer: NVIDIA GeForce RTX 3060 Laptop GPU (ID=0x2520)
[Game]      Vendor:
[Game]      VRAM:     6009 MB
[Game]      Driver:   <IP_ADDRESS>41
[Game]  WARNING: Shader Unsupported: 'Unlit/GLESDummyDepth' - All passes removed
[Game]  WARNING: Shader Did you use #pragma only_renderers and omit this platform?
[Game]  ERROR: Shader Unlit/GLESDummyDepth shader is not supported on this GPU (none of subshaders/fallbacks are suitable)
[Game]  <RI> Initializing input.
[Game]
[Game]  <RI> Input initialized.
[Game]
[Game]  <RI> Initialized touch support.
[Game]
[Game]  UnloadTime: 0.647400 ms
[Game]  InControl (version 1.8.8 build 9375)
[Game]  UnityEngine.Logger:Log(LogType, Object)
[Game]  UnityEngine.Debug:Log(Object)
[Game]  System.Action`1:Invoke(T)
[Game]  InControl.InControlManager:OnEnable()
[Game]
[Game]  (Filename: D:\RPGEngine\EngineWindowsBuildEngine\rpg_engine\Runtime/Export/Debug/Debug.bindings.h Line: 39)
[Game]
[Game]  WwiseUnity: Wwise(R) SDK Version 2019.2.14 Build 7616.
[Game]  UnityEngine.Logger:LogFormat(LogType, String, Object[])
[Game]  UnityEngine.Debug:LogFormat(String, Object[])
[Game]  AkWwiseInitializationSettings:InitializeSoundEngine()
[Game]  AkInitializer:OnEnable()
[Game]
[Game]  (Filename: D:\RPGEngine\EngineWindowsBuildEngine\rpg_engine\Runtime/Export/Debug/Debug.bindings.h Line: 39)
[Game]
[Game]  WwiseUnity: Setting Plugin DLL path to: C:/Program Files/Star Rail/Games/StarRail_Data\Plugins\x86_64
[Game]  UnityEngine.Logger:Log(LogType, Object)
[Game]  UnityEngine.Debug:Log(Object)
[Game]  AkCommonPlatformSettings:get_AkInitializationSettings()
[Game]  AkWwiseInitializationSettings:InitializeSoundEngine()
[Game]  AkInitializer:OnEnable()
[Game]
[Game]  (Filename: D:\RPGEngine\EngineWindowsBuildEngine\rpg_engine\Runtime/Export/Debug/Debug.bindings.h Line: 39)
[Game]
[Game]  WwiseUnity: Sound engine initialized successfully.
[Game]  UnityEngine.Logger:Log(LogType, Object)
[Game]  UnityEngine.Debug:Log(Object)
[Game]  AkWwiseInitializationSettings:InitializeSoundEngine()
[Game]  AkInitializer:OnEnable()
[Game]
[Game]  (Filename: D:\RPGEngine\EngineWindowsBuildEngine\rpg_engine\Runtime/Export/Debug/Debug.bindings.h Line: 39)

.......

Cause found
-nolog parameter is appended to launch option when Collapse console is disabled.
Source:
https://github.com/neon-nyan/Collapse/blob/6b371b48737a8517cb56d2be0d1bbb1c2281a6f5/CollapseLauncher/XAMLs/MainApp/Pages/HomePage.xaml.cs#L705-L706
Removing that logic fixed the behavior of log not being generated when Collapse console is disabled
Other (potential) problem
Removing that logic will still append game logs to Collapse log, even when console is disabled, which IMO is fine.
Current workaround
Enable Console in Collapse Settings.
Planned bug fix release
1.70.0

Late to the party... Is it me or is '-nolog' still appended to the executable when the console is not enabled? As the Player.log file is still not populating.
This is from the latest preview build:
https://github.com/neon-nyan/Collapse/blob/c82ccfcf2fbd671e6fdd6c680eabcfe3163c46b8/CollapseLauncher/XAMLs/MainApp/Pages/HomePage.xaml.cs#L706-L707

I checked and my player.log is also not populating, although it think it did work for a while when @bagusnl came up with a fix for the issue.
Removing those two lines seems to indeed solve the issue.

I was legit not aware that there were 2 of the same thing, and how did it worked as early as last time I tested it was 1.70.4 ???
But thank you for noticing it, we'll wait for neon/cry0 to merge this and fix said issue. Sorry for my dumbass brain not re-checking it again.


GHDL module

Do you plan to add GHDL module support for mixed language? Thanks!

If someone provides a Wasm build of GHDL yes. Otherwise no.
As far as I know it is not currently possible to compile Ada to Wasm due to compiler deficiencies (nested function ABI requirements).

I imagined it was complex.... thanks!


Reduce Primitive components to one with tag name props

I would like to propose a different option for creating primitive components. Now the code literally creates 16 components in a loop using reduce and additionally spread operator to create a new object.
https://github.com/radix-vue/radix-vue/blob/73c3303d0eaa5c1aea11632d150770920b64f26a/packages/radix-vue/src/Primitive/Primitive.vue#L119-L123
I don't see any reason for this. Wouldn't it be easier to just create one component with a prop for tag name? We can do something similar to headless-ui with a "as" props. If you still want to maintain a similar api to radix, you could treat :asChild="true" as as="template".
<template>
  <PrimitivButton>
    ...
  </Primitive>
</template>

<template>
  <Primitive as="button">
    ...
  </Primitive>
</template>

<template>
  <PrimitivButton asChild>
    ...
  </Primitive>
</template>

<template>
  <Primitive as="template">
    ...
  </Primitive>
</template>

Here's an example of how I would do it.
import {
  defineComponent,
  h,
  mergeProps,
  cloneVNode,
  type PropType,
  Fragment,
  type VNode,
} from "vue";
import { renderSlotFragments, isValidVNodeElement } from "@/shared";

type AsTag =
  | "a"
  | "button"
  | "div"
  | "form"
  | "h2"
  | "h3"
  | "img"
  | "input"
  | "label"
  | "li"
  | "nav"
  | "ol"
  | "p"
  | "span"
  | "svg"
  | "ul"
  | "template";

const throwError = (componentName: string) => {
  throw new Error(
    [
      `Detected an invalid children for \`${componentName}\` with \`asChild\` prop.`,
      "",
      "Note: All components accepting `asChild` expect only one direct child of valid VNode type.",
      "You can apply a few solutions:",
      [
        "Provide a single child element so that we can forward the props onto that element.",
        "Ensure the first child is an actual element instead of a raw text node or comment node.",
      ]
        .map((line) => `  - ${line}`)
        .join("\n"),
    ].join("\n")
  );
};

export const Primitive = defineComponent({
  inheritAttrs: false,
  props: {
    asChild: {
      type: Boolean,
      default: false,
    },
    as: {
      type: String as PropType<AsTag>,
      default: "div",
    },
  },
  setup(props, { attrs, slots }) {
    const asTag = props.asChild ? "template" : props.as;

    if (asTag !== "template") {
      return () => h(props.as, attrs, { default: slots.default });
    }

    return () => {
      if (!slots.default) return null;
      const childrens = renderSlotFragments(slots.default());

      if (childrens.length !== 1) throwError(asTag);

      const firstChildren = childrens[0];
      if (!isValidVNodeElement(firstChildren)) throwError(asTag);

      if (Object.keys(attrs).length > 0) {
        // remove props ref from being inferred
        delete firstChildren.props?.ref;
        const mergedProps = mergeProps(attrs, firstChildren.props ?? {});
        delete firstChildren.props?.class;

        const cloned = cloneVNode(firstChildren, mergedProps);
        // Explicitly override props starting with `on`.
        // It seems cloneVNode from Vue doesn't like overriding `onXXX` props. So
        // we have to do it manually.
        for (const prop in mergedProps) {
          if (prop.startsWith("on")) {
            cloned.props ||= {};
            cloned.props[prop] = mergedProps[prop];
          }
        }

        return cloned;
      }

      return firstChildren;
    };
  },
});

Would love to know what maintainers think about this. It would be a pretty big change to the codebase, but I think it's worth it.

@zernonia , interesting

This is a good suggestion! Though the loop doesn't effect much in small app, but I can foresee the improvement in terms of performance in larger app!

I think with this we could expose another api, as="" similar to HeadlessUI. Some people were asking about that and I think making being able to change the element type directly instead of making a child component is a great plus

Good point @khairulhaaziq ! Im really digging this approach, and the as= prop. And if user wanted to use custom component, they can just use as=template, which would perform the same the current asChild.

we can keep both I think if that's possible! yeah just create a PR!


[WIP] docs(security/dart): new chapter

Current version has 2/3 of the TS counterpart.
Contributes to #1812.

@naomiblack @mprobst @kwalrath : here is a Dart version of the security guide. It occurred to me that 2/3 of the chapter content was currently relevant, and so here it is :).
As usual, if you want to see the TS-side .jade file differences, it is best to ignore whitespace, either by following this file-diff link or appending ?w=1 to your URL when you are viewing the diff on GitHub. You will notice that the TS-side .jade has very few changes: mainly just new block headers and a few change in docregion tag names.

Currently the security features have not been implemented in a Dart version, so the implementation cannot work. I think we should hold off on this until we have clarified & implemented the corresponding features in Dart.

HTML escaping is implemented (being such a basic feature). The rest of the Dart chapter are guidelines (which apply just as well to TS and Dart). The Dart chapter does not mention any unimplemented features. I think that there is value to our readers to include the security guidelines that are applicable & implemented now. (My 2 cents).

@chalin what is the status of this?

@Foxandxss - latest news I had was the the requisite security functionality was on its way (and might be completed); but there has been a rush to prepare things for the Dart Summit next week so I'm not sure when this will get approved.

I've staged this here: https://kw-angular-io.firebaseapp.com/docs/dart/latest/guide/security.html

Superseded by https://github.com/angular/angular.io/pull/3017. @chalin if it should be reopened let me know.

@filipesilva - thanks, for closing this PR.

#3017 covers TS changes
Dart side updates will be tracked via https://github.com/dart-lang/site-webdev/pull/270


Prevent admin from creating two users of the same name

The title is quite self-explanatory

Was added in #53


Unable to use with Typescript

Steps to reproduce
Add the following lines to your typescript file.
const config = getPersistConfig({
    key: 'root',
    storage, // whatever storage you use
    whitelist: ['property1.a1.b1', 'property1.a2.b2.c2', 'property2.a2'],
    rootReducer // your root reducer must be also passed here
});

Expected Outcome
ESLint does not show any errors.
Actual Outcome
ESLint repeatedly say Unsafe call of an 'any' typed value and Unsafe assignment of an any type value

Hi @samitha9125, can you please provide more details? I checked this and the typescript validates everything as expected.
Where do you get this error from? Is this coming from getPersistConfig call? Can you show me your entire config and reducers? Also, any screenshot of the error would be helpful to me. Thank you.

Closing. I couldn't reproduce this issue. Without more details, I won't be able to help.


improve new-version

[ ] make the script runnable like ./new-version.h, without an arg. it should get the version from the root package.json.

[ ] also it should check if the latest version is the current version, and dont do anything in that case

[ ] check if i can make greenkeeper and travis work together, so that when greenkeeper fires, it should make a pr to the master, but also to the project branch. on the master, it should just update the package.json. on the project branch, it should create a pr with the changed files? or maybe just pushing directly is good enough, without the hassle of two prs, but just one on master.

[ ] pull on all branches before doing any work when running the script.

Most of these are obsolete with the new grid system.

It looks there should be some logic for overlapping versions as well. For instance, the diff entries generated for 0.58.5 are overlapping with the 0.59-rc releases, and even if that is just because of the RC status on 0.59, it is conceivable that a 0.58.6 could overlap with a real 0.59.0

Indeed. I am working on something like a grid. I want to change the new-version script to get the correct previous version, and then to make a table with the releases, and diffs for all possibilities.

Done