[GLUTEN-4653][TEST][VL] Disable spark and gluten ui in velox backend unit test

…unit test
What changes were proposed in this pull request?
As title
Close #4653
How was this patch tested?
CI
Test local with mvn clean test -Pspark-3.3 -Pbackends-velox -Dtest=none -DwildcardSuites=io.glutenproject.execution.VeloxTPCHV1Suite  -DfailIfNoTests=false
Before this:
VeloxTPCHV1Suite:
24/02/05 09:13:45 INFO SparkContext: Running Spark version 3.3.1
24/02/05 09:13:45 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
24/02/05 09:13:45 INFO ResourceUtils: ==============================================================
24/02/05 09:13:45 INFO ResourceUtils: No custom resources configured for spark.driver.
24/02/05 09:13:45 INFO ResourceUtils: ==============================================================
24/02/05 09:13:45 INFO SparkContext: Submitted application: test-sql-context
24/02/05 09:13:46 INFO ResourceProfile: Default ResourceProfile created, executor resources: Map(cores -> name: cores, amount: 1, script: , vendor: , memory -> name: memory, amount: 1024, script: , vendor: , offHeap -> name: offHeap, amount: 2048, script: , vendor: ), task resources: Map(cpus -> name: cpus, amount: 1.0)
24/02/05 09:13:46 INFO ResourceProfile: Limiting resource is cpu
24/02/05 09:13:46 INFO ResourceProfileManager: Added ResourceProfile id: 0
24/02/05 09:13:46 INFO SecurityManager: Changing view acls to: root
24/02/05 09:13:46 INFO SecurityManager: Changing modify acls to: root
24/02/05 09:13:46 INFO SecurityManager: Changing view acls groups to:
24/02/05 09:13:46 INFO SecurityManager: Changing modify acls groups to:
24/02/05 09:13:46 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users  with view permissions: Set(root); groups with view permissions: Set(); users  with modify permissions: Set(root); groups with modify permissions: Set()
24/02/05 09:13:46 INFO Utils: Successfully started service 'sparkDriver' on port 46275.
24/02/05 09:13:46 INFO SparkEnv: Registering MapOutputTracker
24/02/05 09:13:46 INFO SparkEnv: Registering BlockManagerMaster
24/02/05 09:13:46 INFO BlockManagerMasterEndpoint: Using org.apache.spark.storage.DefaultTopologyMapper for getting topology information
24/02/05 09:13:46 INFO BlockManagerMasterEndpoint: BlockManagerMasterEndpoint up
24/02/05 09:13:46 INFO SparkEnv: Registering BlockManagerMasterHeartbeat
24/02/05 09:13:46 INFO DiskBlockManager: Created local directory at /tmp/blockmgr-f8cfb212-f819-42ac-b18f-5a53c4aa29b6
24/02/05 09:13:46 INFO MemoryStore: MemoryStore started with capacity 5.5 GiB
24/02/05 09:13:46 INFO SparkEnv: Registering OutputCommitCoordinator
+24/02/05 09:13:46 INFO Utils: Successfully started service 'SparkUI' on port 4040.
24/02/05 09:13:46 INFO GlutenDriverPlugin: Gluten build info:
==============================================================
Backend: Velox
Backend Branch: HEAD
Backend Revision: 5a29a19ed35946fcaf4cd8c17c94add3077487d7
Backend Revision Time: 2024-02-04 17:14:27 +0800
GCC Version: gcc (Ubuntu 9.4.0-1ubuntu1~20.04.2) 9.4.0
Gluten Branch: GLUTEN#4398
Gluten Build Time: 2024-02-05T09:12:42Z
Gluten Repo URL: ssh://git@g.hz.netease.com:22222/lakehouse/gluten.git
Gluten Revision: 1c5dab0f80c415c10339684c3be9a73e2a2e1c96
Gluten Revision Time: 2024-02-05 17:11:53 +0800
Gluten Version: 1.2.0-SNAPSHOT
Hadoop Version: 2.7.4
Java Version: 1.8.0_392
Scala Version: 2.12.15
Spark Version: 3.3.1
==============================================================
24/02/05 09:13:46 INFO SparkDirectoryUtil: Created local directory at /tmp/gluten-be94239b-10db-46ae-b8b5-30158b9c0832
24/02/05 09:13:46 INFO JniWorkspace: Creating JNI workspace in root directory /tmp/gluten-be94239b-10db-46ae-b8b5-30158b9c0832/jni/669fbdf1-6856-4f0d-b5d0-1667714f40f4
24/02/05 09:13:46 INFO JniWorkspace: JNI workspace /tmp/gluten-be94239b-10db-46ae-b8b5-30158b9c0832/jni/669fbdf1-6856-4f0d-b5d0-1667714f40f4/gluten-7564488696067479598 created in root directory /tmp/gluten-be94239b-10db-46ae-b8b5-30158b9c0832/jni/669fbdf1-6856-4f0d-b5d0-1667714f40f4
24/02/05 09:13:46 INFO JniLibLoader: Trying to load library libarrow.so.1500.0.0
24/02/05 09:13:46 INFO JniLibLoader: Library /tmp/gluten-be94239b-10db-46ae-b8b5-30158b9c0832/jni/669fbdf1-6856-4f0d-b5d0-1667714f40f4/gluten-7564488696067479598/libarrow.so.1500.0.0 has been loaded using path-loading method
24/02/05 09:13:46 INFO JniLibLoader: Library /tmp/gluten-be94239b-10db-46ae-b8b5-30158b9c0832/jni/669fbdf1-6856-4f0d-b5d0-1667714f40f4/gluten-7564488696067479598/libarrow.so.1500.0.0 has been loaded
24/02/05 09:13:46 INFO JniLibLoader: Symbolic link /tmp/gluten-be94239b-10db-46ae-b8b5-30158b9c0832/jni/669fbdf1-6856-4f0d-b5d0-1667714f40f4/gluten-7564488696067479598/libarrow.so.1500 created for library /tmp/gluten-be94239b-10db-46ae-b8b5-30158b9c0832/jni/669fbdf1-6856-4f0d-b5d0-1667714f40f4/gluten-7564488696067479598/libarrow.so.1500.0.0
24/02/05 09:13:46 INFO JniLibLoader: Successfully loaded library libarrow.so.1500.0.0
24/02/05 09:13:46 INFO JniLibLoader: Trying to load library libparquet.so.1500.0.0
24/02/05 09:13:46 INFO JniLibLoader: Library /tmp/gluten-be94239b-10db-46ae-b8b5-30158b9c0832/jni/669fbdf1-6856-4f0d-b5d0-1667714f40f4/gluten-7564488696067479598/libparquet.so.1500.0.0 has been loaded using path-loading method
24/02/05 09:13:46 INFO JniLibLoader: Library /tmp/gluten-be94239b-10db-46ae-b8b5-30158b9c0832/jni/669fbdf1-6856-4f0d-b5d0-1667714f40f4/gluten-7564488696067479598/libparquet.so.1500.0.0 has been loaded
24/02/05 09:13:46 INFO JniLibLoader: Symbolic link /tmp/gluten-be94239b-10db-46ae-b8b5-30158b9c0832/jni/669fbdf1-6856-4f0d-b5d0-1667714f40f4/gluten-7564488696067479598/libparquet.so.1500 created for library /tmp/gluten-be94239b-10db-46ae-b8b5-30158b9c0832/jni/669fbdf1-6856-4f0d-b5d0-1667714f40f4/gluten-7564488696067479598/libparquet.so.1500.0.0
24/02/05 09:13:46 INFO JniLibLoader: Successfully loaded library libparquet.so.1500.0.0
24/02/05 09:13:46 INFO JniLibLoader: Trying to load library libgluten.so
24/02/05 09:13:46 INFO JniLibLoader: Library /tmp/gluten-be94239b-10db-46ae-b8b5-30158b9c0832/jni/669fbdf1-6856-4f0d-b5d0-1667714f40f4/gluten-7564488696067479598/libgluten.so has been loaded using path-loading method
24/02/05 09:13:46 INFO JniLibLoader: Library /tmp/gluten-be94239b-10db-46ae-b8b5-30158b9c0832/jni/669fbdf1-6856-4f0d-b5d0-1667714f40f4/gluten-7564488696067479598/libgluten.so has been loaded
24/02/05 09:13:46 INFO JniLibLoader: Successfully loaded library libgluten.so
24/02/05 09:13:46 INFO JniLibLoader: Trying to load library libvelox.so
24/02/05 09:13:47 INFO JniLibLoader: Library /tmp/gluten-be94239b-10db-46ae-b8b5-30158b9c0832/jni/669fbdf1-6856-4f0d-b5d0-1667714f40f4/gluten-7564488696067479598/libvelox.so has been loaded using path-loading method
24/02/05 09:13:47 INFO JniLibLoader: Library /tmp/gluten-be94239b-10db-46ae-b8b5-30158b9c0832/jni/669fbdf1-6856-4f0d-b5d0-1667714f40f4/gluten-7564488696067479598/libvelox.so has been loaded
24/02/05 09:13:47 INFO JniLibLoader: Successfully loaded library libvelox.so
24/02/05 09:13:47 INFO GlutenDriverEndpoint: Initialized GlutenDriverEndpoint, address: 6de11c2d27b7:46275.
24/02/05 09:13:47 INFO DriverPluginContainer: Initialized driver component for plugin io.glutenproject.GlutenPlugin.
24/02/05 09:13:47 INFO Executor: Starting executor ID driver on host 6de11c2d27b7
24/02/05 09:13:47 INFO Executor: Starting executor with user classpath (userClassPathFirst = false): ''
24/02/05 09:13:47 INFO ExecutorPluginContainer: Initialized executor component for plugin io.glutenproject.GlutenPlugin.
24/02/05 09:13:47 INFO GlutenExecutorEndpoint: Initialized GlutenExecutorEndpoint.
24/02/05 09:13:47 INFO GlutenDriverEndpoint: Registered executor NettyRpcEndpointRef(spark://GlutenExecutorEndpoint@6de11c2d27b7:46275) (6de11c2d27b7:46275) with ID driver
24/02/05 09:13:47 INFO Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 45203.
24/02/05 09:13:47 INFO NettyBlockTransferService: Server created on 6de11c2d27b7:45203
24/02/05 09:13:47 INFO BlockManager: Using org.apache.spark.storage.RandomBlockReplicationPolicy for block replication policy
24/02/05 09:13:47 INFO BlockManagerMaster: Registering BlockManager BlockManagerId(driver, 6de11c2d27b7, 45203, None)
24/02/05 09:13:47 INFO BlockManagerMasterEndpoint: Registering block manager 6de11c2d27b7:45203 with 5.5 GiB RAM, BlockManagerId(driver, 6de11c2d27b7, 45203, None)
24/02/05 09:13:47 INFO BlockManagerMaster: Registered BlockManager BlockManagerId(driver, 6de11c2d27b7, 45203, None)
24/02/05 09:13:47 INFO BlockManager: Initialized BlockManager: BlockManagerId(driver, 6de11c2d27b7, 45203, None)
+24/02/05 09:13:47 INFO GlutenDriverPlugin: Gluten SQL Tab has attached.

After:
VeloxTPCHV1Suite:
24/02/05 09:19:07 INFO SparkContext: Running Spark version 3.3.1
24/02/05 09:19:08 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
24/02/05 09:19:08 INFO ResourceUtils: ==============================================================
24/02/05 09:19:08 INFO ResourceUtils: No custom resources configured for spark.driver.
24/02/05 09:19:08 INFO ResourceUtils: ==============================================================
24/02/05 09:19:08 INFO SparkContext: Submitted application: test-sql-context
24/02/05 09:19:08 INFO ResourceProfile: Default ResourceProfile created, executor resources: Map(cores -> name: cores, amount: 1, script: , vendor: , memory -> name: memory, amount: 1024, script: , vendor: , offHeap -> name: offHeap, amount: 2048, script: , vendor: ), task resources: Map(cpus -> name: cpus, amount: 1.0)
24/02/05 09:19:08 INFO ResourceProfile: Limiting resource is cpu
24/02/05 09:19:08 INFO ResourceProfileManager: Added ResourceProfile id: 0
24/02/05 09:19:08 INFO SecurityManager: Changing view acls to: root
24/02/05 09:19:08 INFO SecurityManager: Changing modify acls to: root
24/02/05 09:19:08 INFO SecurityManager: Changing view acls groups to:
24/02/05 09:19:08 INFO SecurityManager: Changing modify acls groups to:
24/02/05 09:19:08 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users  with view permissions: Set(root); groups with view permissions: Set(); users  with modify permissions: Set(root); groups with modify permissions: Set()
24/02/05 09:19:08 INFO Utils: Successfully started service 'sparkDriver' on port 43795.
24/02/05 09:19:08 INFO SparkEnv: Registering MapOutputTracker
24/02/05 09:19:08 INFO SparkEnv: Registering BlockManagerMaster
24/02/05 09:19:08 INFO BlockManagerMasterEndpoint: Using org.apache.spark.storage.DefaultTopologyMapper for getting topology information
24/02/05 09:19:08 INFO BlockManagerMasterEndpoint: BlockManagerMasterEndpoint up
24/02/05 09:19:08 INFO SparkEnv: Registering BlockManagerMasterHeartbeat
24/02/05 09:19:08 INFO DiskBlockManager: Created local directory at /tmp/blockmgr-7a67e853-0ca2-4a02-800d-7ac7cb00b51d
24/02/05 09:19:08 INFO MemoryStore: MemoryStore started with capacity 5.5 GiB
24/02/05 09:19:08 INFO SparkEnv: Registering OutputCommitCoordinator
-
24/02/05 09:19:08 INFO GlutenDriverPlugin: Gluten build info:
==============================================================
Backend: Velox
Backend Branch: HEAD
Backend Revision: 5a29a19ed35946fcaf4cd8c17c94add3077487d7
Backend Revision Time: 2024-02-04 17:14:27 +0800
GCC Version: gcc (Ubuntu 9.4.0-1ubuntu1~20.04.2) 9.4.0
Gluten Branch: GLUTEN#4398
Gluten Build Time: 2024-02-05T09:18:05Z
Gluten Repo URL: ssh://git@g.hz.netease.com:22222/lakehouse/gluten.git
Gluten Revision: 331eb55a65628d0801024d539cef83223bba53ac
Gluten Revision Time: 2024-02-05 17:17:19 +0800
Gluten Version: 1.2.0-SNAPSHOT
Hadoop Version: 2.7.4
Java Version: 1.8.0_392
Scala Version: 2.12.15
Spark Version: 3.3.1
==============================================================
24/02/05 09:19:08 INFO SparkDirectoryUtil: Created local directory at /tmp/gluten-8f89869b-2202-4c1f-a60e-28f6f0225902
24/02/05 09:19:08 INFO JniWorkspace: Creating JNI workspace in root directory /tmp/gluten-8f89869b-2202-4c1f-a60e-28f6f0225902/jni/d1c0fa3d-d6b3-47d4-958a-a4e2d9d2dbd8
24/02/05 09:19:08 INFO JniWorkspace: JNI workspace /tmp/gluten-8f89869b-2202-4c1f-a60e-28f6f0225902/jni/d1c0fa3d-d6b3-47d4-958a-a4e2d9d2dbd8/gluten-7322974607901209518 created in root directory /tmp/gluten-8f89869b-2202-4c1f-a60e-28f6f0225902/jni/d1c0fa3d-d6b3-47d4-958a-a4e2d9d2dbd8
24/02/05 09:19:08 INFO JniLibLoader: Trying to load library libarrow.so.1500.0.0
24/02/05 09:19:08 INFO JniLibLoader: Library /tmp/gluten-8f89869b-2202-4c1f-a60e-28f6f0225902/jni/d1c0fa3d-d6b3-47d4-958a-a4e2d9d2dbd8/gluten-7322974607901209518/libarrow.so.1500.0.0 has been loaded using path-loading method
24/02/05 09:19:08 INFO JniLibLoader: Library /tmp/gluten-8f89869b-2202-4c1f-a60e-28f6f0225902/jni/d1c0fa3d-d6b3-47d4-958a-a4e2d9d2dbd8/gluten-7322974607901209518/libarrow.so.1500.0.0 has been loaded
24/02/05 09:19:08 INFO JniLibLoader: Symbolic link /tmp/gluten-8f89869b-2202-4c1f-a60e-28f6f0225902/jni/d1c0fa3d-d6b3-47d4-958a-a4e2d9d2dbd8/gluten-7322974607901209518/libarrow.so.1500 created for library /tmp/gluten-8f89869b-2202-4c1f-a60e-28f6f0225902/jni/d1c0fa3d-d6b3-47d4-958a-a4e2d9d2dbd8/gluten-7322974607901209518/libarrow.so.1500.0.0
24/02/05 09:19:08 INFO JniLibLoader: Successfully loaded library libarrow.so.1500.0.0
24/02/05 09:19:08 INFO JniLibLoader: Trying to load library libparquet.so.1500.0.0
24/02/05 09:19:08 INFO JniLibLoader: Library /tmp/gluten-8f89869b-2202-4c1f-a60e-28f6f0225902/jni/d1c0fa3d-d6b3-47d4-958a-a4e2d9d2dbd8/gluten-7322974607901209518/libparquet.so.1500.0.0 has been loaded using path-loading method
24/02/05 09:19:08 INFO JniLibLoader: Library /tmp/gluten-8f89869b-2202-4c1f-a60e-28f6f0225902/jni/d1c0fa3d-d6b3-47d4-958a-a4e2d9d2dbd8/gluten-7322974607901209518/libparquet.so.1500.0.0 has been loaded
24/02/05 09:19:08 INFO JniLibLoader: Symbolic link /tmp/gluten-8f89869b-2202-4c1f-a60e-28f6f0225902/jni/d1c0fa3d-d6b3-47d4-958a-a4e2d9d2dbd8/gluten-7322974607901209518/libparquet.so.1500 created for library /tmp/gluten-8f89869b-2202-4c1f-a60e-28f6f0225902/jni/d1c0fa3d-d6b3-47d4-958a-a4e2d9d2dbd8/gluten-7322974607901209518/libparquet.so.1500.0.0
24/02/05 09:19:08 INFO JniLibLoader: Successfully loaded library libparquet.so.1500.0.0
24/02/05 09:19:08 INFO JniLibLoader: Trying to load library libgluten.so
24/02/05 09:19:08 INFO JniLibLoader: Library /tmp/gluten-8f89869b-2202-4c1f-a60e-28f6f0225902/jni/d1c0fa3d-d6b3-47d4-958a-a4e2d9d2dbd8/gluten-7322974607901209518/libgluten.so has been loaded using path-loading method
24/02/05 09:19:08 INFO JniLibLoader: Library /tmp/gluten-8f89869b-2202-4c1f-a60e-28f6f0225902/jni/d1c0fa3d-d6b3-47d4-958a-a4e2d9d2dbd8/gluten-7322974607901209518/libgluten.so has been loaded
24/02/05 09:19:08 INFO JniLibLoader: Successfully loaded library libgluten.so
24/02/05 09:19:08 INFO JniLibLoader: Trying to load library libvelox.so
24/02/05 09:19:08 INFO JniLibLoader: Library /tmp/gluten-8f89869b-2202-4c1f-a60e-28f6f0225902/jni/d1c0fa3d-d6b3-47d4-958a-a4e2d9d2dbd8/gluten-7322974607901209518/libvelox.so has been loaded using path-loading method
24/02/05 09:19:08 INFO JniLibLoader: Library /tmp/gluten-8f89869b-2202-4c1f-a60e-28f6f0225902/jni/d1c0fa3d-d6b3-47d4-958a-a4e2d9d2dbd8/gluten-7322974607901209518/libvelox.so has been loaded
24/02/05 09:19:08 INFO JniLibLoader: Successfully loaded library libvelox.so
24/02/05 09:19:09 INFO GlutenDriverEndpoint: Initialized GlutenDriverEndpoint, address: 6de11c2d27b7:43795.
24/02/05 09:19:09 INFO DriverPluginContainer: Initialized driver component for plugin io.glutenproject.GlutenPlugin.
24/02/05 09:19:09 INFO Executor: Starting executor ID driver on host 6de11c2d27b7
24/02/05 09:19:09 INFO Executor: Starting executor with user classpath (userClassPathFirst = false): ''
24/02/05 09:19:09 INFO ExecutorPluginContainer: Initialized executor component for plugin io.glutenproject.GlutenPlugin.
24/02/05 09:19:09 INFO GlutenExecutorEndpoint: Initialized GlutenExecutorEndpoint.
24/02/05 09:19:09 INFO GlutenDriverEndpoint: Registered executor NettyRpcEndpointRef(spark://GlutenExecutorEndpoint@6de11c2d27b7:43795) (6de11c2d27b7:43795) with ID driver
24/02/05 09:19:09 INFO Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 44325.
24/02/05 09:19:09 INFO NettyBlockTransferService: Server created on 6de11c2d27b7:44325
24/02/05 09:19:09 INFO BlockManager: Using org.apache.spark.storage.RandomBlockReplicationPolicy for block replication policy
24/02/05 09:19:09 INFO BlockManagerMaster: Registering BlockManager BlockManagerId(driver, 6de11c2d27b7, 44325, None)
24/02/05 09:19:09 INFO BlockManagerMasterEndpoint: Registering block manager 6de11c2d27b7:44325 with 5.5 GiB RAM, BlockManagerId(driver, 6de11c2d27b7, 44325, None)
24/02/05 09:19:09 INFO BlockManagerMaster: Registered BlockManager BlockManagerId(driver, 6de11c2d27b7, 44325, None)
24/02/05 09:19:09 INFO BlockManager: Initialized BlockManager: BlockManagerId(driver, 6de11c2d27b7, 44325, None)
-

===== Performance report for TPCH SF2000 with Velox backend, for reference only ====

query
log/native_4654_time.csv
log/native_master_02_04_2024_d1b29e1bc_time.csv
difference
percentage

q1
32.43
33.68
1.253
103.86%

q2
22.66
24.23
1.570
106.93%

q3
36.69
37.37
0.682
101.86%

q4
37.74
35.96
-1.779
95.29%

q5
68.31
70.39
2.084
103.05%

q6
7.10
6.99
-0.103
98.55%

q7
84.64
84.51
-0.127
99.85%

q8
86.30
84.14
-2.167
97.49%

q9
124.50
121.28
-3.217
97.42%

q10
44.69
43.47
-1.215
97.28%

q11
20.51
20.46
-0.044
99.79%

q12
30.69
26.23
-4.460
85.47%

q13
45.62
45.25
-0.377
99.17%

q14
17.44
15.93
-1.519
91.29%

q15
27.75
26.74
-1.008
96.37%

q16
15.68
14.11
-1.566
90.01%

q17
101.75
102.75
1.000
100.98%

q18
150.00
148.66
-1.345
99.10%

q19
12.44
13.50
1.057
108.50%

q20
26.74
26.71
-0.035
99.87%

q21
226.11
221.36
-4.748
97.90%

q22
13.75
13.64
-0.110
99.20%

total
1233.55
1217.37
-16.175
98.69%


[1.12.2] LootTables for Creepers Accessible by LootTweaker

Expected Behavior
Using /ct loottables all would include the loot tables of each creeper (if they vary from the vanilla creeper) in the dumps folder. Would it be possible to have the loottables registered to be readable by LootTweaker? Leviathan details the process here: https://github.com/PrinceOfAmber/ERZ/issues/13
Actual Behavior
LootTweaker can't detect the tables of the creepers.
Screenshot on This Problem (if possible)

Your Environment

Minecraft/Magistics/Forge version: MC 1.12.2  and Forge 2623

If you check the resources folder, I have no custom loot tables created for any of the creepers. Their drop stats are all the same as a vanilla creeper. I do intend to change this for a few of the creepers in the future, but for right now none of them are customized.


plugins --all example should use cog

The example output for datasette plugins --allon this page has got out of date: https://docs.datasette.io/en/stable/plugins.html

Fixed: https://docs.datasette.io/en/latest/plugins.html#seeing-what-plugins-are-installed


Fixes RNDFPBannerView to allow tap on a DFP Banner

Fixes RNDFPBannerView frame to allow the user to tap on a DFP Banner.
This is related to #70 and #88
Credits to @ndbroadbent

@aparedes works, thanks!

The banners have been totally refactored in v2 of the library, where tapping on the banners is no problem. You can track its development here: https://github.com/sbugert/react-native-admob/pull/165


Command "Open New External Terminal" do not work

Issue Type: Bug
To reproduce the error just run "Open New External Terminal" from the command palette.
I tried to trace the error and it seems to be here: src/vs/platform/externalTerminal/node/externalTerminalService.ts:318 (v1.57.0)
This is the Output from Log (Window):
[2021-06-11 00:13:12.312] [renderer1] [error] Cannot read property 'external' of undefined: TypeError: Cannot read property 'external' of undefined
    at Ze.spawnTerminal (/usr/share/code/resources/app/out/vs/code/electron-main/main.js:32:630)
    at Ze.openTerminal (/usr/share/code/resources/app/out/vs/code/electron-main/main.js:31:613)
    at Object.call (/usr/share/code/resources/app/out/vs/code/electron-main/main.js:21:8293)
    at h.onPromise (/usr/share/code/resources/app/out/vs/code/electron-main/main.js:20:7775)
    at h.onRawMessage (/usr/share/code/resources/app/out/vs/code/electron-main/main.js:20:7134)
    at /usr/share/code/resources/app/out/vs/code/electron-main/main.js:20:6387
    at k.fire (/usr/share/code/resources/app/out/vs/code/electron-main/main.js:16:1835)
    at /usr/share/code/resources/app/out/vs/code/electron-main/main.js:14:46850
    at k.fire (/usr/share/code/resources/app/out/vs/code/electron-main/main.js:16:1835)
    at /usr/share/code/resources/app/out/vs/code/electron-main/main.js:14:47016
    at k.fire (/usr/share/code/resources/app/out/vs/code/electron-main/main.js:16:1835)
    at IpcMainImpl.z (/usr/share/code/resources/app/out/vs/code/electron-main/main.js:14:48719)
    at IpcMainImpl.emit (events.js:327:22)
    at Object.<anonymous> (electron/js2c/browser_init.js:165:9692)
    at Object.emit (events.js:315:20)

VS Code version: Code 1.57.0 (b4c1bd0a9b03c749ea011b06c6d2676c8091a70c, 2021-06-09T17:18:42.895Z)
OS version: Linux x64 5.8.0-55-generic (Ubuntu 20.04.2 LTS)
Restricted Mode: No

System Info

Item
Value

CPUs
Intel(R) Core(TM) i7-4790 CPU @ 3.60GHz (8 x 3800)

GPU Status
2d_canvas: enabledgpu_compositing: enabledmultiple_raster_threads: enabled_onoop_rasterization: disabled_offopengl: enabled_onrasterization: disabled_softwareskia_renderer: enabled_onvideo_decode: disabled_softwarevulkan: disabled_offwebgl: enabledwebgl2: enabled

Load (avg)
1, 1, 1

Memory (System)
15.59GB (5.78GB free)

Process Argv
--unity-launch --crash-reporter-id bd0b1a29-4ec2-492b-aa2e-e79c19fc6675

Screen Reader
no

VM
0%

DESKTOP_SESSION
ubuntu

XDG_CURRENT_DESKTOP
Unity

XDG_SESSION_DESKTOP
ubuntu

XDG_SESSION_TYPE
x11

Confirmed this same behavior testing in vscode-insiders:
Output from Log (Window):
[2021-06-11 00:27:52.922] [renderer4] [error] Cannot read property 'external' of undefined: TypeError: Cannot read property 'external' of undefined
    at Ze.spawnTerminal (/usr/share/code-insiders/resources/app/out/vs/code/electron-main/main.js:32:630)
    at Ze.openTerminal (/usr/share/code-insiders/resources/app/out/vs/code/electron-main/main.js:31:613)
    at Object.call (/usr/share/code-insiders/resources/app/out/vs/code/electron-main/main.js:21:8293)
    at h.onPromise (/usr/share/code-insiders/resources/app/out/vs/code/electron-main/main.js:20:7775)
    at h.onRawMessage (/usr/share/code-insiders/resources/app/out/vs/code/electron-main/main.js:20:7134)
    at /usr/share/code-insiders/resources/app/out/vs/code/electron-main/main.js:20:6387
    at k.fire (/usr/share/code-insiders/resources/app/out/vs/code/electron-main/main.js:16:1835)
    at /usr/share/code-insiders/resources/app/out/vs/code/electron-main/main.js:14:46850
    at k.fire (/usr/share/code-insiders/resources/app/out/vs/code/electron-main/main.js:16:1835)
    at /usr/share/code-insiders/resources/app/out/vs/code/electron-main/main.js:14:47016
    at k.fire (/usr/share/code-insiders/resources/app/out/vs/code/electron-main/main.js:16:1835)
    at IpcMainImpl.z (/usr/share/code-insiders/resources/app/out/vs/code/electron-main/main.js:14:48719)
    at IpcMainImpl.emit (events.js:327:22)
    at Object.<anonymous> (electron/js2c/browser_init.js:165:9692)
    at Object.emit (events.js:315:20)

Version: 1.57.0-insider
Commit: b4c1bd0a9b03c749ea011b06c6d2676c8091a70c
Date: 2021-06-09T10:36:57.548Z
Electron: 12.0.9
Chrome: 89.0.4389.128
Node.js: 14.16.0
V8: <IP_ADDRESS>-electron.0
OS: Linux x64 5.8.0-55-generic

Same in windows
[2021-06-11 08:16:04.900] [renderer1] [error] Cannot read property 'external' of undefined: TypeError: Cannot read property 'external' of undefined
at Je.spawnTerminal (C:\Users\Franco\AppData\Local\Programs\Microsoft VS Code\resources\app\out\vs\code\electron-main\main.js:30:77670)
at Je.openTerminal (C:\Users\Franco\AppData\Local\Programs\Microsoft VS Code\resources\app\out\vs\code\electron-main\main.js:30:77587)
at Object.call (C:\Users\Franco\AppData\Local\Programs\Microsoft VS Code\resources\app\out\vs\code\electron-main\main.js:21:8293)
at h.onPromise (C:\Users\Franco\AppData\Local\Programs\Microsoft VS Code\resources\app\out\vs\code\electron-main\main.js:20:7775)
at h.onRawMessage (C:\Users\Franco\AppData\Local\Programs\Microsoft VS Code\resources\app\out\vs\code\electron-main\main.js:20:7134)
at C:\Users\Franco\AppData\Local\Programs\Microsoft VS Code\resources\app\out\vs\code\electron-main\main.js:20:6387
at k.fire (C:\Users\Franco\AppData\Local\Programs\Microsoft VS Code\resources\app\out\vs\code\electron-main\main.js:16:1835)
at C:\Users\Franco\AppData\Local\Programs\Microsoft VS Code\resources\app\out\vs\code\electron-main\main.js:14:46850
at k.fire (C:\Users\Franco\AppData\Local\Programs\Microsoft VS Code\resources\app\out\vs\code\electron-main\main.js:16:1835)
at C:\Users\Franco\AppData\Local\Programs\Microsoft VS Code\resources\app\out\vs\code\electron-main\main.js:14:47016
at k.fire (C:\Users\Franco\AppData\Local\Programs\Microsoft VS Code\resources\app\out\vs\code\electron-main\main.js:16:1835)
at IpcMainImpl.z (C:\Users\Franco\AppData\Local\Programs\Microsoft VS Code\resources\app\out\vs\code\electron-main\main.js:14:48719)
at IpcMainImpl.emit (events.js:315:20)
at Object. (electron/js2c/browser_init.js:165:9692)
at Object.emit (events.js:315:20)

/duplicate #126043

Same here
Version: 1.57.0
Commit: b4c1bd0a9b03c749ea011b06c6d2676c8091a70c
Date: 2021-06-09T17:22:31.215Z
Electron: 12.0.9
Chrome: 89.0.4389.128
Node.js: 14.16.0
V8: <IP_ADDRESS>-electron.0
OS: Darwin x64 20.3.0

Is this happening every time you run that command?

Confirming the same behavior.
ERR Cannot read property 'external' of undefined: TypeError: Cannot read property 'external' of undefined
at Je.spawnTerminal (C:\Users\PRANAV\AppData\Local\Programs\Microsoft VS Code\resources\app\out\vs\code\electron-main\main.js:30:77670)
at Je.openTerminal (C:\Users\PRANAV\AppData\Local\Programs\Microsoft VS Code\resources\app\out\vs\code\electron-main\main.js:30:77587)
at Object.call (C:\Users\PRANAV\AppData\Local\Programs\Microsoft VS Code\resources\app\out\vs\code\electron-main\main.js:21:8293)
at h.onPromise (C:\Users\PRANAV\AppData\Local\Programs\Microsoft VS Code\resources\app\out\vs\code\electron-main\main.js:20:7775)
at h.onRawMessage (C:\Users\PRANAV\AppData\Local\Programs\Microsoft VS Code\resources\app\out\vs\code\electron-main\main.js:20:7134)
at C:\Users\PRANAV\AppData\Local\Programs\Microsoft VS Code\resources\app\out\vs\code\electron-main\main.js:20:6387
at k.fire (C:\Users\PRANAV\AppData\Local\Programs\Microsoft VS Code\resources\app\out\vs\code\electron-main\main.js:16:1835)
at C:\Users\PRANAV\AppData\Local\Programs\Microsoft VS Code\resources\app\out\vs\code\electron-main\main.js:14:46850
at k.fire (C:\Users\PRANAV\AppData\Local\Programs\Microsoft VS Code\resources\app\out\vs\code\electron-main\main.js:16:1835)
at C:\Users\PRANAV\AppData\Local\Programs\Microsoft VS Code\resources\app\out\vs\code\electron-main\main.js:14:47016
at k.fire (C:\Users\PRANAV\AppData\Local\Programs\Microsoft VS Code\resources\app\out\vs\code\electron-main\main.js:16:1835)
at IpcMainImpl.z (C:\Users\PRANAV\AppData\Local\Programs\Microsoft VS Code\resources\app\out\vs\code\electron-main\main.js:14:48719)
at IpcMainImpl.emit (events.js:327:22)
at Object. (electron/js2c/browser_init.js:165:9692)
at Object.emit (events.js:315:20)

Is this happening every time you run that command?

Yes , This happens every time I try to open the external terminal from vscode.

And no external terminal is opened, correct?

And no external terminal is opened, correct?

Yes. The same error is printed every time I run it.

Can you share your settings.json file?

Can you share your settings.json file?

Sure.
settings.json
{
    "atomKeymap.promptV3Features": true,
    "editor.rulers": [100],
    "editor.multiCursorModifier": "ctrlCmd",
    "editor.formatOnPaste": true,
    "workbench.iconTheme": "material-icon-theme",
    "trailing-spaces.trimOnSave": true,
    "git.enableSmartCommit": true,
    "git.autofetch": true,
    "workbench.colorCustomizations": {
        "editorError.foreground": "#ff0000"
    },
    "git.confirmSync": false,
    "editor.tabSize": 2,
    "explorer.confirmDelete": false,
    "workbench.startupEditor": "newUntitledFile",
    "explorer.confirmDragAndDrop": false,
    "javascript.updateImportsOnFileMove.enabled": "never",
    "cSpell.language": "en, pt-BR",
    "cSpell.userWords": [],
    "window.zoomLevel": 0,
    "breadcrumbs.enabled": true,
    "editor.renderControlCharacters": false,
    "editor.renderWhitespace": "none",
    "explorer.compactFolders": false,
    "editor.codeActionsOnSave": {
        "source.fixAll.eslint": true
    },
    "diffEditor.renderSideBySide": true,
    "splitHTMLAttributes.closingBracketOnNewLine": true,
    "editor.semanticHighlighting.enabled": false,
    "files.associations": {
        "*.svg": "html"
    },
    "extensions.ignoreRecommendations": false,
    "typescript.tsdk": ""
}

@Tyriar I updated to the v1.57.1 and the fix worked, thank you!

Good to hear!


[Build] ARM64 setup

In makedefs/MakeInc.def, change these:
ifneq ($(filter ARM ARM64,$(CURRENT_ARCH_CONFIG)),)

ifneq ($(findstring _Sim,$(RC_ProjectName)),)
ARCH_FLAGS_ARM64          = -arch arm64
else ifneq ($(findstring _host,$(RC_ProjectName)),)
ARCH_FLAGS_ARM64          = -arch arm64
else

ifndef ARCH_STRING_FOR_CURRENT_MACHINE_CONFIG

ifneq ($(EMBEDDED_DEVICE_MAP),)
export ARCH_STRING_FOR_CURRENT_MACHINE_CONFIG := $(shell $(EMBEDDED_DEVICE_MAP) -db $(EDM_DBPATH) -query SELECT DISTINCT KernelMachOArchitecture FROM Targets WHERE KernelPlatform IS \"$(CURRENT_MACHINE_CONFIG_LC)\" LIMIT 1 || echo UNKNOWN )
else
# Without embdedded device map, use a default arch string
export ARCH_STRING_FOR_CURRENT_MACHINE_CONFIG := $(shell echo $(CURRENT_ARCH_CONFIG) | tr A-Z a-z)
ifneq ($(filter ARM64,$(CURRENT_ARCH_CONFIG)),)
export ARCH_STRING_FOR_CURRENT_MACHINE_CONFIG := arm64
endif
endif
endif

Link error:
Undefined symbols for architecture arm64:
  "___firehose_buffer_tracepoint_flush", referenced from:
      __firehose_trace in justlto.o
  "___firehose_kernel_configuration_valid", referenced from:
      _oslog_init in justlto.o
  "___firehose_buffer_create", referenced from:
      _oslog_init in justlto.o
  "_ml_enable_monitor", referenced from:
      _arm_vm_init in justlto.o
  "___firehose_buffer_tracepoint_reserve", referenced from:
      __firehose_trace in justlto.o
  "___firehose_merge_updates", referenced from:
      _oslogioctl in justlto.o
  "_pmap_cs_allow_invalid", referenced from:
      _vm_map_cs_wx_enable in justlto.o
ld: symbol(s) not found for architecture arm64

More errors, which means that our libdispatch/sth else is ARM64

Need to re-build libdisptach, etc for ARM64, not ARM64e

Need to re-build libdisptach, etc for ARM64, not ARM64e
ld: warning: ignoring file /Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/local/lib/kernel/libfirehose_kernel.a, building for macOS-arm64 but attempting to link with file built for macOS-arm64e
Undefined symbols for architecture arm64:
  "___firehose_buffer_tracepoint_flush", referenced from:
      __firehose_trace in justlto.o
  "___firehose_buffer_tracepoint_reserve", referenced from:
      __firehose_trace in justlto.o
  "___firehose_merge_updates", referenced from:
      _oslogioctl in justlto.o
  "___firehose_kernel_configuration_valid", referenced from:
      _oslog_init in justlto.o
  "___firehose_buffer_create", referenced from:
      _oslog_init in justlto.o
ld: symbol(s) not found for architecture arm64

Done by:
xcodebuild install -sdk macosx ARCHS=arm64 VALID_ARCHS=arm64 -target libfirehose_kernel PRODUCT_NAME=firehose_kern DSTROOT=$PWD/dst


Check out how tests work in notebook cells

@rebornix: I'm wondering if I can have a few cells purely for test and rerun them automatically when the algo cell is updated or maybe have the tests show up in test explorer
@connor4312: Hm, yes. I actually haven't really looked at the notebook/cell apis in the ext host very much... currently there's only a provide*TestHierarchy for the documents and workspace folders, so we have no way to ask for tests in a notebook cell. If we add that though I think everything could 'just work' assuming cells are addressable by uris in Locations

One thing that's interesting is that my "test" could just be a notebook cell with a bunch of assert statements. That would not be reasonably detectable by an extension automatically, should there be a way for the user to manually make a cell as a test? Or, going further, are all cells tests by default? Would give automatic access to things like "re run failed tests (cells)"


Integrate a function with pandas and scipy.integrate.quad

I'm trying to integrate a function with pandas and scipy in the most elegant way possible, but I'm getting the following error when executing:
TypeError: 'float' object is not subscriptable
This is a preview of the data set:
           0       1    Live  time:  11646
0        1.0     2.0     0.0    0.0    0.0
1        2.0     3.0     0.0    0.0    0.0
2        3.0     4.0     0.0    0.0    0.0
3        4.0     5.0     1.0    0.0    0.0
4        5.0     6.0     2.0    0.0    0.0
...      ...     ...     ...    ...    ...
4094  4095.0  4096.0  4092.0    1.0    0.0
4095  4096.0  4097.0  4093.0    0.0    0.0
4096  4097.0  4098.0  4094.0    1.0    0.0
4097  4098.0  4099.0  4095.0    2.0    0.0
4098  4099.0  4100.0  4096.0    0.0    0.0

I know there are other ways to solve the problem, but I would like to keep the lambda function, because it makes things simpler.
Code:
import pandas as pd
import pylab as plt
import numpy as np
from scipy.integrate import quad

dados = pd.read_csv('data.csv', sep=',| |\t|\s+', engine='python')
dados = dados.apply(pd.to_numeric,errors='coerce').fillna(0).astype('float')

def func(x):
    return x[3]/x[3].max()

dados['I'] = dados.apply(lambda x: quad(func, 140.0, 4000.0), axis=1)

CSV file:
data.txt

Not sure what you are trying to do, but note that in
def func(x):
    return x[3]/x[3].max()

x is a local variable unrelated to the lambda function. I don't see something that is a scipy issue here, so further discussion probably should go to e.g. stackoverflow.


Use rsync for vagrant-libvirt sync_folder:

Description
The NFS type for synced_folder requires nfsd to be installed and running on a machine for vagrant up to be successful.
nfs was used so that folders were r/w bidirectionally.
I don't really think there is a need for this bidirectional functionality.
Moving to rsync should make this work more universally.
Why is this needed
Issue https://github.com/tinkerbell/sandbox/issues/97 reported.
Moving away from nfs for vagrant libvirt synced_folders should work more universally.
Fixes: #97
How Has This Been Tested?

How are existing users impacted? What migration steps/scripts do we need?

Checklist:
I have:

[x] updated the documentation and/or roadmap (if required)
[x] added unit or e2e tests
[x] provided instructions on how to upgrade

Bringing this over here since I closed the issue

Hey @MikePadge, sorry I'm not following. The PR #98 breaks the docker-compose? That PR doesn't use NFS anymore.

I thought the docker-compose files were expecting the nfs mounts to be available in the vagrant box, but I don't see nfs being used for volumes in these compose files. So I dont' know why they're breaking
Annd that being said, it looks like with nfsd I'm getting the same secondary errors with the containers as rsync. So I'll go ahead and collect that info and open a new issue.


Compose services

Interesting!

I've put the following to /var/lib/rancher/conf/cloud-config.d dir and rebooted:
nginx.yml:
#compose
nginx:
  image: nginx
  links:
  - network
  restart: always
  net: host

Didn't work (nginx container didn't start). Here's what ended up in cloud-config-processed.yml:
#cloud-config
nginx:
  image: nginx
  links:
  - network
  net: host
  restart: always
ssh_authorized_keys: null

I guess nginx key should've been put under services.

@imikushin I'll look into that.  I haven't fully tested all the permutations of configurable.  I'm going to merge this PR even though I know there are some bugs.  This way we can cut a rc3 and do more extensive testing.

@imikushin check out https://github.com/rancherio/os-services.  You can change the URL RancherOS looks at so you can fork that repo and try to add new stuff.  If you do rancherctl service list it should list what is in index.yml
We're working on docs (and a real docs website)

@ibuildthecloud  the rancherctl service list doesn't work in v0.3.0-rc3.
I get this error.
ERRO[0000] Failed to load https://raw.githubusercontent.com/rancherio/os-services/master/index.yml: non-200 http response: 404
disabled ubuntu-console

Logged a bug: https://github.com/rancherio/os/issues/187


Empty dramiel.sqlite file

http://i.imgur.com/eTFoU1F.png
Is the dramiel db supposed to be empty? I've restarted several times. Made sure configs look good. Only thing that seems to be affected is killmails being posted. None are being posted.
 Try chmod'ing and chown'ing the sqlite file to the user the bot runs as.

I reinstalled from scratch. Tried running php Dramiel.php. Supervisorctl does not work without sudo but your instructions say to use sudo. Either way I'm getting an empty sqlite file.
http://i.imgur.com/nyPaGEl.png

Check src/lib/log/libraryError.log. I have a suspicion that you'll end up finding that it claims to not be able to find the driver, which is entirely the case if you have PHP >= 5.4, where PDO/sqlite is no longer enabled by default.

So yea there is no way i'll run php5.4 or lower. Typically I either have 5.6 or 7.0. I've re setup an entire instance and haven't decided whether or not I will install this. Feel free to close the issue. I'll open a new one if the same thing happens on php7.

Perhaps I should have been clearer not enabled by default != non-functional:
   service apache2 restart```
should do the trick if you are running php5.x,

wanted to just add to this:
If you're running php7.0, use sudo apt install php7.0-sqlite3


Styled feedback button

Related Issue
IMPROVE FEEDBACK BUTTON STYLING AND INCREASE MESSAGE AREA
Description
Change CSS properties to style the feedback button
Expanded the message area
Type of PR

[x] Feature enhancement

Screenshots / videos (if applicable)
before :

after:

updated :

Checklist:

[ X ] I have performed a self-review of my code
[ X ] I have read and followed the Contribution Guidelines.
[ X ] I have tested the changes thoroughly before submitting this pull request.
[ X ] I have provided relevant issue numbers, screenshots, and videos after making the changes.
[ X ] I have commented my code, particularly in hard-to-understand areas.

Additional context:
[Include any additional information or context that might be helpful for reviewers.]
Please Consider Merging my pull request @Suchitra-Sahoo
closes #479

Please assign it to me, i will try to improve it
On Fri, 24 May, 2024, 5:04 pm Suchitra Sahoo, @.***>
wrote:

Its not looking suitable. Please work on improving it.
—
Reply to this email directly, view it on GitHub
https://github.com/Suchitra-Sahoo/AgriLearnNetwork/pull/481#issuecomment-2129307650,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/BGKIIZWGFMRGGQD4KN5ALE3ZD4QTTAVCNFSM6AAAAABIHF5JMCVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCMRZGMYDONRVGA
.
You are receiving this because you authored the thread.Message ID:
@.***>

Its not looking suitable. Please work on improving it.

@Suchitra-Sahoo please see the changes i have updated the changes and now it look suitable and more concise
Please Assign it to me
Thank You

Do attach a screenshot

Can you design something like this

Do attach a screenshot

i already attached it , you can see above @Suchitra-Sahoo

Can you design something like this

yes i will try

Do attach a screenshot

I Have also uploaded above in the Screen Shot section
Please have a look
Thank you @Suchitra-Sahoo

Keep the design and shapre of contact us same as it is now. Design the feedbach button in such a way that it matches website design you can keep it same as chatbot colour

Keep the design and shapre of contact us same as it is now. Design the feedbach button in such a way that it matches website design you can keep it same as chatbot colour

Please Check it, I have done it @Suchitra-Sahoo

I think you have made some changes in contact us section as the message area has enlarged and other section has become small. Remove those changes.

Resolve the conflicts too

Ok i will do ASAP
On Wed, 29 May, 2024, 12:26 am Suchitra Sahoo, @.***>
wrote:

Keep the design and shapre of contact us same as it is now. Design the
feedbach button in such a way that it matches website design you can keep
it same as chatbot colour
Please Check it, I have done it @Suchitra-Sahoo
https://github.com/Suchitra-Sahoo
I think you have made some changes in contact us section as the message
area has enlarged and other section has become small. Remove those changes.
—
Reply to this email directly, view it on GitHub
https://github.com/Suchitra-Sahoo/AgriLearnNetwork/pull/481#issuecomment-2135913672,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/BGKIIZVRBVXZDVTBF6S252DZETHOTAVCNFSM6AAAAABIHF5JMCVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCMZVHEYTGNRXGI
.
You are receiving this because you authored the thread.Message ID:
@.***>

I'm closing this PR now once you are done with the changes raise another PR. Do attach a screenshot and mention your issue number.

I'm closing this PR now once you are done with the changes raise another PR. Do attach a screenshot and mention your issue number.

I am done with the changes, please check my new PR #554 @Suchitra-Sahoo


fix: fixed duplicate connection issue and added try catch to understand error

try connect to the hootsuite account twice it will throw an error second time
added try catch for the refresh token issue

Note: Added a delay because it was taking time to run the delete parameter ssm actions hence producing duplicate entries. We may need to move this to a db approach as tech debt to make this efficient.


python3Packages.python-engineio: build on macOS

Motivation for this change
It builds just fine on macOS.
Things done

[ ] Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS linux)
Built on platform(s)

[ ] NixOS
[X] macOS
[ ] other Linux distributions

[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[X] Tested compilation of all pkgs that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review wip"
[ ] Tested execution of all binary files (usually in ./result/bin/)
[ ] Determined the impact on package closure size (by running nix path-info -S before and after)
[ ] Ensured that relevant documentation is up to date
[X] Fits CONTRIBUTING.md.

Also tested building appdaemon on macOS, only one test is failing with OSError: AF_UNIX path too long, but that's because of very long path to tmp directory, for example:
path = '/private/var/folders/y1/9_wlrg890x1g723s7mgn73wr0000gn/T/nix-build-python3.7-aiohttp-3.6.2.drv-0/tmp1a3nap4t/tmp.sock'.

Also tested building appdaemon on macOS, only one test is failing with OSError: AF_UNIX path too long, but that's because of very long path to tmp directory, for example:
path = '/private/var/folders/y1/9_wlrg890x1g723s7mgn73wr0000gn/T/nix-build-python3.7-aiohttp-3.6.2.drv-0/tmp1a3nap4t/tmp.sock'. Not sure why it's using different version of aiohttp.
Building python37Packages.aiohttp with --check is also failing on my machine, so this is probably local issue.

Can you either disable or fix new dependencies that are now failing because of enabling this?

@GrahamcOfBorg build appdaemon

Can you either disable or fix new dependencies that are now failing because of enabling this?

appdaemon is building on multi-user nix.

gdbgui build should be working too.
@GrahamcOfBorg build gdbgui

Is your list complete?
@GrahamcOfBorg build gdbgui appdaemon

Is your list complete?

According to grep - it is :D

@misuzu nix-review is often the better tool to test all rebuilds.


(fix) ensure OmniAuth test mode is disabled …

after any features that enable it

use rails route helpers in request spec
remove redundant before(:each) block from request spec

 Update to be deployed to testing only: Relabel 'Milton Keynes' option with 'Other' on the pre-sign in region selection page.


fix: fixing max-width mediaqueries

Codecov Report

Merging #883 (57f54e2) into master (1877ebc) will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master     #883   +/-   ##
=======================================
  Coverage   56.72%   56.72%
=======================================
  Files          19       19
  Lines         855      855
  Branches      231      231
=======================================
  Hits          485      485
  Misses        358      358
  Partials       12       12

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 1877ebc...57f54e2. Read the comment docs.


Balloon - Step 5

Should change the wording here to specify that they need to click the Fullscreen button to expand the mini game window.

Also in Tutorial 2 - Step 7
Want them to click the button...

We don't want them to click that button.  It gets them out of the flow.  I should have changed the text in all of the steps to just tell them to play it instead of clicking the resize.

And Tutorial 3 - Step 2

And Tutorial 3 - Step 4

Actually, let's do this at the end of tutorials.


Problem with installation from source

Hi,
There is also some problems with installation from source as follows:
1- For message-writer and http-adaptor, we have the following error:
fatal: could not read Username for 'https://github.com': terminal prompts disabled.
I dont know how can I fix this. It should be mentioned that we have not this problem for mqtt-adaptor and everything is fine for this.
2- The go command cannot run with sudo, so we need to use 'chown' command to get the permission of making directories in your 'mainflux-install.sh' file.

siavash@ubuntu:~/Desktop/Mainflux2/mainflux/bin$ ./mainflux-install.sh
./mainflux-install.sh: line 16: Manager: command not found
github.com/mainflux/message-writer (download)
cd .; git clone https://github.com/mainflux/message-writer /home/siavash/Desktop/Mainflux2/mainflux/bin/mainflux/go/src/github.com/mainflux/message-writer
Cloning into '/home/siavash/Desktop/Mainflux2/mainflux/bin/mainflux/go/src/github.com/mainflux/message-writer'...
fatal: could not read Username for 'https://github.com': terminal prompts disabled
package github.com/mainflux/message-writer: exit status 128
github.com/mainflux/http-adapter (download)
cd .; git clone https://github.com/mainflux/http-adapter /home/siavash/Desktop/Mainflux2/mainflux/bin/mainflux/go/src/github.com/mainflux/http-adapter
Cloning into '/home/siavash/Desktop/Mainflux2/mainflux/bin/mainflux/go/src/github.com/mainflux/http-adapter'...
fatal: could not read Username for 'https://github.com': terminal prompts disabled
package github.com/mainflux/http-adapter: exit status 128
fatal: destination path 'mqtt-adapter' already exists and is not an empty directory.
siavash@ubuntu:~/Desktop/Mainflux2/mainflux/bin$

@2014siavash This is similar to https://github.com/mainflux/mainflux/issues/98 as @drasko explained this is caused by transition to monorepo, which is not fully done yet. @drasko Can you please try to fix the script ?

Yep, sure. Working on it now.

Fixed by https://github.com/mainflux/mainflux/commit/f2aa007fabd34363b46ccf83edaebe53c3415cb6


Added to ConvexTests

Thanks for making this cool solver available! I've added it to ConvexTests.jl, which uses test problems from Convex.jl and SumOfSquares.jl in order to test the reliability of Julia-accessible solvers. So these are somewhat weird problems that tend to test edge cases, rather than standard benchmarking problems. I started it when I couldn't find a single solver that could solve all of the problems from Convex.jl's tests (in order to run in CI).
You can see the results for Clarabel here: https://ericphanson.github.io/ConvexTests.jl/dev/Clarabel/
If you would prefer ConvexTests to run the solver with different settings, you can make a PR to adjust them here: https://github.com/ericphanson/ConvexTests.jl/blob/9653106903f05143a0785e5560fd9d5a8f52690d/Clarabel/test.jl#L6-L11
If you are interested, it also possible to run Convex's tests as part of your own test suite to prevent regression on these problems. See e.g. https://jump.dev/Convex.jl/stable/problem_depot/#Problem-Depot.

Thank you for this, it is very helpful.   We will have a look and clean up the edge cases.
It seems that you do not test QP problems directly.   Is that because it is run through Convex.jl, which would reformulate QPs to SOCPs anyway?

It seems that you do not test QP problems directly. Is that because it is run through Convex.jl, which would reformulate QPs to SOCPs anyway?

Yeah, the Convex problems are from here: https://github.com/jump-dev/Convex.jl/tree/master/src/problem_depot/problems. They were taken from Convex.jl's tests, built over a few years (mostly before my time helping maintain Convex). I guess we just never added QP problems, probably for the reason you say.
The SumOfSquares tests are here: https://github.com/jump-dev/SumOfSquares.jl/tree/master/test/Tests

Thanks again.   We have made some stability improvements and added exp and pow cones in v0.3.0.   I have made a PR to ConvexTests.jl with this change.


Jewish Calendar Daylight Savings offset?

Hello,
The Issur Melacha in Effect boolean has been off by an hour ever since daylight savings started. The portion that deals with adding the Jewish calendar is as follows:
sensor:
  - platform: jewish_calendar
    language: english
    diaspora: true
    candle_lighting_minutes_before_sunset: 30
    havdalah_minutes_after_sunset: 45
    sensors:
      - date
      - weekly_portion
      - upcoming_candle_lighting
      - upcoming_havdalah
      - issur_melacha_in_effect

Also, I live in LA if that helps.

I'm having the same issue.

Hello,
Any update on this? Thank you!

Sorry for not commenting earlier. I'm working on a bugfix.
Once I have a patch ready I'll hopefully add it here as a custom component so you don't need to wait for the release.

that's great! thank you!

hello! I was wondering if there has been any further update on this? I've been using another sensor from the community but that seems to be broken lately too.. :(

Mine seems off, but not by an hour. It seems like it might be looking at shkia instead of tzeis for ending times (not sure about the start time)


How to host in console project?

Need to host in service fabric all the examples use web project and it doesnt work if I move to a console app with Kestrel host?

All samples are actually console projects - try to run them with dotnet run from the command line.

sorry the 2 samples i was brought were .net core web with web.config investigating why it doesnt work when copying.


Include selected state for Tabs to the Admin Workspace page

Missing selected state for tabs
Component Reference: https://mosaic.vercel.app/docs/navigation/tabs

Closing as this was created in the Prism repository not the platform-internal repository. Created https://github.com/stoplightio/platform-internal/issues/6812 to replace it.


Delete FUNDING.yml

Since we don't need it and the footer mentions the theme author.

sigh, wrong repo.........


Add DNS token

为确保 Token Profile 的顺利通过，务必逐一确保以下检查项并补充项目资料：
.json 及 .png 文件检查项

[x] logo 尺寸：120*120 px
[x] logo 背景：透明
[x] 代币有至少一笔成功的转账记录
[x] 此项对于 ERC-20 项目方：合约地址有大小写（做 checksum）
[x] .json 和 .png 文件名一致（包括大小写）

项目资料：
官方公告：BitDNS是基于区块链的域名解析系统，连接信息互联网与价值区块链的超级枢纽
团队背景：Karen New是BitDNS创始人兼CEO区块链行业专家，数字资产早期从业者，在牛津大学学习过密码学，参与撰写并发表《新资产——乘上加密货币浪潮》等著作。曾为多个区块链项目提供战略指导，并在构建智能合约，tokenomics，dapps方面有丰富的经验。被知名媒体评为亚洲区块链行业最具影响力女性人物。Kingsley Low是BitDNS CTO，区块链技术与计算机安全领域专家，开源文化及软件自由先驱。加密货币早期思想领袖，曾在售后服务业及供应链领域有20年领导开发经验。目前参与主导BitDNS的核心模块开发，旨在提升开发者体验，构建大规模区块链商业应用的基础。Sorbon是BitDNS企业战略及应用业务负责人，拥有多年全球顶级咨询公司普华永道的工作经验 ，曾参与大型跨国公司及政府的战略制定与推动，拥有多年行业的创新项目经验。
项目基本情况：BitDNS是基于区块链及智能合约的新一代分布式DNS系统，解决传统DNS域名系统易被攻击、中心化垄断、隐私泄露等问题，具有NFT域名投资、交易、解析等功能；基于BitDNS，独创了全网通分布式互联网用户身份识别系统BitUID，用户通过智能合约直接使用TOKEN购买会员服务，保护其隐私信息和会员权益；基于BitDNS，还开发了区块链版Appstore和网址导航，围绕域名解析入口和BitUID海量用户，聚合新一代dWeb4.0应用，如：分布式网站、最加密的邮箱、即时通信、社交关系网络、视频会议、分布式信息流、短视频、分布式商业。
媒体报道：暂无
收录的交易所：暂无
转账所需 Gas Limit（对 ERC-20 项目方）：85800

Please check the following to ensure a successful verification of Token Profile
.json and .png document checklists

[x] logo dimensions: 120*120 px
[x] logo background: Transparent
[x] At least one transaction on the token contract
[x] For ERC-20 project teams: Upper and lower capitalized alphabets in token address (For checksum purposes)
[x] Same document name for both .json and .png (Including capitalization)

Project background:
Official announcement: BitDNS is a domain name resolution system based on blockchain, and is the super-hub connecting information and value between internet and blockchain
Project team background: Karen new is the founder and CEO of bitdns, an expert in blockchain industry and an early practitioner of digital assets. She studied cryptography at Oxford University and participated in the writing and publication of new assets: riding the wave of cryptocurrency and other works. He has provided strategic guidance for many blockchain projects, and has rich experience in building smart contracts, tokenomics and dapps. She was rated as the most influential female figure in Asian blockchain industry by well-known media. Kingsley low is bitdns CTO, an expert in blockchain technology and computer security, and a pioneer in open source culture and software freedom. As an early thought leader of cryptocurrency, he has 20 years of experience in the field of after-sales service and supply chain. At present, we participate in the core module development of bitdns, aiming to improve the experience of developers and build the foundation of large-scale blockchain commercial applications. Sorbon is the head of enterprise strategy and application business of bitdns. He has many years of working experience of PricewaterhouseCoopers, the world's top consulting company. He has participated in the strategic formulation and promotion of large multinational companies and governments, and has many years of industry innovation project experience.
Project basic information: BitDNS is a new generation of distributed DNS system based on blockchain and smart contract. It solves the problems of traditional DNS domain name system, such as easy to be attacked, centralized monopoly and privacy leakage. It has NFT domain name investment, transaction, resolution and other functions. Based on bitdns, it has created the whole Netcom distributed Internet user identification system bituid, and users can directly use token to purchase membership services through smart contracts Based on bitdns, we also developed a blockchain version of Appstore and web site navigation to aggregate a new generation of dWEB4.0 applications, such as distributed websites, the most encrypted mailbox, instant messaging, social networking, video conference, distributed information flow, short video, and distributed commerce based on bitdns.
Media publications: not yet
Tradeable exchanges: not yet
Recommended Gas Limit (For ERC-20 project teams) for transaction: 85800

为确保资料提交的真实性，请在贵方官网或其他经过认证的社交媒体渠道发布公告，并将此公告链接附于「官方公告」。推荐文案：
#imToken# #1636# 我们正在完善 XXX 在 imToken 中的代币相关资料。完成后，大家可以在 imToken 里看到 logo，更方便地管理 XXX，同时能看到更多代币信息。
注：

1636 为 pr 序号，如 https://github.com/consenlabs/token-profile/pull/1636 的序号为 1636，这是帮助 imToken 判断 pr 真实性的关键。
#imToken #1636 标签及其展示形式可自行调整。
若未提供「官方公告」，则无法显示代币信息。

非常抱歉，由于该PR长时间未更新，我们先关闭这个PR
如果仍需提交，请参考教程重新提交：
https://github.com/consenlabs/token-profile#token-profile-guideline


[Billing] Add new command groups to manage Agreement, RoleAssignment, RoleDefinition and Instructions

Description

Testing Guide

Part 2 of https://github.com/Azure/azure-cli/issues/15473.
History Notes

[Billing] az billing agreement: New commands to manage billing agreement.
[Billing] az billing permission: New commands to manage billing permission.
[Billing] az billing role-assignment: New commands to manage role assignment.
[Billing] az billing role-definition: New commands to display role definition.
[Billing] az billing instruction: New commands to manage instructions of billing.

This checklist is used to make sure that common guidelines for a pull request are followed.

[ ] The PR title and description has followed the guideline in Submitting Pull Requests.

[ ] I adhere to the Command Guidelines.

Billing

/azp run


Add PodSandboxStatus api implementation

A part of #8
Signed-off-by: Xianglin Gao<EMAIL_ADDRESS>

This change is

@xlgao-zju PodSandboxStatus depends on the implementation details of CreatePodSandbox. Please wait a while for it.

@feiskyer Ok.

@feiskyer rebased

@feiskyer updated

@feiskyer updated

LGTM. Thanks.


InvalidOperationException: No Entity Framework provider found for the ADO.NET provider with invariant name 'System.Data.SqlClient'.

From @stanuku on July 8, 2017 6:6
Hello - I'm getting this runtime exception.
My solution details:
Target Framework = .NET 4.6.1

VS 2017 15.2 (26430.120
A class library project (repositories library) using DbContext (using Entity Framework 6.3, not EF Core)
ASP.NET Core 1.1 API project referencing the repositories project.
Running any query using DbContext throws this exception.

Adding the <entityFramework> in the App.config of the API project doesn't help. I suspect that the build is not copying EntityFramework.SqlServer.dll to the API project's bin folder.
Adding Entity Framework package to the API project directly does copy the EntityFramework.SqlServer.dll to the bin folder during build. However, I don't prefer to do that. Rather I would like to maintain the indirection through the repository project.
Any suggestions? (again, I'm not using EF Core, can't take chances in this critical project).
Thanks
Copied from original issue: aspnet/EntityFramework#9120

See https://entityframework.codeplex.com/workitem/2352

@stanuku See the CodePlex issue above for information about making sure the assembly gets deployed. In addition to this, you'll need to make sure that any necessary config file changes are made. We do the best we can within the NuGet environment to ensure that these changes get made for you, but depending on where and how you have NuGet install the package you may need to make some changes manually. Closing this, as we don't think there is anything actionable on the EF Side.

I'm having the same issue and provided link doesn't work anymore. Can you point me to the solution?

Info from the CodePlex issue:
There's an issue which a number of people have reported when using EF 6 with Code First around the EntityFramework.SqlServer provider (or another provider they are using) not being copied locally. This leads to the following error:

System.InvalidOperationException: The Entity Framework provider type 'System.Data.Entity.SqlServer.SqlProviderServices, EntityFramework.SqlServer' registered in the application config file for the ADO.NET provider with invariant name 'System.Data.SqlClient' could not be loaded. Make sure that the assembly-qualified name is used and that the assembly is available to the running application. See http://go.microsoft.com/fwlink/?LinkId=260882 for more information.

This only occurs when the EntityFramework NuGet package is not installed in the start-up project (i.e. it is only installed in a class library etc.)
This issue isn't specific to Entity Framework, but is a side effect of how MSBuild works out which assemblies need to be deployed. The issue occurs because there is no code in the application that explicitly references types in EntityFramework.SqlServer.dll (or relevant provider assembly) since EF will load the assembly at runtime based on info in the App/Web.config file. As a result, MSBuild does not detect that the assembly is needed and will not copy it to the output directory.
There are workarounds to solve this issue:

Install NuGet package in start up project. Simply installing the NuGet package that contains the provider in the start up application is enough to resolve this issue. In the case of SqlServer, this means installing the EntityFramework NuGet package in your start up project.
Add code to reference types from the provider assembly. You can add a line of code that references a type in the provider assembly. This line of code won't actually do anything and can be placed anywhere in your application: var ensureDLLIsCopied = System.Data.Entity.SqlServer.SqlProviderServices.Instance;

Why isn't EF fixing this issue? This issue isn't specific to EF and is a general MSBuild issue. That said, if there was a reasonable way for us to resolve the issue we would. The easiest way would be to have code in EntityFramework.dll that references EntityFramework.SqlServer.dll, but this isn't possible because the SqlServer assembly needs to reference the main EF assembly. Given that there is no clean way for us to resolve the issue, and that there are simple workarounds, we are not going to try and fix it.


Unable to install node-gyp or heapdump

My main objective is to install heapdump,in order to do so, I need to install node-gyp, followed directions at the node-gyp main page. I was led to installing Python and VS Studio Express 2013 Update 3. I am using Windows 7.
Either way, when I tried to install either npm install heapdump --msvs_version=2013 or npm install node-gyp --msvs_version=2013, I get the following error:

C:\Users\pechu\projects\xis>npm install heapdump --msvs_version=2013
\

<EMAIL_ADDRESS>install C:\Users\pechu\projects\xis\node_modules\heapdump
node-gyp rebuild

C:\Users\pechu\projects\xis\node_modules\heapdump>node "C:\dev\nodejs\node_modul
es\npm\bin\node-gyp-bin....\node_modules\node-gyp\bin\node-gyp.js" rebuild
Building the projects in this solution one at a time. To enable parallel build,
please add the "/m" switch.
heapdump.cc
c:\users\pechu\projects\xis\node_modules\heapdump\src\compat-inl.h(50): error C
2070: 'overloaded-function': illegal sizeof operand [C:\Users\pechu\projects\xi
s\node_modules\heapdump\build\addon.vcxproj]
c:\users\pechu\projects\xis\node_modules\heapdump\src\compat-inl.h(60
) : see reference to class template instantiation 'compat::I::HasGetConstruct
orMethodv8::Object' being compiled
c:\users\pechu\projects\xis\node_modules\heapdump\src\compat-inl.h(180): warnin
g C4244: 'argument' : conversion from 'intptr_t' to 'int32_t', possible loss of
data [C:\Users\pechu\projects\xis\node_modules\heapdump\build\addon.vcxproj]
gyp ERR! build error
gyp ERR! stack Error: C:\Program Files (x86)\MSBuild\12.0\bin\msbuild.exe fail
ed with exit code: 1
gyp ERR! stack     at ChildProcess.onExit (C:\dev\nodejs\node_modules\npm\node_m
odules\node-gyp\lib\build.js:267:23)
gyp ERR! stack     at ChildProcess.emit (events.js:98:17)
gyp ERR! stack     at Process.ChildProcess._handle.onexit (child_process.js:810:
12)
gyp ERR!  Exit status 1
npm ERR!
npm ERR! Failed at the<EMAIL_ADDRESS>install script.
npm ERR! This is most likely a problem with the heapdump package,
npm ERR! not with npm itself.
npm ERR! Tell the author that this fails on your system:
npm ERR!     node-gyp rebuild
npm ERR! You can get their info via:
npm ERR!     npm owner ls heapdump
npm ERR! There is likely additional logging output above.
npm ERR! System Windows_NT 6.1.7601
npm ERR! command "C:\dev\nodejs\node.exe" "C:\dev\nodejs\node_modules\n
pm\bin\npm-cli.js" "install" "heapdump" "--msvs_version=2013"
npm ERR! cwd C:\Users\pechu\projects\xis
npm ERR! node -v v0.10.31
npm ERR! npm -v 1.4.23
npm ERR! code ELIFECYCLE
npm ERR!
npm ERR! Additional logging details can be found in:
npm ERR!     C:\Users\pechu\projects\xis\npm-debug.log
npm ERR! not ok code 0

any help?

@peterchchu Are you able to reproduce this on a more recent version of node-gyp?

Closing due to inactivity, please feel free to reopen if you are able to reproduce on a more recent version of node-gyp :)


[Bug] QueryStringRequestCultureProvider Issue

While i'm writing unit tests for RequestCultureProvider implementations,  I notice that QueryStringRequestCultureProviderreturns DefaultRequestCulture for the RequestLocalizationOptions instead of returning a RequestCulture based on UIQueryStringKey property.
I will create a PR soon to fix this bug, also I wrote a unit test to validate the scenario. I'm struggling to create another PR today for  RequestCultureProvider implementations unit tests

@DamianEdwards thoughts? Is this a correct fallback behavior? I would think that defaulting the culture when it wasn't explicitly set seems wrong, but maybe not...

@Eilon according what i know from ASP.NET WebForms, the default Culture is en-US and UICulture is en-GB, nothing but what I have seen in QueryStringRequestCultureProvider that whenever the UIQueryStringKey is missing, it assigned the QueryStringKey value, so I think the same if QueryStringKey is missing while it doesn't follow the fallback of ASP.NET

I think my original thoughts were that using the format culture as the UI culture was somehow more OK than using the UI culture as the format culture... maybe. That said, I can't think of any science to back that up. In this case, I don't think I really expected the QueryStringRequestCultureProvider to be used in production much; I found it useful to enable during development for easy switching between cultures via the URL, and having it set the UI culture based on the format culture was easy.
So, I'm happy to make it set it both ways,

Fixed in c065c90337bf8364abd2e46815e17ba0d31af7c9


[WFLY-19640] Upgrade the Jakarta XML Binding Implementation to 4.0.5

Issue: https://issues.redhat.com/browse/WFLY-19640
[WFLY-19640] Upgrade the Jakarta XML Binding Implementation to 4.0.5

@jimma or @ropalka please review

@soul2zimate  I sent a PR to CXF main first to check: https://github.com/apache/cxf/pull/2031.
If this is good to upgrade in CXF , it's good to upgrade in WFLY too.  Thanks.

This is up to @jimma to decide about this component ugprade @bstansberry .

https://github.com/apache/cxf/pull/2031 was resolved in CXF, so based on @jimma 's comment above I'll merge this.

Thanks @soul2zimate and @jimma


Order of characters and styles with a trained model.

I was able to get a model trained on 800 prompts. I will likely create more prompts to fine-tune the model, but I am not sure why the characters are not in the correct order. I am not using any styles for this result but that might be the issue. I understand this is more of problem with handwriting-synthesis, but I was wondering if you encountered this issue as well.  I used that one script for creating a custom style, but it only does the strokes. This is the output I got for all star lyrics. Thanks for all the help again.

I was able to get a model trained on 800 prompts. I will likely create more prompts to fine-tune the model, but I am not sure why the characters are not in the correct order. I am not using any styles for this result but that might be the issue. I understand this is more of problem with handwriting-synthesis, but I was wondering if you encountered this issue as well.  I used that one script for creating a custom style, but it only does the strokes. This is the output I got for all star lyrics. Thanks for all the help again.

It looks like it might be an over fitting issue. When you're training your model, do you notice the training error and validation error amounts diverging a lot? I never got this far; I only used ~100 prompts at most. I'm very glad you're finding my program to be useful!

I was able to get a model trained on 800 prompts. I will likely create more prompts to fine-tune the model, but I am not sure why the characters are not in the correct order. I am not using any styles for this result but that might be the issue. I understand this is more of problem with handwriting-synthesis, but I was wondering if you encountered this issue as well.  I used that one script for creating a custom style, but it only does the strokes. This is the output I got for all star lyrics. Thanks for all the help again.

It looks like it might be an over fitting issue. When you're training your model, do you notice the training error and validation error amounts diverging a lot? I never got this far; I only used ~100 prompts at most. I'm very glad you're finding my program to be useful!

Yeah I feel like this is an error in the training. It starts with a loss of 4.0 and is at a loss of 0 at around step 380. It only takes a couple hours to train on CPU. I feel like it should take longer?

Yeah I feel like this is an error in the training. It starts with a loss of 4.0 and is at a loss of 0 at around step 380. It only takes a couple hours to train on CPU. I feel like it should take longer?

I'm definitely no expert on the model itself, but some tweaking definitely needs to be done. In my experience training a model, I was able to get negative loss values (which, as it turns out, is normal). Have you had that happen? You can mess with the model's settings, specifically:
'''
nn = rnn(
reader=dr,
log_dir='logs',
checkpoint_dir='checkpoints',
prediction_dir='predictions',
#learning_rates=[.0001, .00005, .00002], # This was the original set of learning rates.
learning_rates=[.001, .0005, .0002], # These learning rates are VERY relaxed.
#batch_sizes=[32, 64, 64], # Much larger batch sizes means less chance of overfitting, but:
batch_sizes=[8, 16, 16], # Smaller batch sizes means it is easier to train on less data.
#patiences=[1500, 1000, 500], # Larger patience values lets the model train for longer even with prolonged increases in loss.
patiences=[1000, 500, 250],
beta1_decays=[.9, .9, .9],
validation_batch_size=32, # THIS might have large impact on overfitting. Larger value means more extensive model performance checking.
optimizer='rms',
#num_training_steps=100000, # Larger max training steps lets the model train for longer (and maybe that's better)
num_training_steps=2500, # This is a VERY small value.
warm_start_init_step=0,
regularization_constant=0.0,
keep_prob=1.0,
enable_parameter_averaging=False,
#min_steps_to_checkpoint=2000, # A larger value ensures poor-performing, early models are not in the running.
min_steps_to_checkpoint=1000,
log_interval=20,
grad_clip=10,
lstm_size=400,
output_mixture_components=20,
attention_mixture_components=10
)
'''
Hope this gives some good pointers as to where to start, but like I said, I never got this far with my own training.

Yeah I feel like this is an error in the training. It starts with a loss of 4.0 and is at a loss of 0 at around step 380. It only takes a couple hours to train on CPU. I feel like it should take longer?

I'm definitely no expert on the model itself, but some tweaking definitely needs to be done. In my experience training a model, I was able to get negative loss values (which, as it turns out, is normal). Have you had that happen? You can mess with the model's settings, specifically:

nn = rnn(

        reader=dr,

        log_dir='logs',

        checkpoint_dir='checkpoints',

        prediction_dir='predictions',

        #learning_rates=[.0001, .00005, .00002], # This was the original set of learning rates.

        learning_rates=[.001, .0005, .0002], # These learning rates are WAY faster.

        #batch_sizes=[32, 64, 64], # Much larger batch sizes means less chance of overfitting, but:

        batch_sizes=[8, 16, 16], # Smaller batch sizes means it is easier to train on less data.

        #patiences=[1500, 1000, 500], # Larger patience values lets the model train for longer even with prolonged increases in loss.

        patiences=[1000, 500, 250],

        beta1_decays=[.9, .9, .9],

        validation_batch_size=32, # THIS might have large impact on overfitting. Larger value means more extensive model performance checking.

        optimizer='rms',

        #num_training_steps=100000, # Larger max training steps lets the model train for longer (and maybe that's better)

        num_training_steps=2500, # This is a VERY small value.

        warm_start_init_step=0,

        regularization_constant=0.0,

        keep_prob=1.0,

        enable_parameter_averaging=False,

        #min_steps_to_checkpoint=2000, # A larger value ensures poor-performing, early models are not in the running.

        min_steps_to_checkpoint=1000,

        log_interval=20,

        grad_clip=10,

        lstm_size=400,

        output_mixture_components=20,

        attention_mixture_components=10

    )

Hope this gives some good pointers as to where to start, but like I said, I never got this far with my own training.

Yeah I'm no expert on the training either 💀 I just read up on overfitting and that sounds about right. The loss values are negative by the time it checkpoints (around -.50) But like you said, that is normal. I'll mess around with the model settings and see if there is a fix in that. I feel like it should be training slower so maybe i need to set higher # of epochs?

@acmattson3
Good news! Changing those values seems to produce a better model. Over the next few days, I will add more prompt data and train with a slower learning rate. Also, the validation_batch_size seems to be one of the more important values to modify to avoid overfitting like you said.  These are the values I trained with.
nn = rnn(
reader=dr,
log_dir='logs',
checkpoint_dir='checkpoints',
prediction_dir='predictions',
# learning_rates=[.0001, .00005, .00002],
learning_rates=[.001, .0005, .0002],
batch_sizes=[32, 64, 64],
# batch_sizes=[8, 16, 16],
patiences=[1500, 1000, 500],
# patiences=[1000, 500, 250],
beta1_decays=[.9, .9, .9],
validation_batch_size=64,
optimizer='rms',
num_training_steps=100000,
# num_training_steps=2500,
warm_start_init_step=0,
regularization_constant=0.0,
keep_prob=1.0,
enable_parameter_averaging=False,
min_steps_to_checkpoint=360,
# min_steps_to_checkpoint=380,
log_interval=20,
grad_clip=10,
lstm_size=400,
output_mixture_components=20,
attention_mixture_components=10
)
nn.fit()

@acmattson3
Good news! Changing those values seems to produce a better model. Over the next few days, I will add more prompt data and train with a slower learning rate. Also, the validation_batch_size seems to be one of the more important values to modify to avoid overfitting like you said.  These are the values I trained with.
nn = rnn(
reader=dr,
log_dir='logs',
checkpoint_dir='checkpoints',
prediction_dir='predictions',
# learning_rates=[.0001, .00005, .00002],
learning_rates=[.001, .0005, .0002],
batch_sizes=[32, 64, 64],
# batch_sizes=[8, 16, 16],
patiences=[1500, 1000, 500],
# patiences=[1000, 500, 250],
beta1_decays=[.9, .9, .9],
validation_batch_size=64,
optimizer='rms',
num_training_steps=100000,
# num_training_steps=2500,
warm_start_init_step=0,
regularization_constant=0.0,
keep_prob=1.0,
enable_parameter_averaging=False,
min_steps_to_checkpoint=360,
# min_steps_to_checkpoint=380,
log_interval=20,
grad_clip=10,
lstm_size=400,
output_mixture_components=20,
attention_mixture_components=10
)
nn.fit()

Those are much improved results! Keep me updated on your progress as you add more data and tweak your values. It'll be interesting to see how your changes affect the model.

Also interested in this, any update?

@acmattson3 Good news! Changing those values seems to produce a better model. Over the next few days, I will add more prompt data and train with a slower learning rate. Also, the validation_batch_size seems to be one of the more important values to modify to avoid overfitting like you said. These are the values I trained with. nn = rnn( reader=dr, log_dir='logs', checkpoint_dir='checkpoints', prediction_dir='predictions', # learning_rates=[.0001, .00005, .00002], learning_rates=[.001, .0005, .0002], batch_sizes=[32, 64, 64], # batch_sizes=[8, 16, 16], patiences=[1500, 1000, 500], # patiences=[1000, 500, 250], beta1_decays=[.9, .9, .9], validation_batch_size=64, optimizer='rms', num_training_steps=100000, # num_training_steps=2500, warm_start_init_step=0, regularization_constant=0.0, keep_prob=1.0, enable_parameter_averaging=False, min_steps_to_checkpoint=360, # min_steps_to_checkpoint=380, log_interval=20, grad_clip=10, lstm_size=400, output_mixture_components=20, attention_mixture_components=10 ) nn.fit()

any update?


Error using exchange_declare(). Can't create exchange

Hello,
I'm using lapin version 1.9, and when I try to create a new exchange with exchange_declare(), I get the following error.
Channel closed on channel 1 by 40:10 => AMQPError { kind: Soft(NOTFOUND), message: ShortString("NOT_FOUND - no exchange 'test_exchange' in vhost 'dnsgymgs'") } => NOT_FOUND - no exchange 'test_exchange' in vhost
These are the arguments:
let declare_options = ExchangeDeclareOptions {            passive: true,            durable: false,            auto_delete: true,            internal: false,            nowait: true,        }; self.channel             .exchange_declare(                 "test_exchange",                 ExchangeKind::Topic,                 declare_options,                 FieldTable::default(),             ).await
I'm not sure what's going on here. Am I using the wrong method?
Thank you

Hi,
That's what passive is for, it doesn't create anything, just success if it exists or error otherwise


Bump version to 0.8.0

Coverage remained the same at 0.0% when pulling 1ff2ffd1dbb3069be7f0633d6cb0a29eca1e2e61 on philipc:bump-version into 234f1f153620f348ee428e573cfdc4968eaf6699 on gimli-rs:master.

Published and tagged.


Browser does not pre-fill login credentials

When visiting the login page, my browser does not auto-fill username and password. When successfully logging in, it also does not ask me to save username+password. This makes it harder to use Harbor.
We're using harbor version 1.1.2. The problem happens on Chromium 61.

@ninjadq
Please take a look at this issue.

Hi @cweiske ,
I can't reproduce this. Are you tried A newer version of harbor?

No, I cannot try a new version. I'm only a user here in our company.

This can not reproduce. May be related with browser setting.

close due to inactivity.


chore: upgrade graphql-js new release for defer/stream

I encountered the same issue in graphql-helix btw

Yeah I started upgrading the tutorial and then introspecting in new one the directives weren’t present so I thought maybe I should upgrade it here and see. So not so sure yet will try to explore this.

@PabloSzx this is an issue with the new experimental tag release. I filed an issue https://github.com/robrichard/defer-stream-wg/discussions/27


IntentService getting destroyed right after getting started

For PoC when the service is started and intent fired, the Service then receives the current CONNECTIVITY_ACTION broadcast correctly but after that the Service's onDestroy() is called.

Android Documentation

IntentService: Stops the service after all of the start requests are handled.

The Service is no longer an IntentService. It now uses generic service.


Remove from Track using service calls

I cant find a way to call a service and remove a flight from tracking. It seems I can only do this from UI. Most times I want to track a flight only. Once the flight lands I want to remove it from flight track as I see the add on keeps tracking the flight until I manually remove it.
I can write a quick NodeRed flow to remove the flight, but I cant find an Action (service call) to remove it. Any help will be appreciated.

Hi.
There is an example in README how to add a flight for track - https://github.com/AlexandrErohin/home-assistant-flightradar24?tab=readme-ov-file#automation
You just need to replace text.flightradar24_add_to_track to text.flightradar24_remove_from_track

@brownbloodspider Dont forget please to give a star to the repo :)

I cant find a way to call a service and remove a flight from tracking. It seems I can only do this from UI. Most times I want to track a flight only. Once the flight lands I want to remove it from flight track as I see the add on keeps tracking the flight until I manually remove it.
I can write a quick NodeRed flow to remove the flight, but I cant find an Action (service call) to remove it. Any help will be appreciated.

alias: Action (Delete Flight Number)
description: ""
triggers:
  - event_type: state_changed
    trigger: event
conditions:
  - condition: template
    value_template: >-
      {{ trigger.event.data.new_state.domain == 'device_tracker' and
      trigger.event.data.new_state.attributes.tracked_type == 'schedule' and
      trigger.event.data.old_state.attributes.tracked_type == 'live'}}
actions:
  - action: text.set_value
    metadata: {}
    data:
      value: "{{ trigger.event.data.old_state.attributes.flight_number }}"
    target:
      entity_id: text.flightradar24_remove_from_track


Simplify codes in example/boot/simple/main.go

Codecov Report

Merging #2 (6c1880d) into master (d66e774) will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master       #2   +/-   ##
=======================================
  Coverage   81.76%   81.76%
=======================================
  Files          36       36
  Lines        2879     2879
=======================================
  Hits         2354     2354
  Misses        421      421
  Partials      104      104

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update d66e774...6c1880d. Read the comment docs.


Element ref

getElementsByClassName is faster than querySelector 🚀
Though it's shaving off milliseconds :trollface:
https://gomakethings.com/javascript-selector-performance/ 🤷♂

Woop! 🎉


Anonymous User is able to delete reviews

Anonymous users should only be able to post reviews and not modify or delete existing reviews

Good call. Since we have the checkbox to flag yourself as "wanting to remain anonymous" in the My Account page, there is no longer a need for anonymous login. I removed anonymous login, and now, a user can edit/remove only reviews he/she has authored.


Objects with RxMoyaProvider are no longer retained in 9.0

Hey,
I'm running into an interesting issue with Moya 9.0
I have a Service type for each kind of request that looks like:
struct UserService {
    let provider: MoyaProvider<MyAPI>

    init(provider: MoyaProvider<MyAPI>) {
        self.provider = provider
    }

    func login(usingUsername username: String, password: String) -> Single<String?> {
        return self.provider.rx.request(.login(username: username, password: password))
            .performMapping()
    }
}

This is then used like this from a singleton class:
let userService = UserService(provider: MoyaProvider<MyAPI>())
userService.performLogin(username: "foo", password: "bar").subscribe(onSuccess: {...}, onError: {...}

This used to work fine in Moya 8.x, where I was using a RxMoyaProvider. Any suggestions to workarounds or whether this should be fixed on Moya's side?

Forgot to add usage example of the service.

@bhstrifork Hey, could you clarify which behavior is different now? I can get a hint from the issue title, but I feel a more complete description would be helpful :wink:

Yeah, I should've been clearer.
In Moya 8.x I could use the UserService as shown above, and it would not get deallocated. Now in Moya 9.0 it is deallocated immediately, meaning my request either doesn't fire, or I never receive the response in my subscription. I was trying to find the issue discussing this already in Moya 8, but I can't seem to find it.
So basically I would like to have a function call as follows:
func login() {
  let userService = UserService(provider: MoyaProvider<MyAPI>())
  userService.performLogin(username: "foo", password: "bar")
    .subscribe(onSuccess: {...}, onError: {...}
}

And then maybe have it call a completion or similar. Or even just forward the request like this:
func login() -> Single<String?> {
  let userService = UserService(provider: MoyaProvider<MyAPI>())
  return userService.performLogin(username: "foo", password: "bar")
}

So the caller doesn't have to care about the UserService.
Does this clarify things?

I think the issue is the provider itself isn't retained, usually a singleton is defined somewhere outside with a static let. Are you familiar with how ARC works in Swift?
Here is your function with some annotations from me
func login() {
  // begin creating a UserService
  //      create a MoyaProvider to pass in as a param
  //      set the UserService.provider to this MoyaProvider (in UserService.init)
  let userService = UserService(provider: MoyaProvider<MyAPI>())

  // create an Observable - nothing interesting here
  userService.performLogin(username: "foo", password: "bar")
    .subscribe(onSuccess: {...}, onError: {...}

  // we're about to leave the scope of this function! free any local variables we created!
  //   userService has 0 strong references and will be disposed of
  //      all of userService's instance variables (userService.provider included) will all be disposed of as well if they have 0 references -- which in this simple case they do
}

So, I was thinking about this last night and I realized that I actually don't keep a reference to the provider as stated is required in the docs. Like you also point out. I am familiar with ARC though. I guess a way to simplify the example is to simply remove UserService from the equation.
Moya 8.x let's me do the following:
func login() -> Observable<String?> {
  let provider = RxMoyaProvider<MyAPI>()
  return provider.request(.login(username: username, password: password))
            .performMapping()
}

It could be that this is a bug in Moya 8.x, but I do recall an issue talking about this being a use case.

Anyway, I think this is non-obvious behaviour anyway. So I'll find a way to work around it on my end.

Anyway, I think this is non-obvious behaviour anyway. So I'll find a way to work around it on my end.

@bhstrifork that does look like a pretty serious bug in 8.x, are you sure that request's subscription fired? Can you give me a commit hash of Moya where you were able to repro, or exactly which version?
If you think it's non obvious behaviour we should re-examine our code and see if there's anyway to make it easier to reason about -- if you're interested, I'd be more than happy to make changes based on what you think is wrong; can you explain what doesn't make sense?

Just realized I made this from the wrong account. Oh well.
Sorry about the very slow response. The commit hash is: 4512a2a4bc8019cf006434378ac6a0640f34f35f
It seems that @volodg is also relying on this behaviour in Moya 8.x from how I interpret their response in https://github.com/Moya/Moya/pull/1294#issuecomment-331320987
I think this was a, potentially unintended, behaviour that people ended up relying on. I do think that the new behaviour is easier to reason about, and you don't end up with potential reference cycles as easily.
I think this issue can just be closed.

Hmm, it looks like maybe the bug was fixed in https://github.com/Moya/Moya/blob/master/Changelog.md#900-alpha1
That makes sense, thanks for reporting @bjarkehs


[hotfix][doc] Fix a concurrent issue in testing.md

What is the purpose of the change
An example in testing.md uses synchronized keyword to protect a static variable, which will cause concurrent issues with multiple sink instances.
Brief change log
Use Collections.synchronizedList() to create a thread-safe list and remove the old synchronized keyword.
Verifying this change
This change is a trivial rework / code cleanup without any test coverage.
This change added tests and can be verified as follows:
Does this pull request potentially affect one of the following parts:

Dependencies (does it add or upgrade a dependency): (no)
The public API, i.e., is any changed class annotated with @Public(Evolving): (no)
The serializers: (no)
The runtime per-record code paths (performance sensitive): (no)
Anything that affects deployment or recovery: JobManager (and its components), Checkpointing, Kubernetes/Yarn/Mesos, ZooKeeper: (no)
The S3 file system connector: (no)

Documentation

Does this pull request introduce a new feature? (no)
If yes, how is the feature documented? (not applicable)

I've done that 😊


document approach to disabling output

Looks like this is possible (not supported, maybe?) but not documented. Helps out a lot with using the exposed API with custom behavior on the tool's output.

Hi @OutdatedVersion thanks for your contribution!


Recognise .mts & .cts as TypeScript files

See: https://www.typescriptlang.org/docs/handbook/esm-node.html#new-file-extensions

Included with 9.0.0602


Demo run time error

in the icons section I get this error:
TypeError: Failed to construct 'URL': Please use the 'new' operator.

[ ] The issue is present in the latest release.
[ ] I have searched the issues of this repository and believe that this is not a duplicate.

  Output from `npx @material-ui/envinfo` goes here.

Thanks for the report!
Do you remember on which page/demo that happened?

This happened with me too, but it's hard to reproduce the bug.

Closing in favor of https://github.com/mui-org/material-ui/issues/26943

Duplicate of #27153


Help with phantom files on LSF server.

Hi, all. Hoping someone can shed some light on this. I'm running Snakemake on a compute server that runs LSF under a cache layer system. The server can experience latency in seeing that files have been removed. For example, the act of listing a directory that has been removed (but still looks to be there) will report the files are not there. After listing, the system flushes the removed directory and the removed files are no longer "there". This happens in the .snakemake/tmp* directories during parallel processing:
ls: cannot access .snakemake/tmp.yodq9cq4/write_sam.64.sh: No such file or director
Snakemake actually finishes all rules/steps and then post all-rule throws an error looking for phantom files.
[Tue Nov 24 16:17:52 2020]
Finished job 5.
676 of 677 steps (100%) done

[Tue Nov 24 16:17:52 2020]
localrule all:
    input: REPORT.trans_nuc_counts.txt, REPORT.nuc_counts.txt, REPORT.nuc_ambiguous_counts.txt, REPORT.trans_nuc_ambiguous_counts.txt, viromatch_results/tmp_dir_cleanup/DONE.tmp_dir_cleanup.txt
    jobid: 0

[Tue Nov 24 16:17:52 2020]
Finished job 0.
677 of 677 steps (100%) done
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/dist-packages/snakemake/__init__.py", line 735, in snakemake
    keepincomplete=keep_incomplete,
  File "/usr/local/lib/python3.7/dist-packages/snakemake/workflow.py", line 972, in execute
    success = scheduler.schedule()
  File "/usr/local/lib/python3.7/dist-packages/snakemake/scheduler.py", line 383, in schedule
    self._executor.shutdown()
  File "/usr/local/lib/python3.7/dist-packages/snakemake/executors/__init__.py", line 668, in shutdown
    shutil.rmtree(self.tmpdir)
  File "/usr/lib/python3.7/shutil.py", line 494, in rmtree
    _rmtree_safe_fd(fd, path, onerror)
  File "/usr/lib/python3.7/shutil.py", line 452, in _rmtree_safe_fd
    onerror(os.unlink, fullname, sys.exc_info())
  File "/usr/lib/python3.7/shutil.py", line 450, in _rmtree_safe_fd
    os.unlink(entry.name, dir_fd=topfd)
FileNotFoundError: [Errno 2] No such file or directory: '566.jobfinished'

This is frustrating, as Snakemake has actually finished all of the steps in the pipeline successfully. I see support for latency waiting for files to appear, but this seems to be a different problem.
Anyway, any insight or suggestions for obviating this post-DAG error would be greatly appreciated. Thanks in advance!

Is there a way to decouple the .snakemake directory from the --directory (output) directory --- i.e. have them write to separate disks? Or, can we write the .snakemake/tmp* files to another disk? We have a fast scratch disk space that is not layered (as outlined above). If I could write the .snakemake/tmp* files to the fast disk, but keep writing output to the --directory, I think the issue would be resolved.

I re-wrote my pipeline to symlink the output directory to slower, larger disks and keep all of the Snakemake processing files/directory on fast disks. Essentially, the master script reads/writes all of the pipeline housekeeping stuff to fast space and the heavy, computational files are written to slower space. And ... it worked. No errors, the tmp dirs cleaned themselves up, and the stats files were written on completion. The latency for process monitoring was removed.


Require Maven 3.5.4+

README to fix

Currently, version also needs to be updated here: https://github.com/mojohaus/versions/blob/6cd759ce2b1e884ebbbf3dece70b156d1b102753/versions-maven-plugin/src/main/java/org/codehaus/mojo/versions/DisplayPluginUpdatesMojo.java#L128
However, I think that this assumption is bogus: minimum maven version of the POM doesn't have to be the same as the minimum version required to run versions-maven-plugin.