[spawn_urdf-4] process has died

Describe the bug
log file: C:\Users\NAME.ros\log\3523f36e-36e5-11e9-a3db-106530272d8c\gazebo_gui-3*.log
[ERROR] [1550869401.276000, 6.017000]: Spawn service failed. Exiting.
[gazebo-2] process has finished cleanly
log file: C:\Users\NAME.ros\log\3523f36e-36e5-11e9-a3db-106530272d8c\gazebo-2*.log
[spawn_urdf-4] process has died [pid 19968, exit code 1, cmd python c:\opt\ros\melodic\x64\lib\gazebo_ros\spawn_model -urdf -model turtlebot3_waffle -x -2.0 -y -0.5 -z 0.0 -param robot_description __name:=spawn_urdf __log:=C:\Users\NAME.ros\log\3523f36e-36e5-11e9-a3db-106530272d8c\spawn_urdf-4.log].
log file: C:\Users\NAME.ros\log\3523f36e-36e5-11e9-a3db-106530272d8c\spawn_urdf-4*.log
===========REQUIRED process [rviz-10] has died!
NOTE: NAME and myhostname are edited names instead of the real UserName and Host ID
To Reproduce
Followed the instructions in the web page below
https://ms-iot.github.io/ROSOnWindows/Turtlebot/Turtlebot3.html
In the section in the web page above "Let’s try out something more!"
roslaunch turtlebot3_gazebo turtlebot3_gazebo_cartographer_demo.launch
ADDITIONAL INFORMATION:
[rospy.internal][ERROR] 2019-02-22 14:03:21,272: Traceback (most recent call last):
File "C:\opt\ros\melodic\x64\lib\site-packages\rospy\impl\tcpros_base.py", line 733, in receive_once
self.stat_bytes += recv_buff(sock, b, p.buff_size)
File "C:\opt\ros\melodic\x64\lib\site-packages\rospy\impl\tcpros_base.py", line 104, in recv_buff
d = sock.recv(buff_size)
error: [Errno 10054] An existing connection was forcibly closed by the remote host
[rospy.internal][ERROR] 2019-02-22 14:03:21,272: Traceback (most recent call last):
File "C:\opt\ros\melodic\x64\lib\site-packages\rospy\impl\tcpros_base.py", line 733, in receive_once
self.stat_bytes += recv_buff(sock, b, p.buff_size)
File "C:\opt\ros\melodic\x64\lib\site-packages\rospy\impl\tcpros_base.py", line 104, in recv_buff
d = sock.recv(buff_size)
error: [Errno 10054] An existing connection was forcibly closed by the remote host
[rosout][ERROR] 2019-02-22 14:03:21,276: Spawn service failed. Exiting.
[rospy.core][INFO] 2019-02-22 14:03:21,276: signal_shutdown [atexit]
[rospy.internal][INFO] 2019-02-22 14:03:22,289: topic[/rosout] removing connection to /rosout
[rospy.internal][INFO] 2019-02-22 14:03:22,289: topic[/clock] removing connection to http://myhostname:51198/
[rospy.impl.masterslave][INFO] 2019-02-22 14:03:22,289: atexit
[rospy.internal][WARNING] 2019-02-22 14:03:22,292: Unknown error initiating TCP/IP socket to myhostname:51197 (http://myhostname:51198/): Traceback (most recent call last):
File "C:\opt\ros\melodic\x64\lib\site-packages\rospy\impl\tcpros_base.py", line 557, in connect
self.socket.connect((dest_addr, dest_port))
File "C:\opt\python27amd64\lib\socket.py", line 228, in meth
return getattr(self._sock,name)(*args)
error: [Errno 10061] No connection could be made because the target machine actively refused it
Expected behavior
Gazebo running a simulated world with a simulated turtlebot, RViz running the mapping progress, and a simulation node to drive the turtlebot random walking.
Environment information:

OS version: winver Windows Version 1703 (OS Build 15063.1563) -- Windows 10 Enterprise
Chocolatey Versions: choco list --local-only  Chocolatey v0.10.11

@TVarkey Thanks for reporting the issues! I noticed http://myhostname:51198/ was used for the connection. Are you trying to communicate the nodes across different machines? Have you tried to play with (or turn off) the firewall to see if it helps with the error of the target machine actively refused it.

@seanyen-msft I am just following instructions in the link provided in the "To Reproduce" and I don't believe there are any communications across machines. Since I am not communicating across machines, is there a way around without turning off the firewall? Thank you.

@TVarkey can you try to run the following under a command prompt with admin privilege? (It is for debugging purpose only. It's not recommended to permanently switch off the firewall.)
> netsh advfirewall set allprofiles state off

@seanyen-msft I ran that command and I am still seeing the same issue
Also, want to point out that, I have not seen any of the gazebo logs such as the gazebo-2*.log, so far
log file: C:\Users\UserName.ros\log\b2f734a1-36fa-11e9-87b2-106530272d8c\gazebo-2*.log
[spawn_urdf-4] process has died [pid 10676, exit code 1, cmd python c:\opt\ros\melodic\x64\lib\gazebo_ros\spawn_model -urdf -model turtlebot3_waffle -x -2.0 -y -0.5 -z 0.0 -param robot_description __name:=spawn_urdf __log:=C:\Users\UserName.ros\log\b2f734a1-36fa-11e9-87b2-106530272d8c\spawn_urdf-4.log].
log file: C:\Users\UserName.ros\log\b2f734a1-36fa-11e9-87b2-106530272d8c\spawn_urdf-4*.log
================================================================================REQUIRED process [rviz-10] has died!

Could you attach master.log from C:\Users\UserName.ros\log*runid*?

master.log

@ooeygui See attached log. Sorry... Did not mean to close. Thanks for your help.

@seanyen-msft Anything else required from me? Please let me know. Thanks, Thomas

@seanyen-msft Anything else required from me? Please let me know. Thanks, Thomas

@seanyen-msft @ooeygui Do you need more information? If not, can you please remove the label for more-information-needed? If you need anything else from me, please let me know

Sorry for the delay - I'm investigating this.

Typically when we see:
An existing connection was forcibly closed by the remote host
It is due to the Firewall blocking access to the ROS process. Can you verify that the firewall rules allow that ROS process?

So I'm seeing the same problems here but tied to [spawn_urdf-3]. I've attached the log files.
[ INFO] [1554903509.360539600]: Finished loading Gazebo ROS API Plugin. [ INFO] [1554903509.375889100]: waitForService: Service [/gazebo_gui/set_physics_properties] has not been advertised, waiting... [ INFO] [1554903509.652757200]: Finished loading Gazebo ROS API Plugin. [ INFO] [1554903509.658113500]: waitForService: Service [/gazebo/set_physics_properties] has not been advertised, waiting... [ INFO] [1554903513.987533500, 0.058000000]: waitForService: Service [/gazebo/set_physics_properties] is now available. [ERROR] [1554903517.413000, 0.282000]: Spawn service failed. Exiting. [gazebo-1] process has finished cleanly log file: C:\Users\xx\.ros\log\dc9d1e8f-5b95-11e9-949c-4439c48fd245\gazebo-1*.log [gazebo_gui-2] process has finished cleanly log file: C:\Users\xx\.ros\log\dc9d1e8f-5b95-11e9-949c-4439c48fd245\gazebo_gui-2*.log [spawn_urdf-3] process has died [pid 352, exit code 1, cmd python C:\opt\ros\melodic\x64\lib\gazebo_ros\spawn_model -urdf -model turtlebot3_waffle -x -2.0 -y -0.5 -z 0.0 -param robot_description __name:=spawn_urdf __log:=C:\Users\xx\.ros\log\dc9d1e8f-5b95-11e9-949c-4439c48fd245\spawn_urdf-3.log]. log file: C:\Users\xx\.ros\log\dc9d1e8f-5b95-11e9-949c-4439c48fd245\spawn_urdf-3*.log
spawn_urdf-3.log
spawn_urdf-3-stdout.log
master.log
When I first ran the tutorial (same as listed by OP) I had to click through several layers of Firewall permissions, of which I granted all network permissions to all processes that prompted for it. It's a single node on a single PC.
I closed all the processes/node, disabled all firewalls via control panel and tried again with the same results. Let me know if you'd like me to try anything else.

For what it's worth: I thought I'd spend some time on this. I'll come back and edit this if I find anything interesting as I go rather than a stream of comments.
I thought I'd start by trying to manually relaunch the spawn_urdf node after the error occurred so I dug through the launch file and the log file to find/validate the command line which I determined to be:
rosrun gazebo_ros spawn_model -urdf -model turtlebot3_waffle -x -2.0 -y -.05 -z 0.0 -param robot_description __name:=spawn_urdf
Interestingly when I run this the node spins up but complains that it can't find the /gazebo/spawn_urdf_model service:

[INFO] [1554991461.045000, 0.000000]: Loading model XML from ros parameter robot_description
[INFO] [1554991461.078000, 0.000000]: Waiting for service /gazebo/spawn_urdf_model
[WARN] [1554991462.100000, 0.000000]: wait_for_service(/gazebo/spawn_urdf_model): failed to contact, will keep trying

Odd part is that this service seems to be up and running; [Clipped output]

C:\Windows\System32>rosservice list
/cartographer_node/get_loggers
/cartographer_node/set_logger_level
/cartographer_occupancy_grid_node/get_loggers
[snip]
/gazebo/set_parameters
/gazebo/set_physics_properties
/gazebo/spawn_sdf_model
/gazebo/spawn_urdf_model
/gazebo/unpause_physics
/gazebo_gui/get_loggers
/gazebo_gui/set_logger_level
[snip]

So I wonder if the forcibly closed error is due to the gazebo node having some sort of issue when executing the service call originating from spawn_urdf? That seems reasonable considering the log file entry since it seems to have found the service when run from the launch file situation:

[rosout][INFO] 2019-04-10 09:38:33,831: Calling service /gazebo/spawn_urdf_model
[rospy.internal][ERROR] 2019-04-10 09:38:37,411: Traceback (most recent call last):
File "C:\opt\ros\melodic\x64\lib\site-packages\rospy\impl\tcpros_base.py", line 733, in receive_once
self.stat_bytes += recv_buff(sock, b, p.buff_size)
File "C:\opt\ros\melodic\x64\lib\site-packages\rospy\impl\tcpros_base.py", line 104, in recv_buff
d = sock.recv(buff_size)
error: [Errno 10054] An existing connection was forcibly closed by the remote host

@bakerhillpins Thanks for the diagnostics! /gazebo/spawn_urdf_model is advertised by gazebo_ros_api_plugin from gazebo_ros. Maybe you can enable DEBUG level messages from gazebo_ros?
Also since the plugin is loaded by Gazebo, logs under c:\Users\<account name>\.gazebo\ might be worth to check as well.

@seanyen I've not tried enabling DEBUG yet. I'll put it on my list.
I looked in the gazebo logs and found 2 things I thought I'd mention.
1st, the log has an error looking for the autorace model.config. Seems odd since the tutorial is referencing the cartographer demo which, as I understand it, uses the Turtlebot World with the Waffle device. There is no config file in that directory, but there are in the world and waffle dirs.

(1554903513 9405700) [Err] [..\gazebo\gui\InsertModelWidget.cc:433] Missing model.config for model "C:/Users/xx/catkin_ws/src/turtlebot3/install\share\turtlebot3_gazebo\models\turtlebot3_autorace"
(1554903513 14483700) model.config file is missing in directory["C:/Users/xx/catkin_ws/src/turtlebot3/install\share\turtlebot3_gazebo\models\turtlebot3_autorace"]

2nd, note that the first half of the directory separators are Linux style. The RosOnWindows page mentions an attempt to convert. Unsure if it matters, but there it is. I can resolve the directory with either separator model via windows explorer but it may have a conversion engine.

When I manually execute the gazebo client it seems to crash and exit every time leaving an error in the Windows Application Event log. (remove the .log extension)
gzclientError.evtx.log
Looking back through the log this error has occurred each time I've executed the client.

This has been tracked for awhile; but has not manifested in several releases. Closing.
If you do come across a new repro, please attach a stack trace of the crashing process.

I am facing the exact same problem! URDF files won't show in Gazebo!

@YoushaaMurhij Thank you for reporting. Can you point me to the repo which reproduces this crash?

@YoushaaMurhij Thank you for reporting. Can you point me to the repo which reproduces this crash?
It is Turtlebot3 repo.
I followed the instructions in the web page below:
https://ms-iot.github.io/ROSOnWindows/Turtlebot/Turtlebot3.html

I noticed I have the same problem when running
roslaunch turtlebot3_gazebo turtlebot3_gazebo_cartographer_demo.launch
on my work computer, running Windows 10 Enterprise. However, when I repeated the same steps on my personal PC, I did not have this error at all and it worked fine. On my work laptop, I tried to reinstall from scratch, but every time when running the launch file I get the following output:
NODES
  /
    cartographer_node (cartographer_ros/cartographer_node)
    cartographer_occupancy_grid_node (cartographer_ros/cartographer_occupancy_grid_node)
    flat_world_imu_node (turtlebot3_slam/flat_world_imu_node)
    gazebo (gazebo_ros/gzserver)
    gazebo_gui (gazebo_ros/gzclient)
    move_base (move_base/move_base)
    robot_state_publisher (robot_state_publisher/robot_state_publisher)
    rviz (rviz/rviz)
    spawn_urdf (gazebo_ros/spawn_model)
    turtlebot3_drive (turtlebot3_gazebo/turtlebot3_drive)

auto-starting new master
process[master]: started with pid [35508]
ROS_MASTER_URI=http://<IP_ADDRESS>:11311
setting /run_id to a98ddd0f-7051-11ea-99a0-00216afa3394
process[rosout-1]: started with pid [32392]
started core service [/rosout]
process[gazebo-2]: started with pid [38248]
process[gazebo_gui-3]: started with pid [43208]
process[spawn_urdf-4]: started with pid [116112]
process[robot_state_publisher-5]: started with pid [72360]
process[move_base-6]: started with pid [92348]
ERROR: cannot launch node of type [cartographer_ros/cartographer_node]: cartographer_ros
ROS path [0]=C:\opt\ros\melodic\x64\share\ros
ROS path [1]=C:/catkin_ws/src
ROS path [2]=C:\opt\ros\melodic\x64\share
ERROR: cannot launch node of type [cartographer_ros/cartographer_occupancy_grid_node]: cartographer_ros
ROS path [0]=C:\opt\ros\melodic\x64\share\ros
ROS path [1]=C:/catkin_ws/src
ROS path [2]=C:\opt\ros\melodic\x64\share
process[flat_world_imu_node-9]: started with pid [102356]
process[rviz-10]: started with pid [71272]
process[turtlebot3_drive-11]: started with pid [87908]
[ INFO] [1585330666.913992100]: TurtleBot3 Simulation Node Init
[ INFO] [1585330666.919415400]: robot_model : WAFFLE
[ INFO] [1585330666.919582500]: turning_radius_ : 0.000000
[ INFO] [1585330666.919971700]: front_distance_limit_ = 0.000000
[ INFO] [1585330666.920419800]: side_distance_limit_ = 0.000000
Traceback (most recent call last):
  File "C:\opt\ros\melodic\x64\lib\gazebo_ros\spawn_model", line 34, in <module>
    from tf.transformations import quaternion_from_euler
  File "C:\opt\ros\melodic\x64\lib\site-packages\tf\__init__.py", line 31, in <module>
    from .listener import Transformer, TransformListener, TransformerROS
  File "C:\opt\ros\melodic\x64\lib\site-packages\tf\listener.py", line 33, in <module>
    import sensor_msgs.msg
ImportError: No module named msg
[ INFO] [1585330667.224164000]: Finished loading Gazebo ROS API Plugin.
[ INFO] [1585330667.225161200]: Finished loading Gazebo ROS API Plugin.
[ INFO] [1585330667.227411600]: waitForService: Service [/gazebo/set_physics_properties] has not been advertised, waiting...
[ INFO] [1585330667.227150500]: waitForService: Service [/gazebo_gui/set_physics_properties] has not been advertised, waiting...
[spawn_urdf-4] process has died [pid 116112, exit code 1, cmd python C:\opt\ros\melodic\x64\lib\gazebo_ros\spawn_model -urdf -model turtlebot3_WAFFLE -x -2.0 -y -0.5 -z 0.0 -param robot_description __name:=spawn_urdf __log:=C:\Users\cdobrin1\.ros\log\a98ddd0f-7051-11ea-99a0-00216afa3394\spawn_urdf-4.log].
log file: C:\Users\cdobrin1\.ros\log\a98ddd0f-7051-11ea-99a0-00216afa3394\spawn_urdf-4*.log
[ INFO] [1585330669.417506800, 0.083000000]: waitForService: Service [/gazebo/set_physics_properties] is now available.
[ INFO] [1585330669.662622600, 0.324000000]: Physics dynamic reconfigure ready.
[ERROR] [1585330669.707273700, 0.368000000]: PluginlibFactory: The plugin for class 'Submaps' failed to load.  Error: According to the loaded plugin descriptions the class Submaps with base class type rviz::Display does not exist. Declared types are  rtabmap_ros/Info rtabmap_ros/MapCloud rtabmap_ros/MapGraph rviz/Axes rviz/Camera rviz/DepthCloud rviz/Effort rviz/FluidPressure rviz/Grid rviz/GridCells rviz/Illuminance rviz/Image rviz/InteractiveMarkers rviz/LaserScan rviz/Map rviz/Marker rviz/MarkerArray rviz/Odometry rviz/Path rviz/PointCloud rviz/PointCloud2 rviz/PointStamped rviz/Polygon rviz/Pose rviz/PoseArray rviz/PoseWithCovariance rviz/Range rviz/RelativeHumidity rviz/RobotModel rviz/TF rviz/Temperature rviz/WrenchStamped rviz_imu_plugin/Imu rviz_plugin_tutorials/Imu
[ WARN] [1585330674.470789100, 5.081000000]: Timed out waiting for transform from base_footprint to map to become available before running costmap, tf error: canTransform: target_frame map does not exist.. canTransform returned after 0.1 timeout was 0.1.

The turtlebot world appears in Gazebo, but there is no robot traveling through it like there is supposed to be. I believe I am having the same problem as the others on this issue.

This one looks fishy to me. Can you try choco upgrade ros-melodic-desktop_full -y --pre to the latest daily build and see if this problem goes away?
Recently there are some Python3 migration movement which might break some Python packages, and the fix is merged here.
Traceback (most recent call last):
  File "C:\opt\ros\melodic\x64\lib\gazebo_ros\spawn_model", line 34, in <module>
    from tf.transformations import quaternion_from_euler
  File "C:\opt\ros\melodic\x64\lib\site-packages\tf\__init__.py", line 31, in <module>
    from .listener import Transformer, TransformListener, TransformerROS
  File "C:\opt\ros\melodic\x64\lib\site-packages\tf\listener.py", line 33, in <module>
    import sensor_msgs.msg
ImportError: No module named msg


Correct the spacing in the rich rule lwrp

Currently the port_protocol field collides with the log field. This PR adds a space in between.

Fixed with PR #18


Modernize repo

Alaska Airlines Pull Request
Please include a summary of the change and which issue is fixed. Please also include relevant motivation and context. List any dependencies that are required for this change.
Fixes: #47, #50, #51
Summary:
Please summarize the scope of the changes you have submitted, what the intent of the work is and anything that describes the before/after state of the project.

Implement theming support by using new Auro tokens
Modernize repo with new version of generator
Update repo for SSR support

Type of change:
Please delete options that are not relevant.

[x] New capability
[x] Revision of an existing capability
[ ] Infrastructure change (automation, etc.)
[ ] Other (please elaborate)

Checklist:

[x] My update follows the CONTRIBUTING guidelines of this project
[x] I have performed a self-review of my own update

By submitting this Pull Request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
Pull Requests will be evaluated by their quality of update and whether it is consistent with the goals and values of this project. Any submission is to be considered a conversation between the submitter and the maintainers of this project and may require changes to your submission.
Thank you for your submission!
-- Auro Design System Team

:tada: This PR is included in version 2.0.0 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release

Your semantic-release bot :package::rocket:


Add Download link to japanese navigation menu

Add Download link to japanese navigation menu and modify and fix some navigation links to Japanese pages.

80a6b23e0025f5b2676e943baba9fe2aaa36182e tested LGTM.  Thanks!
@azuchi while you're editing this file, did you want to provide translations for all the top-level menu items?  That appears to be what was done for other transactions, e.g. Simplified Chinese:

@harding thanks for the review! Following the advice, I translated the menu item to japanese.


[Cherry-pick] Ignore optimizer when using UC

PR types

Bug fixes
PR changes

APIs
Description

Cherry-pick #8058

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.gongel seems not to be a GitHub user. You need a GitHub account to be able to sign the CLA. If you have already a GitHub account, please add the email address used for this commit to your account.You have signed the CLA already but the status is still pending? Let us recheck it.


Add support for Spark 2.3.0

After finally getting a response to https://github.com/datastax/spark-cassandra-connector/pull/1170 confirming that it's fine to lose Scala 2.10 support, here it is...
In Spark, this commit apache/spark@425c4ad removes Scala 2.10 support. One of the things removed is the workarounds using ScalaReflectionLock, which causes a java.lang.NoClassDefFoundError when using the connector.
This pull request potentially resolves https://datastax-oss.atlassian.net/projects/SPARKC/issues/SPARKC-530.

👍 nice work!

+1

test this please

+1

I'll need to put a check in travis to stop doing 2.10 checks

Build against Scala 2.10 finished with failure

Build against Scala 2.11 finished with failure

@nikolovivan There are some compilation errors in the data source scan spec, probably because it uses some Spark internals (or at least internalish) code to check query plan builds. Do you want to take a crack at fixing it or want me to rewire that? Once the compilation is fixed I think it may hit SPARKC-537 which I think is due to how 2.2+ spark changed IsNotNull predicates

I think with the mods made the 2.10 build is just going to do the 2.11 build ... so we'll all just remember that it's the same on this ticket, and I"ll put a version gate after we tag and branch.

I updated the code. Any chance we could try the Jenkins build again?
PS. I'm having some issues triggering the integration tests locally. I think it has to do with ports being closed on my local machine, but I could try getting a different machine if things don't work out and we end up having to go back and forth.

test this please

Local runs are probably failing because of this https://issues.apache.org/jira/browse/CASSANDRA-14173 if your java is up to date

Build against Scala 2.11 finished with failure

Build against Scala 2.10 finished with failure

Error Message
org.apache.spark.SparkException: Job aborted due to stage failure: Task 0 in stage 5.0 failed 1 times, most recent failure: Lost task 0.0 in stage 5.0 (TID 14, localhost, executor driver): java.lang.NoSuchMethodError: net.jpountz.lz4.LZ4BlockInputStream.<init>(Ljava/io/InputStream;Z)V  at org.apache.spark.io.LZ4CompressionCodec.compressedInputStream(CompressionCodec.scala:122)  at

I'll get a integration test fix in so it's easier to pick this stuff up locally

https://github.com/datastax/spark-cassandra-connector/pull/1176
I'm gonna let integration tests run on this branch then merge forward to master, then that should be good to rebase on for local testing.

Looks like a dependency issue. I'll try and set up a different environment in a container where I can have a bit more control and run those integration tests.
Let me know when/if I can help. Keen to get this over the line.

I managed to run the intergration tests on a Docker container which was pretty nice. Happy to provide it if needed.
There are quite a few commits here, but not much has changed - I've updated some versions to be in line with what Spark 2.3.0 uses and I've added an exclusion in test that fixes the class not found error.
The issue now is that 6 of those tests fail for me (actually 4, but 1 pair is ran twice with different input parameters). Another pair has to do with the hints for wrong CF or KS names not coming back as expected for some reason, even though my changes shouldn't have affected this.
There is a possibility that it is due to me not setting up the container image exactly the same way as the build server, so maybe worth trying the Jenkins build again. One of the failures looks like it could be related to SPARKC-537 mentioned above.

I'm almost done with my own mods to bring everything up to 3.11 and 2.2, once I get that in we should be ok on local and jenkins builds.

@nikolovivan the name mismatch thing is because apache commons changed their underlying algorithm for JaroWinkler, the spark upgrade updates commons so now the threshold needs recalibrating.
I'm working on other test failures as well for 2.2 so hopefully once fixed on 2.2 they'll all pass on your branch

@RussellSpitzer, thanks for the update. I was looking into the failures yesterday:

for JaroWinkler I was printing the distances and saw that the threshold needs to go down to maybe 0.6 in order to get the tests to pass again. I'll recalibrate it by going down the least possible amount to get the tests to pass. I guess it's safe enough.
one of the tests seems to fail because an additional configuration might be needed to get the logical plan to get propagated - spark.sql.constraintPropagation.enabled. Should be OK to get it to work.
the last one might get fixed by your changes.

I will wait for your work to be done and then merge in into this branch and then bring it to green.

@nikolovivan have you looked over https://github.com/datastax/spark-cassandra-connector/pull/1176
Our 2.10 jenkins build seems to be broken but I did similar fixes to what you did to get the JW fixing, i actually did both lowercasing and lowering the threshold.
I haven't seen the test that is failing because of constraint propagation? But basically i have a clean run on 2.2 now and I also switched C* to 3.11 and logging to logback. I'll have the tests run on your current branch since I don't know what other fixes might be needed.

test this please

@RussellSpitzer Just saw your PR. I didn't have to lower the threshold for JW. Just lowercasing made my test pass. Maybe we should leave it like this and keep it 0.85?
Hopefully your test will fix the pushdown filter.
The constraint propagation is in CassandraDataSourceSpec - it should "pass through local conf properties". Seems like qp.constraints should not be empty doesn't hold for me. I looked in the Spark code and it checks if spark.sql.constraintPropagation.enabled. So hopefully this will be just about setting this config in test. Tried quickly, but didn't manage, so I might be missing something simple.

@nikolovivan that's fine with me, for some reason the naming tests still fails for me but only on jenkins. Not in travis, and not locally.
Lets replace the "local conf test" I have another version I'm working on that doesn't so strictly depend on Spark internals.
 it should "pass through local conf properties" in {

    sc.setLocalProperty(
      CassandraSourceRelation.AdditionalCassandraPushDownRulesParam.name,
      "com.datastax.spark.connector.sql.PushdownUsesConf")

    val df = sparkSession
      .read
      .format("org.apache.spark.sql.cassandra")
      .options(Map("keyspace" -> ks, "table" -> "test1", PushdownUsesConf.testKey -> "Don't Remove"))
      .load().filter("g=1 and h=1")

    df.queryExecution.executedPlan // Will throw an exception if local key is not set

    val df2 = sparkSession
      .read
      .format("org.apache.spark.sql.cassandra")
      .options(Map("keyspace" -> ks, "table" -> "test1"))
      .load().filter("g=1 and h=1")

    intercept[IllegalAccessException] {
      df2.explain() //
    }

/**
  * Throws an exception if test key is not set
  */
object PushdownUsesConf extends CassandraPredicateRules {
  val testKey = "testkey"
  val notSet = "notset"
  override def apply(
                      predicates: AnalyzedPredicates,
                      tableDef: TableDef,
                      conf: SparkConf): AnalyzedPredicates = {
    if (conf.contains(testKey)){
      predicates
    } else {
      throw new IllegalAccessException(s"Conf did not contain $testKey")
    }
  }
}

I may just skip my pr since you are fixing all these things on master anyway

@RussellSpitzer, I took your changes to CassandraDataSourceSpec and it's now all green locally.

test this please

If jenkins complains, i'll turn off the parallel build framework since that's the only difference between Jenkins and travis

Jenkins approves!!
Ok, I think we just need to clean up our commits a bit here and we should be good to go. Maybe we rebase this into,
Remove scala2.10 commit
Spark 2.3 Upgrade and Test Fixes commit
Then merge this
Unless you have another structure?

Sounds good to me. I'll do it now.

Looks clean!

Build against Scala 2.11 finished with success

Build against Scala 2.10 finished with success


Undefined bindings and sql errors cause streams to hang

Environment
Knex version: 0.14.6
Database + version: Postgres 10.3
OS: OS X
Bug
When using .stream() and you set undefined bindings, stream doesn't emit error but instead hangs forever. As a short example, this is enough to reproduce the bug:
// Also seems to be happening when there's an SQL syntax error.
knex.raw('SELECT * FROM table WHERE id = :id', { id: undefined })
      .stream()
      .on('data', data => {
          console.log('data', data)
      })
      .on('finish', () => {
        resolve();
      })
      .on('error', (error) => {
        reject(error)
      })

I'm expecting to see the stream finished but nothing happens. No error message is logged. This seems to be similar to: https://github.com/tgriesser/knex/issues/2562. I also took that reproducable code base as the basis for this bug.
Reproducing
Here's a repo how to reproduce it: https://github.com/kimmobrunfeldt/knex-stream-hang-repro
I tried to save it into npm.runkit.com: https://runkit.com/kimmobrunfeldt/knex-stream-hang but for some reason it's saying "knex module not found"

I just tested this with the latest master. Invalid SQL syntax errors are correctly propagated in master but undefined bindings are not

I accidentally had 0.14.6 tag checked out locally and found the error after a long debug session. Turns out it was already fixed in master :) Now the .toSQL() call and other building is wrapped in to try catch here: https://github.com/tgriesser/knex/blob/ec8550249fb813321c2ec7b2cbb4988321aa8d76/src/runner.js#L87
Nice job, thanks!


how to disable changing the date in JFXDatePicker and the time in JFXTimePicker

Hi,
How do I remove the ability of the user in messing with the date in JFXDatePicker?
I only want to show the user the date calendar like in windows 10 but don't want him/her to change the date.
JFXDatePicker datePickerFX = new JFXDatePicker();
datePickerFX.setValue(earthClock.getLocalDate());
datePickerFX.setEditable(false);

As you can see, I've tried using setEditable() to stop the tampering but it doesn't work.
Also the same with JFXTimePicker. I want no one to tamper with the time.
Note : I have an EarthClock instance and call earthClock.getLocalDate() to update the date in datePickerFX programmatically if needed.
Thanks much for this excellent library !
-mokun

Hello,
I tested setEditable using the latest JFoenix and it seems to work just fine (there is some minor css glitch though). can you re-validate the issue using JFoenix 1.10.0
Regards,


Send local notification when certificate expires on macOS

Prompt 5 days before expiration of the certificate. Refresh with token. If that fails, direct user to same institution and profile to connect again.

Currently not possible as the expiration date isn't available to the app.

@jornane Do you think you can expose this information to the Mac client somehow?


Remove dependency on vendor bundles (BC) and composer

Scenario:

One (or more) vendor bundles (e.g. SensioLabs) have been depreciated
One (or more) vendors do not maintain backward compliancy (BC)
The deployment workflow (Ansible) breaks

Requirements:

The deployment workflow (Ansible) shall not need (no  longer use) Composer

The developer shall use Composer for updating vendor bundles

The application shall include all vendor bundles in one repository:

building the application is basically a copy function
the whole app including vendors is always tested together
vendor BC is no longer important (depreciation cannot break deployment)

Dependency: Issue https://github.com/TIXI24/sfitixi/issues/132, priority can be lowered as soon as this issue is solved.

This has been fixed in commit https://github.com/TIXI24/sfitixi/commit/da392eed5436193ff1dd76cd8ef1ac9c6b9c0cf2.
PLEASE NOTE:

Knp-Snappy bundle (dev-master version) ceased to be compatible with the TIXI24 bundle config and broke the install & update workflows.
This has been fixed by changing the bundles version to 1.4. This (trial and error) cost me three @$*%# days.
BEWARE: changing composer.json MUST ALSO INCLUDE changing composer.lock (do this in OSX), BOTH CHANGES need to be propagated to the git repository

The requirement "The deployment workflow (Ansible) shall not need (no longer use) Composer" is not deemed feasible. The Symfony project piggybacks scripts in composer.json for configuring the system. It is not clear what these scripts really do (bad documentation). Looking at future releases this situation (separation of concerns) is only getting worse, not better.
So us poor adopters just need to keep up with Fabien and the Composer team.


Only fetch serving runtime templates with dashboard label

JIRA: https://issues.redhat.com/browse/RHOAIENG-12799
Description

Added back the label selector for 'opendatahub.io/dashboard': 'true' when fetching the templates.
How Has This Been Tested?

Go to the serving runtimes page in the settings
Duplicate a serving runtime template
Go to the OpenShift console and find that template
Remove the label 'opendatahub.io/dashboard': 'true' from the template
Refresh the serving runtimes page in the dashboard
Make sure the template without the label is not listed

Test Impact

There is no way to test the WebSocket watch API, the only way is to make sure the hook has been called with the selector option, so I updated that.
Request review criteria:

Self checklist (all need to be checked):

[x] The developer has manually tested the changes and verified that the changes work
[x] Testing instructions have been added in the PR body (for PRs involving changes that are not immediately obvious).
[x] The developer has added tests or explained why testing cannot be added (unit or cypress tests for related changes)

If you have UI changes:

[ ] Included any necessary screenshots or gifs if it was a UI change.
[ ] Included tags to the UX team if it was a UI/UX change.

After the PR is posted & before it merges:

[ ] The developer has tested their solution on a cluster by using the image produced by the PR to main

/lgtm
testing in the cluster, removing the label 'opendatahub.io/dashboard': 'true' from the  template, the template is not listed in the serving runtimes page


twitter.trends.place(_id = 23424975) is timing out

I am using python  2.7.6 version and the call to get the trends  twitter.trends.place(_id = 23424975) is timing out.

Tested and this is now working - likely to be a transient issue. Closing.


onMembersAdded send welcome message to channel instead of new member

Versions
"botbuilder": "~4.8.0",
Describe the bug
When adding a new member to a channel (which installed bot). The sendActivity sends a message to the channel instead of the new member.
this.onMembersAdded(async (context, next) => {
            const membersAdded = context.activity.membersAdded;
            for (let cnt = 0; cnt < membersAdded.length; cnt++) {
                if (membersAdded[cnt].id !== context.activity.recipient.id) {
                    await context.sendActivity("Hello and Welcome");
                }
            }
            await next();
        });

To Reproduce
Steps to reproduce the behavior:

Install a bot to a channel
Add new member to the channel
call context.sendActivity("Hello and Welcome");
message sent to channel

Expected behavior
message sent to new member
Screenshots
If applicable, add screenshots to help explain your problem.
Additional context
Add any other context about the problem here.
[bug]

Nevermind. I found the solution, something like this
this.onMembersAdded(async (context, next) => {
            const membersAdded = context.activity.membersAdded;
            let conversationType = context.activity.conversation.conversationType;
            for (let cnt = 0; cnt < membersAdded.length; cnt++) {
                if (membersAdded[cnt].id !== context.activity.recipient.id) {
                    if (conversationType === 'personal') {
                        //member is added to personal channel
                        await context.sendActivity(language.welcome_in_person);
                    }
                } else if (conversationType !== 'personal') {
                    //bot is added to channel, send welcome to channel
                    await context.sendActivity(language.welcome_in_channel);
                }
            }
            await next();
        });```


how do townload

how do townload

You go on the website and click download, or clone the repo and build from source.

Thanks for opening this issue! However, I'm closing this because it is not a technical issue for the Lapce project. A better place for discussions and questions is our Discord chat. Feel free to hop by!


Made Tests for Models

Testing
Created Unit Tests for Models using Rspec and Capybara
Issues

close #23

@carlosmuerto, I have already applied the required changes.


Make Layer a Node, add LayerGroup class #2

Description
Taking over and bringing up to date the efforts of @tlambert03 in #4018.

Type of change

[ ] Bug-fix (non-breaking change which fixes an issue)
[x] New feature (non-breaking change which adds functionality)
[x] Breaking change (fix or feature that would cause existing functionality to not work as expected)
[x] This change requires a documentation update

References

How has this been tested?

[ ] example: the test suite for my feature covers cases x, y, and z
[ ] example: all tests pass with my change
[ ] example: I check if my changes works with both PySide and PyQt backends
as there are small differences between the two Qt bindings.

Final checklist:

[ ] My PR is the minimum possible work for the desired functionality
[ ] I have commented my code, particularly in hard-to-understand areas
[ ] I have made corresponding changes to the documentation
[ ] I have added tests that prove my fix is effective or that my feature works
[ ] If I included new strings, I have used trans. to make them localizable.
For more information see our translations guide.

@brisvag looks like we dropped this yet again. It's a complex issue! 😅 Do you think you'll want to update this PR or should we close it and start a third attempt? 😭

Hi there, so I gave this a check by running the examples/layer_groups.py script and I encountered the following errors:

AttributeError: 'Node' object has no attribute 'set_gl_state' (at napari\napari\_vispy\layers\base.py", line 157, in _on_blending_change):

Not totally sure but maybe is due to the node represeting the root of the layer group not having that method/attribute? To overcome the error I did the following at https://github.com/brisvag/napari/blob/9deed9fdade52ecb5155eb69873743eab2d3873c/napari/_vispy/layers/base.py#L157
       if hasattr(self.node, "set_gl_state"):
            self.node.set_gl_state(**blending_kwargs)

KeyError: <Points layer 'points' at 0x1ef2beb1b70> (at napari\napari\_vispy\canvas.py", line 591, in reorder_children):

After applying the previous change I encountered this other error. I think is related with some missing logic to handle adding the child layers of a layer group at the add_layer_visual_mapping so I tried adding there some logic to handle the layer group case (so iterating the layer and mapping the child layers), leaving the method to look like:
    def add_layer_visual_mapping(self, napari_layer, vispy_layer) -> None:
        """Maps a napari layer to its corresponding vispy layer and sets the parent scene of the vispy layer.

        Paremeters
        ----------
        napari_layer : napari.layers
            Any napari layer, the layer type is the same as the vispy layer.
        vispy_layer : napari._vispy.layers
            Any vispy layer, the layer type is the same as the napari layer.

        Returns
        -------
        None
        """

        vispy_layer.node.parent = self.view.scene
        self.layer_to_visual[napari_layer] = vispy_layer

        if napari_layer.is_group():
            for child in napari_layer:
                self.layer_to_visual[child] = vispy_layer
                child.events.visible.connect(self._reorder_layers)

        napari_layer.events.visible.connect(self._reorder_layers)

        self._reorder_layers()

Messages like WARNING: Cannot open file '.../napari/theme_{{ name }}:/caret-right.svg':

After doing the above, I was able to launch napari from the examples script and noticed some warnings related with QSS rules. Checking the 01_buttons.qss and  03_treeview.qss files, I think the warnings came from the rules regarding icons URLs that need to use the template variable id instead of name. So the rules should look something like:
QtViewerPushButton[mode="new_group"] {
  image: url("theme_{{ id }}:/folder.svg");
}

QTreeView::branch:closed:has-children {
  image: url("theme_{{ id }}:/caret-right.svg");
  image: url("theme_{{ id }}:/delete.svg");
  padding: 6px;
}

Other warnings/keybinding warnings:

I also saw some other warnings related to keybindings but resetting napari (napari --reset) make those disappear.
With all the changes above I was able to launch napari and saw the following:

Seems like there is still some work to do but could it be worthy to include the described changes or some variation of them here (not totally sure if they actually are the appropriate way to do things to be honest 😅 ) ? Also, should this be updated fixing the conflicts with the latest main before even thinking on doing/applying any further changes 🤔?

FWIW I can reproduce the steps listed by @dalthviz locally - thanks for explaining it so well. I'll keep playing with it next week!

Awesome work y'all :) I don't really have bandwidth to work actively on this now, so feel free to open another PR with your changes to supersede this one!

Also, should this be updated fixing the conflicts with the latest main before even thinking on doing/applying any further changes 🤔?

...feel free to open another PR with your changes to supersede this one!

I can have a go at

merging main
apply @dalthviz suggested changes
thinking about next steps
as an experiment in the next few hours, to see how easy this would be.

Stop me if this is silly :laughing: I'll report back here otherwise :slightly_smiling_face:

Initial report:
Naive merging got us some of the way (https://github.com/napari/napari/pull/6610) but running
python examples/layer_group.py

now locally gives me
Traceback (most recent call last):
  File "/home/alessandro/dev/napari/examples/layer_group.py", line 16, in <module>
    viewer = napari.Viewer(ndisplay=3)
  File "/home/alessandro/dev/napari/napari/viewer.py", line 52, in __init__
    super().__init__(
  File "/home/alessandro/dev/napari/napari/components/viewer_model.py", line 225, in __init__
    super().__init__(
  File "/home/alessandro/dev/napari/napari/utils/key_bindings.py", line 311, in __init__
    super().__init__(*args, **kwargs)
  File "/home/alessandro/dev/napari/napari/utils/mouse_bindings.py", line 25, in __init__
    super().__init__(*args, **kwargs)
  File "/home/alessandro/dev/napari/napari/utils/events/evented_model.py", line 255, in __init__
    super().__init__(**kwargs)
  File "pydantic/main.py", line 339, in pydantic.main.BaseModel.__init__
  File "pydantic/main.py", line 1064, in pydantic.main.validate_model
  File "pydantic/fields.py", line 437, in pydantic.fields.ModelField.get_default
  File "/home/alessandro/dev/napari/napari/layers/base/base.py", line 113, in __call__
    obj = super().__call__(*args, **kwargs)
  File "/home/alessandro/dev/napari/napari/layers/layergroup/layergroup.py", line 25, in __init__
    Layer.__init__(self, None, self._get_ndim(), name=name)
  File "/home/alessandro/dev/napari/napari/layers/base/base.py", line 381, in __init__
    self._transforms: TransformChain[Affine] = TransformChain(
  File "/home/alessandro/dev/napari/napari/utils/transforms/transforms.py", line 128, in __init__
    super().__init__(
  File "/home/alessandro/dev/napari/napari/utils/events/containers/_evented_list.py", line 121, in __init__
    super().__init__(data, basetype=basetype, lookup=lookup)
  File "/home/alessandro/dev/napari/napari/utils/events/containers/_typed.py", line 66, in __init__
    self.extend(data)
  File "/home/alessandro/mambaforge/envs/napari/lib/python3.10/_collections_abc.py", line 1149, in extend
    self.append(v)
  File "/home/alessandro/mambaforge/envs/napari/lib/python3.10/_collections_abc.py", line 1128, in append
    self.insert(len(self), value)
  File "/home/alessandro/dev/napari/napari/utils/events/containers/_evented_list.py", line 207, in insert
    self._process_inserted_item(self[index])
  File "/home/alessandro/dev/napari/napari/utils/transforms/transforms.py", line 160, in __getitem__
    if f"getitem_{key}" not in self._cache_dict:
AttributeError: 'TransformChain' object has no attribute '_cache_dict'

While the _cache_dict attribute has been added to main recently, I don't see at first glance how it's possible for a TransformChain not to have that attribute, as it calls the Transform constructor in its constructor, and self._cache_dict get initialised there :thinking: I'll keep thinking but if anyone sees any obvious pointers for me, let me know :slightly_smiling_face:

Sometimes this happens due to wrongly merged changes to resolution order; in the init it might be doing something that accesses that attribute before it's initialized.

Thanks @brisvag - yes, agreed - looks like in the super class of TransformChain, EventedModel, the __init__ has a call to get_item which seems to happen too early.
I'll have another think with a fresher mind later this week - if anyone wants to do the same experiment, ideally in a better way :sweat_smile: or progress this otherwise, go ahead :rocket:

Not totally sure but could that mean then that Transform.__init__(self) should be called before super at https://github.com/napari/napari/blob/d4d5d2dd523ee9aa4b7ac0fe414069983905dc75/napari/utils/transforms/transforms.py#L122-L136
?

Thanks @dalthviz - I've tried that and it does seem to fix the issue, although I have no idea whether that broke something else, especially as the comment says the word "above" 🤔
There seem to be a few more issues that I've hackily tried fixing in #6610 (will continue to try) - I got it into a state where at least a napari viewer with a LayerGroup appears but there's still a few bugs.
I replaced lots of calls to layer.is_group with is_instance(layer, LayerGroup) but I am confused whether that's the right thing to do: I think it would be helpful to understand the intended relationship between https://github.com/alessandrofelder/napari/blob/layergroups3/napari/utils/tree/group.py, https://github.com/alessandrofelder/napari/blob/layergroups3/napari/utils/tree/node.py and Layer, LayerGroup?


Label Currency Format

I have tried, format a LABEL text like a currency, but It is not working
Here is my JS View
new sap.m.Label({
text: "{MyModel>TOTAL_1}",
type: "sap.ui.model.type.Currency",
formatOptions: {
minIntegerDigits: 3
}
}),
Thank you
Natasha M

You have to define the type and its options as part of the binding for property 'text'. You tried to define them as separate properties of the sap.m.Label.
Please check https://openui5nightly.hana.ondemand.com/#/entity/sap.ui.model.type.Currency for code samples.

Also you are binding your text wrong. It should be look like this:
text: "{MyModel>/TOTAL_1}",

new sap.m.Label({
text: "{MyModel>/TOTAL_1}",
type: "sap.ui.model.type.Currency",
formatOptions: {
minIntegerDigits: 3
}
});

I am closing this issue as the functionality is working correctly. Feel free to open a new thread linking this issue, if you want to continue the discussion


Temporarily downgrade Podman on GitHub to fix CI failures for Podman tests

What type of PR is this:
/kind bug
/area testing
/area infra
/area odo-on-podman
What does this PR do / why we need it:
As reported in https://github.com/redhat-developer/odo/issues/6927, the tests on Podman have been consistently failing since a few days, due to an error: Error: k8s.gcr.io/pause:3.5: image not known
A regression in libpod has been identified in Ubuntu 22.04.1 LTS and reported [1][2]. Though not strictly the same error as the one we observed, I think this regression might affect networking.
As suggested in [3], I'm trying to downgrade Podman to see if it helps. 🤞🏿
[1] https://github.com/actions/runner-images/issues/7753
[2] https://bugs.launchpad.net/ubuntu/+source/libpod/+bug/2024394
[2] https://github.com/actions/runner-images/issues/7753#issuecomment-1600764394
EDIT: the Podman tests are now passing with the changes here. Let's merge this as it is. I'm still keeping an eye out on [1] and will revert the changes here once it is fixed and made available in the runner images.
Which issue(s) this PR fixes:
Fixes #6927
PR acceptance criteria:

[ ] Unit test

[ ] Integration test

[ ] Documentation

How to test changes / Special notes to the reviewer:

/override Kubernetes-Integration-Tests/Kubernetes-Docs-Integration-Tests
Unrelated.

thanks @rm3l for this fix


Add transfer of MultiSigWallet ownership in deploy script

Pull Request Test Coverage Report for Build 7859

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 100.0%

Totals

Change from base Build 7848:
0.0%

Covered Lines:
1355

Relevant Lines:
1355

💛  - Coveralls


docker: podman-friendly image locations

Adds fully qualified canonical locations of container images, making the container technology setup podman-friendly.
Closes reanahub/reana#729.

Codecov Report

Merging #241 (f2c72ee) into master (824abdf) will not change coverage.
The diff coverage is n/a.

:exclamation: Your organization is not using the GitHub App Integration. As a result you may experience degraded service beginning May 15th. Please install the Github App Integration for your organization. Read more.
Additional details and impacted files

@@          Coverage Diff           @@
##           master    #241   +/-   ##
======================================
  Coverage    1.26%   1.26%
======================================
  Files          10      10
  Lines         555     555
======================================
  Hits            7       7
  Misses        548     548


Silent install failure on windows 32-bit python

I've had a number of confusing errors and issues trying to get this to work properly, and finally realized the problem upon reading this comment on #250, which is that I had mistakenly installed a 32-bit version of Python 3.7. After switching to a 64-bit interpreter, installation worked on the first attempt.
If 32-bit is not supported, an error message saying so would be very helpful.

ah I still have it listed on the readme as compatible, I will update that and look into adding an error message. thanks -Andrew

I re-read this and there is no technical reason that spiceypy cannot support 32 bit installs, indeed getspice.py still downloads 32 bit cspice for windows. However getting windows builds working is very tedious, so I provide windows users the prebuilt wheels or conda-forge spiceypy distribution.
It sounds like the issue was that the errors raised during setup were not noticed or there is something wrong with the code currently, I think we have plenty of checks in the code but if you could re-run the install and send me a copy of the logs then it could be helpful to see why it was not clearly warned.


Implement i32 ops through masking

This PR resolves https://github.com/near/wasmtime/issues/106 by implementing 32-bit operations as a 64-bit operation + "AND (2^32-1)" on the result.
This makes most of the implementations easier as we no longer need to divide by 2^32 before doing the operation and this is reflected by the smaller number of cycles.
The i32.rotl is broken now due to the excessive register use which leads to using register CTX that can't hold 64-bit values. I will look into fixing this as a next step, but really we just need one more register in ZKASM machine.
UPD: Rotl is fixed in https://github.com/near/wasmtime/pull/153
Some operations became more expensive:

add, sub by 2 cycles due to the need for AND
32 bit signed comparisons by 8 cycles due to the need for sign extension

The performance on Fibonacci improved for handwritten version by 20k cycles but became worse for rust version by 2k cycles - need to investigate why.
The size of SHA256 benchmark decreased by a whopping 33k lines.

I have rebased these changes on the latest main branch. PTAL @MCJOHN974 , @mooori


Search is under header overlay

Search component should be overlaying everything on the page

Hey, I would like to work on this issue.


Authentication provider support

The library requires a way to authenticate remote stores.

/cc @shizhMSFT @deitch

/cc @northtyphoon @juliusl

Closing as auth provider support is already there.


Cannot get theme to work via jekyll-remote-theme.

I have a local site that is using minima v3 via something like this in my Gemfile:
gem "minima", :github => 'jekyll/minima'

This works fine but I'm struggling to get it working with github pages.
I read elsewhere that jekyll-remote-theme is the official way to do this. So I removed the line above and added this to my Gemfile:
# If you have any plugins, put them here!
group :jekyll_plugins do
  gem "jekyll-remote-theme"
end

and this to my _config.yml file:
# Build settings
plugins:
  - jekyll-remote-theme

# set up remote_theme
remote_theme: jekyll/minima

When running bundle exec jekyll build I get a timeout though:
/Users/didier/.rbenv/versions/3.2.1/lib/ruby/gems/3.2.0/gems/jekyll-remote-theme-0.4.3/lib/jekyll-remote-theme/downloader.rb:53:in `rescue in download': Failed to open TCP connection to [codeload.github.com:443](http://codeload.github.com:443/) (execution expired) (Jekyll::RemoteTheme::DownloadError)

Am I missing something obvious?

I was missing something obvious... some old little snitch rule on my machine filtering the network 🤦


⚠ ClamAV has degraded performance

In e13bfd2, ClamAV (https://spamassassin.apache.org/) experienced degraded performance:

HTTP code: 200
Response time: 232 ms

Resolved: ClamAV performance has improved in 62a2d95 after 15 minutes.


option to see a transaction duration, as with an http request

Hi @sjvans ,
We have a lot of simultaneous transactions and would like to be able to quickly track how long they have been active. Is there a setting for this? At the moment they are all listed individually.

Similar to an HTTP request;

We use the CLS, CAP 7.9.5 and telemetry 1.0.1

hi @qby-ankul
there is no direct link between spans and transactions. per top level span (typically the incoming http request), there can be multiple transactions (cf. odata's $batch), and there is no attribute or the like to mark the individual spans.
best,
sebastian


[BUG] Application crash after sending Lumens

Priority
Normal
Observed Behaviour
The application crashed after successfully sending (transaction was submitted to the Stellar network) Lumens to a recipient address.
Expected Behaviour
After sending Lumens, the application should navigate back to the main wallet interface, with a new row in the transaction log reflecting the amount sent.
Reproduction Steps

Navigate to “send”
Scan QR code
Enter Lumen amount
Hit “send”
Wait for activity indicator
Observe crash occurs

Fixed


typo fixed

documents validation https://github.com/secretflow/secretflow/issues/640

I have read the CLA Document and I hereby sign the CLA


Add Regular Expressions for Python

There is a regex cheatsheet for R but not for python, so maybe this one or this one would be appropriate.
Thank you for an amazing resource, by the way

Would you care to add the PR with this please?

I've created a pull request with the Dataquest Python REGEX cheatsheet.


Customize auth page

Issue type
Styling css of login page
I'm submitting a ...  (check one with "x")

[x] bug report
[ ] feature request
[ ] question about the decisions made in the repository

Issue description
Current behavior:
I was able to remove arrow icon from left top corner by adding below in css file
/deep/ .nb-theme-cosmic nb-card-header { display: none !important; }
Expected behavior:
I want to remove the nb-card thing which is in login.template.html which is part of node modules so that it looks like below:

Steps to reproduce:

Related code:

insert short code snippets here

Other information:
npm, node, OS, Browser
<!--
Node, npm: `node --version` and `npm --version`
OS: Windows (7/8/10). Linux (incl. distribution). macOS (El Capitan? Sierra?)
Browser: Chrome/Safari/Firefox/etc?
-->

Angular, Nebular
<!--
Check your `package-lock.json` or locate a `package.json` in the `node_modules` folder.
-->

Start here -> https://akveo.github.io/nebular/docs/auth/custom-auth-components#custom-auth-components

@Prefix1802 I don't want the card which is coming outside the login component. How can i remove that ?

You can find it in nebular https://github.com/akveo/nebular/blob/master/src/framework/auth/components/auth.component.ts which is somewhere in node_modules:
@Component({   selector: 'nb-auth',   styleUrls: ['./auth.component.scss'],   template:

 <----- My guess is you are looking for this one

<a href="#" (click)="back()" class="link back-link" aria-label="Back">

, })

@Prefix1802 But this file is not editable so how can i override that card css in my component ?

The file should be writeable, what error do you get when making changes and saving the file?

@Prefix1802 If I am making the changes in that file, they are not reflecting once i compile it.

I will have a look on my test server. Will report back asap.

I recommend not changig any code in node modules. Instead have alook at this answer:
https://stackoverflow.com/a/59264020
You can find the docs here:
https://akveo.github.io/nebular/docs/auth/custom-auth-components#custom-auth-components


Create plug template

To ease development start, there can be a plug-example repo with the bare minimum to clone as a base for the example.
How to make a repo a template

https://github.com/Willyfrog/silverbullet-plug-template
I've invited you to collaborate on it, as I'm not sure how to transfer ownership to the org (already tried and I couldn't create public repos on it)

I also didn’t see the option to transfer, so I forked it and added you as an admin to the forked repo. Further discussions on the template itself we can have in https://github.com/silverbulletmd/silverbullet-plug-template


BUG: Stata value labels

When reading a Stata file incrementally, the value labels are read even when specifying convert_categoricals=False (this does not happen when reading the entire file at once).

closed by #11591


batch operation support ？

Hi~
Current version support batch get, batch delete and bacth put ? Consider performance, and less RPC calls ?

gohbase already batch requests internally. This can be configured via the RPCQueueSize and FlushInterval. See default here.
Exposing the batching API to the caller is a request tracked via https://github.com/tsuna/gohbase/issues/68, and recent work has started to fulfil that request https://github.com/tsuna/gohbase/pull/202


44-Gowns-Page-BE-Data

Made this branch off of develop to try and render data fro the backend onto the Gowns Page that I had done and had merged previously.  Igor and I had worked through and were able to get data on the page, but did not have time to get the mapping done to automatically populate the page.  There are lots of commits from different people as we were using multiple resources.

Wrong merge direction


Apple carplay

Hello, my version is mst2_eu_vw_pq_p0240t. How do I update apple carplay?

Is carplay enable? If it says you need to activate it, you need to patch SWaP and then add FEC/SWaP code to your unit. There's a video on youtube that shows you how to do this.

If the Apple car play and android auto is missing, there is only option to enable it from vcds/obdeleven?

mst2_eu_vw_pq_p0240t

Install mst2_eu_vw_pq_p0253t 240 is too buggy


Edit command enters 0 or negative index returns differently from enters a positive index

This reaction might be considered as inconsistent response.

We can also write it into UG and state that for edit command to be a valid command, only positive integer is considered.

Addon : same issue for non-integer value

Closed by #210


Cockpit API for getting repository details doesn't return git_url

https://github.com/Jumpscale/jscockpit/commit/9fd76e19e0089830b69e0e70e2d47a761679beb1


Study listing brakes when no ref

Fixing that problem

Coverage decreased (-0.04%) to 91.328% when pulling 2c80aa7151b14d8679dc4af5ed60aa2712536f11 on antgonza:study-listing-no-ref into 764f0746e08f989683e0b4f3b296f28ecc7f8c10 on biocore:master.

👍

Any chance a test can be added?

Coverage decreased (-0.1%) to 91.274% when pulling 6a204ae3e29cf3082a27bb50b0a42e6930b39ee7 on antgonza:study-listing-no-ref into 764f0746e08f989683e0b4f3b296f28ecc7f8c10 on biocore:master.

I think this is ready for review. These changes allows for:

Fix study listing for new biom tables, like: deblur, human, uploaded
Fix adding those bioms to analysis
Fix displaying those bioms in the analysis page.
Now the algorithm and parameters displayed for bioms are accurate and not hardcoded

Note that the analysis is still broken for non phylogenetic metrics, which should be another PR.
cc: @ElDeveloper, @josenavas

Ahh, forgot to add that I'm also fixing a weird error between https/http in miniconda.

Coverage decreased (-0.09%) to 91.276% when pulling a68d08ca6d8d1ae148b5cf81b8e0cb6078e59c2c on antgonza:study-listing-no-ref into 764f0746e08f989683e0b4f3b296f28ecc7f8c10 on biocore:master.

Coverage increased (+0.01%) to 91.384% when pulling db5a0b8a4a7c3439c0bcd649328fbae4455f3b4f on antgonza:study-listing-no-ref into 764f0746e08f989683e0b4f3b296f28ecc7f8c10 on biocore:master.

Coverage increased (+0.01%) to 91.383% when pulling 905dd5649134ad1c49e2dbf02b9f2a062675c279 on antgonza:study-listing-no-ref into 764f0746e08f989683e0b4f3b296f28ecc7f8c10 on biocore:master.

Coverage increased (+0.01%) to 91.383% when pulling 43899fbea7b86f7872e5df463310def3c0c53ee4 on antgonza:study-listing-no-ref into 764f0746e08f989683e0b4f3b296f28ecc7f8c10 on biocore:master.


About “query.bone_orientation_trs”

About the query method of query.bone_orientation_trs，
I tried many times, but it didn't work,
The bones in the model exist,
The log error is as follows
[Molang][error]-minecraft:armor_stand | query.bone_orientation_trs couldn't find the specified bone in the current entity's queryable geometry
I used it in animation keyframes. Is it feasible
Is it related to queryable geometry, what it is, and where it is set

文档详细信息
⚠ 请勿编辑此部分。 docs.microsoft.com ➟ GitHub 问题链接必须具有此部分。

ID: becc5dc9-7216-0ed4-6f4b-a39bb62323fe
Version Independent ID: fcccee12-66a4-bd85-31c3-651b5ae29a5e
Content: Molang Documentation - Experimental Query Functions
Content Source: creator/Reference/Content/MolangReference/Examples/MolangConcepts/ExperimentalQueryFunctions.md
Product: gaming
GitHub Login: @JDHeaden
Microsoft Alias: v-jillheaden

entity.zip


Allow user to specify hash_function in one_hot

This is a shallow PR that allows passing the hash_function argument from one_hot. This ensures that users can use a stable hash function for one_hot, and can fix issues like #9500. It does, however, also eliminate what seems to be the only purpose for the function.
After inspecting the API, I that there's no difference between typing one_hot(data, n) and hashing_trick(data, n), since the built in hash is indeed the default hash_function for hashing_trick as well as for one_hot.

If you need this functionality, I recommend using hashing_trick directly.
one_hot exists for historical reasons only.

Makes sense. Thanks for clarifying @fchollet.

@fchollet I understand your arguments, but this is a bad default. Say, someone builds a model that uses one_hot to make data transformations, then saves the model and later on uses it for making predictions. Because hash is randomized, such pipeline will give different (wrong!) results.


Bitrate correctness / meaning ?

Trying to understand the different bitrate meaning, as bitRate_Nominal, bitRate_Maximum (that i found "anormally" hight on my ISMA sample file) and bitRate_Encoded.
When i read this log below, i just get totally confused about OverallBitRate and OverallBitRate_Maximum.
How the last one could inferior to the first one ? and be that different ?
I cannot understand their calculation from the videos and audios streams.
Any help welcome. Thank you for your understanding.
    General
    ID/String : 0 (0x0)
    Format : BDAV
    Format/Info : Blu-ray Video
    FileSize/String : 7.59 GiB
    Duration/String : 1mn 16s
    OverallBitRate_Mode/String : Variable
    OverallBitRate/String : 848 Mbps
    OverallBitRate_Maximum/String : 48.0 Mbps

    Video #1
    ID/String : 4113 (0x1011)
    MenuID/String : 1 (0x1)
    Format : AVC
    Format/Info : Advanced Video Codec
    Format_Profile<EMAIL_ADDRESS>    Format_Settings_CABAC/String : Yes
    Format_Settings_RefFrames/String : 4 frames
    Format_Settings_GOP : M=3, N=12
    CodecID : 27
    Duration/String : 1mn 16s
    BitRate_Mode/String : Constant
    BitRate_Nominal/String : 10.0 Mbps
    Width/String : 1 280 pixels
    Height/String : 720 pixels
    DisplayAspectRatio/String : 16:9
    FrameRate/String : 23.976 fps
    ColorSpace : YUV
    ChromaSubsampling : 4:2:0
    BitDepth/String : 8 bits
    ScanType/String : Progressive
    Bits-(Pixel*Frame) : 0.453
    colour_range : Limited
    colour_primaries : BT.709
    transfer_characteristics : BT.709
    matrix_coefficients : BT.709

    Video #2
    ID/String : 6912 (0x1B00)
    MenuID/String : 1 (0x1)
    Format : AVC
    Format/Info : Advanced Video Codec
    Format_Profile<EMAIL_ADDRESS>    Format_Settings_CABAC/String : Yes
    Format_Settings_RefFrames/String : 4 frames
    Format_Settings_GOP : M=3, N=12
    CodecID : 27
    Duration/String : 1mn 16s
    BitRate_Mode/String : Variable
    BitRate_Maximum/String : 7 992 Kbps
    Width/String : 720 pixels
    Height/String : 480 pixels
    DisplayAspectRatio/String : 16:9
    FrameRate/String : 23.976 fps
    Standard : NTSC
    ColorSpace : YUV
    ChromaSubsampling : 4:2:0
    BitDepth/String : 8 bits
    ScanType/String : Progressive
    colour_range : Limited
    colour_primaries : BT.601 NTSC
    transfer_characteristics : BT.601
    matrix_coefficients : BT.601

    Audio #1
    ID/String : 4352 (0x1100)
    MenuID/String : 1 (0x1)
    Format : DTS
    Format/Info : Digital Theater Systems
    Format_Settings_Mode : 16
    Format_Settings_Endianness : Big
    CodecID : 130
    Duration/String : 1mn 16s
    BitRate_Mode/String : Constant
    BitRate/String : 768 Kbps
    Channel(s)/String : 2 channels
    ChannelPositions : Front: L R
    SamplingRate/String : 48.0 KHz
    BitDepth/String : 16 bits
    Compression_Mode/String : Lossy
    StreamSize/String : 6.99 MiB (0%)

    Audio #2
    ID/String : 6656 (0x1A00)
    MenuID/String : 1 (0x1)
    Format : DTS
    Format/Info : Digital Theater Systems
    Format_Profile : Express
    Format_Settings_Mode : 16
    Format_Settings_Endianness : Big
    CodecID : 162
    Duration/String : 1mn 16s
    BitRate_Mode/String : Constant
    BitRate/String : 192 Kbps
    Channel(s)/String : 2 channels
    ChannelPositions : Front: L R
    SamplingRate/String : 48.0 KHz
    BitDepth/String : 16 bits
    Compression_Mode/String : Lossy
    StreamSize/String : 1.75 MiB (0%)

    Text #1
    ID/String : 4608 (0x1200)
    MenuID/String : 1 (0x1)
    Format : PGS
    CodecID : 144
    Duration/String : 1mn 10s
    Video_Delay/String : 1s 1ms

    Text #2
    ID/String : 4609 (0x1201)
    MenuID/String : 1 (0x1)
    Format : PGS
    CodecID : 144
    Duration/String : 1mn 10s
    Video_Delay/String : 1s 1ms

    Text #3
    ID/String : 4610 (0x1202)
    MenuID/String : 1 (0x1)
    Format : PGS
    CodecID : 144
    Duration/String : 1mn 10s
    Video_Delay/String : 1s 1ms

    Text #4
    ID/String : 4611 (0x1203)
    MenuID/String : 1 (0x1)
    Format : PGS
    CodecID : 144
    Duration/String : 1mn 10s
    Video_Delay/String : 1s 1ms

    Text #5
    ID/String : 4612 (0x1204)
    MenuID/String : 1 (0x1)
    Format : PGS
    CodecID : 144
    Duration/String : 1mn 10s
    Video_Delay/String : 1s 1ms

    Text #6
    ID/String : 4613 (0x1205)
    MenuID/String : 1 (0x1)
    Format : PGS
    CodecID : 144
    Duration/String : 1mn 10s
    Video_Delay/String : 1s 1ms

BitRate_Nominal: indicated (in the bitstream) average bitrate
BitRate_Maximum: maximal instantaneous bitrate; with MP4 based files, it is per frame and may be not good, should be per GOP, I need to change that in order to avoid high values as you see.
BitRate_Encoded: sometimes a stream is inside another one, e.g. audio and video are together in DV in MOV, and one can not be removed. BitRate is the bit rate of the audio in case it is demuxed from DV, BitRate_Encoded is 0 because it adds no bitrate to the file as it is already in the bitrate of the video part.
This is quite complicated and the output of MediaInfo is definitely not perfect for showing all differences.

I really appreciate your input, as i've difficulty to understand the coherence of all these different values.
That's said, i still doesn't understand why OverallBitRate (848Mbps) > OverallBitRate_Maximum (48Mbps)
An overall bitrate of 848 Mbps in that case seem out of order to me ?
The maximum overall bitrate seem more "realist", though not really equal to the sum of the others bitrate in the container.

I missed the part about OverallBitRate
OverallBitRate_Maximum and OverallBitRate are computed differently, looks like it is a bug on OverallBitRate with this file (bug looks like to come from duration detection).
I can not say more or debug without the file.

I hope that @Nadahar could send this file to you. I'll ask him in case i didn't get notified.
Thank you very much for your help and explanations.

I just picked a .m2ts file at random from a set of bluray discs that turns out to have 460 .m2ts files. I had no idea that the file was "special" in any way so now I'm having a hard time finding it again. I removed the file path when I pasted it for "privacy reasons" 😭
I can't find any among the 460 with a size of 7.59 GiB when I look at Windows explorer's reported size. It should be added that I have a very low (0.7 Mbps) upload speed, so uploading 7.59 GiB would take approximately forever even if/when I find the file.
To make it even worse, I did this on my laptop, not my development computer (which I use most of the time). When I installed the MediaInfo GUI the first time (1.5 - 2 years ago) it had some malware bundled in the installer, which meant I had to find an even older version which had a "clean" installer. I've since downloaded the non-installer version on my development computer and overwritten the files of the installed version, but I haven't done so on my laptop. That means this is done with a quite old version, 0.7.73.

I can't find any among the 460 with a size of 7.59 GiB

OK, I think I see the source of the issue: there is a feature in MediaInfo which detects sequence of files (xxx000.mts, xxx001.mts...) and consider them as a single package because it is the case with a couple of my clients (and files coming from HLS and so on). as you tested the mts file directly and not the mpls file, and on a BDMV with lot of files, MediaInfo took it as a single package and computed duration as last time stamp of last file minus first timestamp of first file, which is wrong in your case as files ar independent. This is the reason duration so overall bitrate is wrong.
With CLI: disable the feature " --File_TestContinuousFileNames=0"
With GUI: not possible to disable the feature
So this is a bad side effect of a feature enabled by default, I need to fix that in order to avoid BDMV directories when I check sequence of files, but I can promise no ETA.

I couldn't find a "recently opened" overview in the MediaInfo GUI, but it might be logged somewhere? In any case, selecting "Open" in the GUI at least gave me the right folder, narrowing it down to "only" 87 files.
But, fortunately I hadn't closed my Notepad++ on my laptop, on which I edited out the command line - so it was still in the undo buffer 😄
My manually overwritten "updated" MediaInfo v0.7.96 reports the same data, so the bug is probably still there. Better yet, the actual filesize is only 26.4 MiB (despite MediaInfo's claim of 7.59 GiB), so uploading it should be no problem.
It turns out it is a problem though, because when I copy that file to a separate folder (so it's not "among its peers" in the BDMV/STREAM folder), the values are very different (they even seem reasonable):

General
ID                                       : 0 (0x0)
Complete name                            : C:\Users<user>\Desktop\00017.m2ts
Format                                   : BDAV
Format/Info                              : Blu-ray Video
File size                                : 26.4 MiB
Duration                                 : 15 s 570 ms
Overall bit rate mode                    : Variable
Overall bit rate                         : 14.2 Mb/s
Maximum Overall bit rate                 : 48.0 Mb/s
Video #1
ID                                       : 4113 (0x1011)
Menu ID                                  : 1 (0x1)
Format                                   : AVC
Format/Info                              : Advanced Video Codec
Format profile<EMAIL_ADDRESS>Format settings, CABAC                   : Yes
Format settings, ReFrames                : 4 frames
Format settings, GOP                     : M=3, N=12
Codec ID                                 : 27
Duration                                 : 15 s 15 ms
Bit rate mode                            : Constant
Nominal bit rate                         : 10.0 Mb/s
Width                                    : 1 280 pixels
Height                                   : 720 pixels
Display aspect ratio                     : 16:9
Frame rate                               : 23.976 (24000/1001) FPS
Color space                              : YUV
Chroma subsampling                       : 4:2:0
Bit depth                                : 8 bits
Scan type                                : Progressive
Bits/(Pixel*Frame)                       : 0.453
Color range                              : Limited
Color primaries                          : BT.709
Transfer characteristics                 : BT.709
Matrix coefficients                      : BT.709
Video #2
ID                                       : 6912 (0x1B00)
Menu ID                                  : 1 (0x1)
Format                                   : AVC
Format/Info                              : Advanced Video Codec
Format profile<EMAIL_ADDRESS>Format settings, CABAC                   : Yes
Format settings, ReFrames                : 4 frames
Format settings, GOP                     : M=3, N=12
Codec ID                                 : 27
Duration                                 : 15 s 15 ms
Bit rate mode                            : Variable
Maximum bit rate                         : 7 992 kb/s
Width                                    : 720 pixels
Height                                   : 480 pixels
Display aspect ratio                     : 16:9
Frame rate                               : 23.976 (24000/1001) FPS
Standard                                 : NTSC
Color space                              : YUV
Chroma subsampling                       : 4:2:0
Bit depth                                : 8 bits
Scan type                                : Progressive
Color range                              : Limited
Color primaries                          : BT.601 NTSC
Transfer characteristics                 : BT.601
Matrix coefficients                      : BT.601
Audio #1
ID                                       : 4352 (0x1100)
Menu ID                                  : 1 (0x1)
Format                                   : DTS
Format/Info                              : Digital Theater Systems
Mode                                     : 16
Format settings, Endianness              : Big
Codec ID                                 : 130
Duration                                 : 15 s 19 ms
Bit rate mode                            : Constant
Bit rate                                 : 768 kb/s
Channel(s)                               : 2 channels
Channel positions                        : Front: L R
Sampling rate                            : 48.0 kHz
Frame rate                               : 93.750 FPS (512 spf)
Bit depth                                : 16 bits
Compression mode                         : Lossy
Stream size                              : 1.38 MiB (5%)
Audio #2
ID                                       : 6656 (0x1A00)
Menu ID                                  : 1 (0x1)
Format                                   : DTS
Format/Info                              : Digital Theater Systems
Format profile                           : Express
Mode                                     : 16
Format settings, Endianness              : Big
Codec ID                                 : 162
Duration                                 : 14 s 933 ms
Bit rate mode                            : Constant
Bit rate                                 : 192 kb/s
Channel(s)                               : 2 channels
Channel positions                        : Front: L R
Sampling rate                            : 48.0 kHz
Bit depth                                : 16 bits
Compression mode                         : Lossy
Stream size                              : 350 KiB (1%)
Text #1
ID                                       : 4608 (0x1200)
Menu ID                                  : 1 (0x1)
Format                                   : PGS
Codec ID                                 : 144
Duration                                 : 1 s 0 ms
Delay relative to video                  : 1 s 1 ms
Text #2
ID                                       : 4609 (0x1201)
Menu ID                                  : 1 (0x1)
Format                                   : PGS
Codec ID                                 : 144
Duration                                 : 1 s 0 ms
Delay relative to video                  : 1 s 1 ms
Text #3
ID                                       : 4610 (0x1202)
Menu ID                                  : 1 (0x1)
Format                                   : PGS
Codec ID                                 : 144
Duration                                 : 1 s 0 ms
Delay relative to video                  : 1 s 1 ms
Text #4
ID                                       : 4611 (0x1203)
Menu ID                                  : 1 (0x1)
Format                                   : PGS
Codec ID                                 : 144
Duration                                 : 1 s 0 ms
Delay relative to video                  : 1 s 1 ms
Text #5
ID                                       : 4612 (0x1204)
Menu ID                                  : 1 (0x1)
Format                                   : PGS
Codec ID                                 : 144
Duration                                 : 1 s 0 ms
Delay relative to video                  : 1 s 1 ms
Text #6
ID                                       : 4613 (0x1205)
Menu ID                                  : 1 (0x1)
Format                                   : PGS
Codec ID                                 : 144
Duration                                 : 1 s 0 ms
Delay relative to video                  : 1 s 1 ms

because when I copy that file to a separate folder (so it's not "among its peers" in the BDMV/STREAM folder),

Due to the issue I talked about in my previous comment.

@JeromeMartinez It seems you figured it out while I was still posting - we've done some crossposting here 😉
I don't know if this is a real problem or not (analyzing single .m2ts files in a bluray structure), it was just something I did because it was a media file I found while looking "randomly" for files to open to try to get an impression of how the bitrate fields worked. It's not something I'd normally do.

It is a problem as it is not an expected behavior, but my sponsors (paying for it) have priority for the moment so I let the option enabled; when I have time (I don't have it for the moment), I'll see what I can do for catching only the real sequences of files.
I edited the ticket (title, labels) accordingly.

My original goal when doing this was to try to find a reliable way to find the maximum bitrate for variable bitrate streams of any audio or video type. Since you're already "here" @JeromeMartinez, it might be easier if you could tell me if that's possible or not than me trying to figure it out?

My original goal when doing this was to try to find a reliable way to find the maximum bitrate for variable bitrate streams of any audio or video type.

can you define "maximum bitrate"? by frame? by GOP? x seconds time frame? as discussed , I currently do by frame in MOV, and it may not fit your needs (by GOP?).
for TS (or Bluray), it depends: if maximum bitrate is provided, I display it ("BitRate_Maximum"), else nothing displayed by default (showing it needs to parse the whole file + implementing the feature in MediaInfo, an interesting feature but not yet done)
In a general view, MediaInfo shows this info in "BitRate_Maximum" field when available, but as for any other software it may be buggy/not defining "maximum" the way you want, and needs improvements. Here we are at the limits of free support, and options are using MediaInfo as is with potential bugs, sending patches, paying someone for patching, or using something else (no idea about what).

@JeromeMartinez I don't define it, the DLNA standard does - but very vague I'm afraid. As I understand it, it's "bits per seconds when played at normal speed". I don't know what criteria they have for measuring it, I guess it's not thought of that much in detail. What it's used for is to classify media files into predefined "profiles" by which a media player either supports or doesn't support the given profile, which depends on many criterias, where this "maximum bitrate" is often one of them. I guess it really comes down to the speed of the media player's network interface, buffer size and CPU power, and that it doesn't matter if the bitrate is above the specified limit for a short amount of time as long as it can be "evened out" by buffering.
This wasn't a request to implement it, I'm simply trying to figure out what information is there and if/when I can use it. I think it's a very unreasonable demand by DLNA to ask that we know this, and I'm just trying to see if there's any way to do it. I understand that ideally you'd have to scan the whole file/stream to know unless the information is available as metadata in the format. Scanning a little part of the file might be enough to get a good idea though, and I didn't know what the source if this information was. I understand it now as if it's based on metadata only, and is omitted if the metadata isn't there. When it's there it should be reasonably reliable, given that the encoder/muxer has done its job. Does that sound about right?

Does that sound about right?

Yes.

What it's used for is to classify media files into predefined "profiles" by which a media player either supports or doesn't support the.

Are these "profiles" publicly available? An pending idea for MediaInfo is to provide a database, with the possibility to apply a policy on all file in order to find which file does not meet this policy, having a "profile" for each player would be good to have.
(Actually there is already something in MediaConch but not yet really usable for a big number of files in the GUI)

@JeromeMartinez The profiles are publicly available in the sense that anyone that registers can download them at https://spirespark.com/dlna/guidelines/
They are not public in the sense that you're not allowed to share the content of the documents you've downloaded, everybody has to register and download themselves.
I don't know if DLNA's media format profiles are suitable for your need, there's a lot of work verifying all the requirements. The pluss side is that all DLNA compliant players will announce which profiles they support via UPnP, or can be looked up at if they are certified: https://spirespark.com/dlna/products/. By clicking on "View Certificate" for any given device, you can see what profiles they are certified for and thus is "guaranteed" to support. We've found that many devices support more than what they're certified for though.

We've found that many devices support more than what they're certified for though.

This is the interesting part. Actually interesting part is to have real data, file per file, in order to get a "profile" per player and not against specs.
If you have a "profile" per HW player, I am interested in such data.

We do in a sense have that in what we call "renderer profiles" or "renderer configurations"  (renderer is a DLNA term for "client"), but they aren't accurate at all. That's the reason why I'm trying to more accurately be able to determine the DLNA profiles for media, to be able to use the media format profile information to determine compatibility and to a lesser degree rely on our manually configured compatibility information.
Fully testing all formats in all it's variations is a big job for one device, and when there are thousands of devices it quickly gets hopeless to do this manually. I don't know how one would automate it either, because even though you can "push" media to a player with DLNA, there is no mechanism for giving feedback as to whether the playback were successful. This is generally indicated on the device only, be an onscreen/display error message or simply by not playing the media.
The inaccurate information we're currently relying on can be found here, specifically in the "supported" lines within each file. But, I don't know of a single profile/configuration that I would say is 100%, and many are copy/pasted and then tweaked. As we (the developers) don't have access to most of the devices, we're relying on user feedback. The users are often only concerned with a few formats for their use, so the rest can often be completely wrong. I wouldn't use that information for anything more than a very rough idea. Another thing is that this only dictates the formats supported when streamed over the network via DLNA. Some players can play additional formats/codecs when played from USB or from physical media.

Thanks!
This is a good start, but still a bit light because you don't have e.g. maximum supported H264 profile/level.
So you have 2 issues:

MediaInfo may be wrong
User input is always with errors, not easy to handle.

side note: I don't think the bitrate is the biggest difference to check, I suggest to focus on profile/level first, but this is subjective.

As we (the developers) don't have access to most of the devices, we're relying on user feedback.

Our common fate :(.

I am interested at some point in the future to have something more automated about compatibility, this is long term. I'll ping you and @Sami32 when I have something interesting to show for semi-automating such config file.

Back to this ticket: I reserve it for the issue about the sequence of files, which should be tweaked in order to avoid duration/bitrate info errors by default with Blurays.

@JeromeMartinez

side note: I don't think the bitrate is the biggest difference to check, I suggest to focus on profile/level first, but this is subjective.

I'm not prioritizing the criteria, I'm just focusing on bitrate right now. As I see it all criterias must be met to be able to claim that a given media corresponds to a given profile. I was actually working primarily on audio format support when getting into the "bitrate issue", and (encoding) profile/level often isn't a criteria/relevant.

For audio, this is often CBR, and when it is VBR you can not know maximum bitrate without parsing the whole file, I got some TS files with AAC having low bitrate during 1 hour then during few seconds a very high bitrate, you can catch that only by parsing the whole file because there is no metadata for that.
No luck...
We plan to provide graph of instantaneous bitrate and maximum bitrate with full parsing (so it will be long on your side: the time to load the whole file from disk...), but no ETA for the moment.


Add support for restricting folder to enterprise

Added the --restrict-to-enterprise flag for restricting folder collaboration to the owner's enterprise to the box folders:update command.  Also fixed a bug in the --upload-email access flag in that command.
Fixes #148

Verified that @mattwiller has signed the CLA. Thanks for the pull request!


Create a trust manager backed by known trusted X509 certificates

I think providing a way to trust all downstream certificates might be useful.  I am not sure about providing a way to trust specific certs.  Is there not a way to do this with Netty already?

@ryanjbaxter There is a way to trust specific certs with Netty. All this change does is expose that method to Spring Cloud Gateway.

So does Netty not use the trusted certificates from the JVM, you must configure them manually?  In other words if I add a certificate to the JVM will Netty automatically trust it without me having to do anything to configure Netty?

I am not sure if Netty will trust certificates from JVM. But even if it did we wouldn't want that approach. Adding certificates to the java installation would impact all applications running on that box not just the Spring Cloud Gateway.  Here is the API from Netty that this pull request uses.

I did some Googling and couldnt find anything concrete on whether defaults to the JVM but saw some hints that it might not.  I ask because in the past for other projects we didnt do anything special to support custom certificates when it used the JVM truststore.  Maybe @spencergibb knows.

@ryanjbaxter  This PR is attempting to implement option 2.
Note: I don't think the underlying SSL stack provider makes any difference.

I agree it is adding option 2, option 1 is still available as well.


Add handling for '\r'

The c string decoding code in the MI engine didn't handle '\r'. This adds code to handle that.

LGTM


MQTT retain publishes do not make it to Pulsar

Describe the bug
I'm seeing some very strange behavior using the retain feature on a standalone Pulsar. If I create a MQTT subscription on one client and on another I publish a retained MQTT message, that message never makes it to the subscription, nor do I see any messages on the Pulsar topic when using pulsar-admin to look at the topic stats. However, when I connect a new client and subscribe I get that retained message once I subscribe, but still sending new messages does not work, the messages only send when you first subscribe. Unretained messages on the same topic will come through just fine.
It almost seems like retained messages make it onto the MoP system topic so that when clients connect they do get the retained message, however the retained message never makes it into the Pulsar topic so once you're subscribed you don't get any new retained messages. This is entirely different behavior than I've seen in any other MQTT server, and I can validate this is NOT the behavior that I see while doing the same operations through Moquitto. I'd expect retain messages to still make it to the Pulsar topic, and I'd expect active subscriptions, Pulsar or MQTT, to get the retained messages.
To Reproduce
Steps to reproduce the behavior:

Start standalone Pulsar with MoP
Create an MQTT subscription on a topic, eg persistent://public/default/test_retain
Publish a retained message on that topic over MQTT
The MQTT subscription won't receive the retained message.
Look at the topic stats for that topic, no message on that topic.
Publish an unretained message on that topic over MQTT
The MQTT subscription will receive that unretained message.
Reconnect the subscription to that topic, you'll suddenly receive the retained message.

Similarly if you subscribe a Pulsar consumer and publish a retained message you will never see that message come through.
Expected behavior
MQTT retained messages should make it to the Pulsar topic and be received by all Pulsar and MQTT subscriptions on that topic.
Desktop (please complete the following information):
This is running in the streamnative/sn-pulsar container. I've tried several versions with the same results.
Additional context
Add any other context about the problem here.

It seems like in the Qos0 and Qos1 PublishHandlers the call to addRetainedMessage returns to early or avoids calling writeToPulsarTopic. So it seems retained messages never make it to the destination Pulsar topic because of this. I'd expected addRetainedMessage and writeToPulsar topic to be called for retained messages, as retained messages should still reach Pulsar. This early return seems to prevent messages from reaching Pulsar, and thus prevents the message from reaching all active subscriptions.
See here:

https://github.com/streamnative/mop/blob/95899c30662b6bca564e0149fd28b261e1685ace/mqtt-impl/src/main/java/io/streamnative/pulsar/handlers/mqtt/support/Qos0PublishHandler.java#L38
https://github.com/streamnative/mop/blob/95899c30662b6bca564e0149fd28b261e1685ace/mqtt-impl/src/main/java/io/streamnative/pulsar/handlers/mqtt/support/Qos1PublishHandler.java#L51

PR submitted for fix.

Bump. This is a pretty major bug in the retain mechanism, and it'd be nice to get this into the next release.


fix: Don't call GraphQLError.toString() recursively

graphql@16 deprecated printError, which now calls error.toString(). Our GraphQLErrorExt class calls this within its own toString() method, causing a "call stack exceeded" infinite recursive loop.

Confirmed tests also pass for<EMAIL_ADDRESS>


Bug in Chrome with wrapNativeOnMobile : true

jcf.setOptions('Select', {

    wrapNative: false,

    wrapNativeOnMobile: true

});

On Chrome the native options are shown instead of the custom ones.
The goal is to have native dropdown list in mobile but jcf ones in the desktop version.
Seems like with chrome this is not possible

This could be to do with the detection of whether your device is a mobile. I found that firefox worked fine but when in chrome it thought it was a mobile. I think this is related to the fact my laptop is a touch screen.


Where's the debugging output?

What should anybody be doing with this output?
$ helm install --debug -n myname -f values_file.yaml .
[debug] Created tunnel using local port: '42711'

[debug] SERVER: "localhost:42711"

[debug] CHART PATH: /my/local/path

Error: error validating "": error validating data: found invalid field type for v1.ServicePort

Which file is it parsing? There are like 8 services in this chart. What exactly is he missing from his ports definition? Where's the f'n stacktrace? What should anybody do with this output?

Did you run helm lint or try the helm template plugin?

The funny thing is I already found one problem (a type: NodePort was indented 3 instead of 2 spaces), but before and after helm lint is totally happy, despite install being unhappy.
But seriously, can we agree that install --debug should be more detailed? You also don't know what's the problem from reading this, right?

FWIW @erikbgithub - the issue you're running into is with one of the Services as part of your deployment I think - you've set a type field under the ports section eg:
apiVersion: v1
kind: Service
metadata:
  name: something
spec:
  type: LoadBalancer
  ports:
  - name: my-port
     type: invalid # this field shouldn't be here!
     protocol: TCP

or something similar :) but yep, it'd be nice if the output included a filename to look at perhaps. For reference, I deduced the above from found invalid field **type** for **v1.ServicePort**

@munnerz Thanks. Yes, that was the error in the example. However, let's not forget the discussion point that this is about being enabled to debug stuff yourself. You wouldn't like to open a github issue every time you do a spelling error, right?
PS: However it's interesting that you understand the text that way. I've read it as  type of the field "SerivcePort" is wrong not as there is a field "type" in ServicePort which is not correct.

IIRC this was fixed in later releases of Helm. If I attempt to install a poorly formed manifest I can see the file and line number which failed:
PS C:\Users\mafishe\go\src\github.com\kubernetes\charts\stable> helm install .\nginx-ingress\ --debug -n ingressctl
[debug] Created tunnel using local port: '59538'

[debug] SERVER: "localhost:59538"

[debug] Original chart version: ""
[debug] CHART PATH: C:\Users\mafishe\go\src\github.com\kubernetes\charts\stable\nginx-ingress

Error: apiVersion "extensions/v1beta3" in nginx-ingress/templates/controller-deployment.yaml is not available

You don't even need to specify --debug to get this functionality either.
PS C:\Users\mafishe\go\src\github.com\kubernetes\charts\stable> helm install .\nginx-ingress\ -n ingressctl
Error: apiVersion "extensions/v1beta3" in nginx-ingress/templates/controller-deployment.yaml is not available

So as far as "debugging poorly malformed charts", we've vastly improved this area and can now nail it down to the exact file which is poorly malformed. Closing this, but please re-open if there's something else I'm missing here.


Document InfluxDB tracing

There are two options for tracing:

log
jaeger

Jaeger
If the tracing type flag == jaeger, then we use the Jaeger library to configure a Jaeger tracing destination.
https://sourcegraph.internal/github.com/influxdata/influxdb/-/blob/cmd/influxd/launcher/launcher.go#L360-374
Jaeger has great docs for this.
https://www.jaegertracing.io/docs/1.11/client-libraries/
https://www.jaegertracing.io/docs/1.11/client-features/
In the second Jaeger link, you’ll find a section “Tracer configuration via environment variables”. At a minimum, the InfluxDB OSS 2.x user will need to set these env vars:
JAEGER_AGENT_HOST - Jaeger agent host name or IP address
JAEGER_SERVICE_NAME - “service name” added to each trace

@sanderson doesn't think we're going to expose this--closing


AppConfigMonitor is logging en ERROR on FileNotFound

can it not log an ERROR because ansible is creating transient temp files on a config change
thrown by isSameFile.java

It looks like ansible is creating a temporary file as part of an update to a different config file in the directory being monitored.  This is triggering the watch event but by the time isSameFile is called the file has gone.  Just need to catch the NoSuchFileException and quietly ignore it (with some debug).

Fixed in > v7.0-beta.139