kics scan within a docker can not use proxy

Expected Behavior
kics scan within a docker can use proxy
Actual Behavior
Steps to Reproduce the Problem
I try to scan the folder /home/ubuntu/workspace/PROJECT/kics-scan within a docker
I also set the proxy as env but it's not working .....
docker run --env https_proxy=http://security-proxy.****.net:3128 -v /home/ubuntu/workspace/PROJECT/kics-scan:/home/ubuntu/workspace/PROJECT/kics-scan --network=host checkmarx/kics:latest scan -p /home/ubuntu/workspace/PROJECT/kics-scan -q /app/bin/assets/queries --ci --report-formats html -o /home/ubuntu/workspace/PROJECT/kics-scan --ignore-on-exit results
07:27:28  5:27AM INF Scanning with Keeping Infrastructure as Code Secure v1.4.3
07:27:28  5:27AM INF Loading queries of type:
07:27:55  5:27AM INF Inspector initialized, number of queries=1998
07:27:55  5:27AM INF Query execution timeout=1m0s
07:27:55  5:27AM ERR Unable to GET descriptions API error="Get "https://kics.io/api/\": dial tcp: lookup kics.io on 10...:53: no such host"
07:27:55  5:27AM WRN Unable to get descriptions: Get "https://kics.io/api/": dial tcp: lookup kics.io on 10...:53: no such host
Specifications
connection from docker host ubuntu works well:

Establish HTTP proxy tunnel to kics.io:443

CONNECT kics.io:443 HTTP/1.1
Host: kics.io:443
User-Agent: curl/7.68.0
Proxy-Connection: Keep-Alive

< HTTP/1.1 200 Connection established

Version:
docker version
Client:
Version:           20.10.2
API version:       1.41
Go version:        go1.13.8
Git commit:        20.10.2-0ubuntu1~20.04.2
Built:             Tue Mar 30 21:24:57 2021
OS/Arch:           linux/amd64

Platform:
uname -a
Linux runner-0 5.4.0-77-generic #86-Ubuntu SMP Thu Jun 17 02:35:03 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux

Subsystem:
behind a coorperate proxy

the isses above is with version 1.2.4 !
so I updated to version 1.4.3 AND tried it on the bash console of the host and getting the message:
1:06PM ERR Unable to GET descriptions API error="Get "https://kics.io/api/\": dial tcp: lookup kics.io: no such host"
when I downgrade to version 1.2.4 , I do not get the error and the scan ran through successfull

Hi @ticteam, thank you for reporting this issue, we will investigate the issue for the moment as a workaround I recommend using --disable-full-descriptions flag to continue scanning with the latest version of KICS.


Also not sure if this works on a single instance (didn't check), but it should.
Works on 4 servers on CentOS perfectly. Much smoother than before.
Forced to use an older version of the 'gem'.

Well. Let me explain how I'm using it.  I'm typing on my phone so excuse the straight line without breaks. I'm using a wrapper cookbook that runs replicaset (recipe) [which includes the "install" recipe, otherwise mongo isn't there]. Then after that I include the "user management" recipe which actually also won't raise an error if the admin user is missing the first time (not that this is likely the best method). After the first user is created mongo then requires authentication and future runs of chef need the admin user. I'm guessing the assumption made in user management for instance is that if the authentication fails it's OK to ignore it because adding (or modifying (see comments in user management) fails due to lack of privileges (couldn't login as admin when there's an admin user and it's necessary). The same should apply to the parts that add the replica set. I'm guessing from what you said it's going to be best if we check if authentication is necessary (ask mongo somehow) and when authentication happens based on that decision it's going to be best to fail (raise). It'd seem wise to me then to move the connecting code into libraries and share it from everywhere then?

Ok so that's why I suspected: at this point the recipe doesn't know if authentication is required or not, because it doesn't know if it has already been setup or not.
If we assume chef is the only one interacting with mongodb setup, then we could track our own state: was the create_user recipe already executed? If not, then we assume no authentication required. But this doesn't even work if we run chef multiple times...
So we want to be more robust as you said: we should auto-detect the state:

try to connect with no auth (we'll have to find a specific command that requires the required privileges (this was introduced in mongodb 2.6. If we want to support 2.4 we will need a fallback here) (or maybe just get the current and/or admin infos and check that)
if it doesn't work, try to authenticate as admin
if it doesn't work, fatal error

It should indeed be moved into libraries, this would help re-use it everywhere we need it!

Hopefully going to get back to this soon... It's somewhat a free time issue for me.

User management and auth fixed under https://github.com/sous-chefs/mongodb/pull/13


Bug: editorState doesn't track code state

Bug report
Packages affected

[ ] sandpack-client
[x] sandpack-react

Description of the problem
The editorState value found on the sandpack instance appears to track whether or not the user has toggled between files, rather than whether they've edited the code:
https://user-images.githubusercontent.com/6692932/151000878-2a5ff0a5-de69-42ef-9662-3aa8226ee913.mp4
It's possible I've misunderstood what editorState is meant to track, but it seems like for most use cases, it would be much more valuable to know whether the user has tampered with the code, vs. changed tabs.
For context: I want to show a little "*" next to the sandbox's title when the user modifies code, so that they know it's been modified. It's important because the sandboxes are in lessons, and the lesson text refers to the original code (eg. "Notice how the text is red"). If the user changes the text from red to yellow, I want to show that the code has been modified, to explain the discrepancy. The code is saved and restored, so they might've modified it in a previous session and forgotten.
Link to sandbox:
https://codesandbox.io/s/sandpack-editorstate-demo-mhoyb
Your Environment

Software
Name/Version

Sandpack-client version
—

Sandpack-react version
0.13.5

Browser
Chrome 97.0

Operating System
MacOS Monterey

Hey @joshwcomeau, thanks for reporting this issue. Indeed, the editorState wasn't reliable enough, and hopefully, the new approach makes it better. It should have been fixed on v0.13.6

@danilowoz beautiful! I just tested and it works flawlessly.
Love that it does an actual equality check, rather than just registering changes, so if the user undoes their changes, it flips back to pristine 💯


reset _prevRenderedRowsCount when all ListView rows are loaded

Intention of this PR is to fix bug in RN.ListView as it doesn't re-render rows if the initial render happened in multiple steps.
My guess is that _prevRenderedRowsCount member is used there to prevent re-render of already rendered rows when filling ListView in multiple steps. However it should be reset when all rows are loaded otherwise it prevents further row updates during ListView lifetime.
Test Plan
Scenario:
Create ListView with more rows than set in initialListSize prop. Without the fix this ends with this._prevRenderedRowsCount == total number of rows. Change ListView state/props so some of the rows should be re-rendered.
Existing behavior:
No rows are re-rendered as shouldUpdateRow is always false.
Expected behavior:
Rows are re-rendered if dataSource.rowShouldUpdate() returns true.
Related PRs
Release Notes
[GENERAL] [BUGFIX] [ListView] - Fixing bug that prevents rows to be updated after being rendered in multiple steps

Warnings

:warning:

:clipboard: Release Notes - This PR may have incorrectly formatted Release Notes.

  Generated by :no_entry_sign: dangerJS

ListView is deprecated and will be removed from React Native soon.


cca project fails to compile

When adding this plugin to my project that uses cca (chrome mobile apps) it fails to compile

---
Want to back this issue? **[Post a bounty on it!](https://www.bountysource.com/issues/5990723-cca-project-fails-to-compile?utm_campaign=plugin&utm_content=tracker%2F637500&utm_medium=issues&utm_source=github)** We accept bounties via [Bountysource](https://www.bountysource.com/?utm_campaign=plugin&utm_content=tracker%2F637500&utm_medium=issues&utm_source=github).

fwiw - it looks like the crosswalk team is beginning to work on this issue, hopefully it will get resolved soon
https://crosswalk-project.org/jira/browse/XWALK-3308

looks like its fixed in chromium
https://github.com/crosswalk-project/crosswalk/pull/2857

Oh, thank you for letting me know.

$> cd crosswalk-cordova-<IP_ADDRESS>-arm
$> /bin/create ~/Desktop/issue_302 com.example.googlemap MainActivity
Running: android update lib-project --path "/Users/wf9a5m75/Downloads/crosswalk-cordova-<IP_ADDRESS>-arm/framework/xwalk_core_library" --target "android-19"
Updated project.properties
Updated local.properties
build.xml: Found version-tag: custom. File will not be updated.
Added file /Users/wf9a5m75/Downloads/crosswalk-cordova-<IP_ADDRESS>-arm/framework/xwalk_core_library/proguard-project.txt

Creating Cordova project for the Android platform:
	Path: ../../Desktop/issue_302
	Package: com.example.googlemap
	Name: MainActivity
	Android target: android-19
Copying template files...
Running: android update lib-project -p "../../Desktop/issue_302/CordovaLib" --target android-19
Project successfully created.
Updated project.properties
Updated local.properties
No project name specified, using project folder name 'CordovaLib'.
If you wish to change it, edit the first line of build.xml.
Added file ../../Desktop/issue_302/CordovaLib/build.xml
Added file ../../Desktop/issue_302/CordovaLib/proguard-project.txt

$> cd ~/Desktop/issue_302/

$> plugman install --platform android --project . --plugin https://github.com/wf9a5m75/phonegap-googlemaps-plugin#test --variable API_KEY_FOR_ANDROID=...
Fetching plugin "https://github.com/wf9a5m75/phonegap-googlemaps-plugin" via git clone
Plugin "https://github.com/wf9a5m75/phonegap-googlemaps-plugin" checked out to git ref "test".
Installing "plugin.google.maps" for android
Fetching plugin "plugin.http.request" via plugin registry
Installing "plugin.http.request" for android
Fetching plugin "https://github.com/wf9a5m75/google-play-services" via git clone
Plugin "https://github.com/wf9a5m75/google-play-services" checked out to git ref "v22".
Installing "com.google.playservices" for android
Updated local.properties
No project name specified, using project folder name 'google-play-services_lib'.
If you wish to change it, edit the first line of build.xml.
Added file /Users/wf9a5m75/Desktop/issue_302/com.google.playservices/google-play-services_lib/build.xml
Added file /Users/wf9a5m75/Desktop/issue_302/com.google.playservices/google-play-services_lib/proguard-project.txt
Fetching plugin "android.support.v4" via plugin registry
Installing "android.support.v4" for android

             In order to run this plugin, you need to obtain Google Maps API key for Android.
             Visit to https://github.com/wf9a5m75/phonegap-googlemaps-plugin/wiki/Installation

             Please confirm what this version is updated at
             https://github.com/wf9a5m75/phonegap-googlemaps-plugin/wiki/Release-Notes

$> vim src/plugin/google/maps/GoogleMaps.java
// Comment out 794 - 814
https://github.com/wf9a5m75/phonegap-googlemaps-plugin/blob/test/src/android/plugin/google/maps/GoogleMaps.java#L794-L814

$> vim assets/www/index.html

Eclipse -> "run as Android Application"

Crosswalk Cordova Android(ARM) ver11.40.277.1
$> cd crosswalk-cordova-11.40.277.1-arm

$> ./bin/create ~/Desktop/issue_302_v11 com.example.googlemap issue_302_v11
Running: android update lib-project --path "/Users/wf9a5m75/Downloads/crosswalk-cordova-11.40.277.1-arm/framework/xwalk_core_library" --target "android-21"
Updated project.properties
Updated local.properties
build.xml: Found version-tag: custom. File will not be updated.
Updated file /Users/wf9a5m75/Downloads/crosswalk-cordova-11.40.277.1-arm/framework/xwalk_core_library/proguard-project.txt

Creating Cordova project for the Android platform:
	Path: ../../Desktop/issue_302_v11
	Package: com.example.googlemap
	Name: issue_302_v11
	Android target: android-21
Copying template files...
Running: android update lib-project -p "../../Desktop/issue_302_v11/CordovaLib" --target android-21
Project successfully created.
Updated project.properties
Updated local.properties
No project name specified, using project folder name 'CordovaLib'.
If you wish to change it, edit the first line of build.xml.
Added file ../../Desktop/issue_302_v11/CordovaLib/build.xml
Added file ../../Desktop/issue_302_v11/CordovaLib/proguard-project.txt

$> plugman install --platform android --project . --plugin https://github.com/wf9a5m75/phonegap-googlemaps-plugin#test --variable API_KEY_FOR_ANDROID=...
Fetching plugin "https://github.com/wf9a5m75/phonegap-googlemaps-plugin" via git clone
Plugin "https://github.com/wf9a5m75/phonegap-googlemaps-plugin" checked out to git ref "test".
Installing "plugin.google.maps" for android
Fetching plugin "plugin.http.request" via plugin registry
Installing "plugin.http.request" for android
Fetching plugin "https://github.com/wf9a5m75/google-play-services" via git clone
Plugin "https://github.com/wf9a5m75/google-play-services" checked out to git ref "v22".
Installing "com.google.playservices" for android
Updated local.properties
No project name specified, using project folder name 'google-play-services_lib'.
If you wish to change it, edit the first line of build.xml.
Added file /Users/wf9a5m75/Desktop/issue_302_v11/com.google.playservices/google-play-services_lib/build.xml
Added file /Users/wf9a5m75/Desktop/issue_302_v11/com.google.playservices/google-play-services_lib/proguard-project.txt
Fetching plugin "android.support.v4" via plugin registry
Installing "android.support.v4" for android

             In order to run this plugin, you need to obtain Google Maps API key for Android.
             Visit to https://github.com/wf9a5m75/phonegap-googlemaps-plugin/wiki/Installation

             Please confirm what this version is updated at
             https://github.com/wf9a5m75/phonegap-googlemaps-plugin/wiki/Release-Notes

$> vim src/plugin/google/maps/GoogleMaps.java
// Comment out 794 - 814
https://github.com/wf9a5m75/phonegap-googlemaps-plugin/blob/test/src/android/plugin/google/maps/GoogleMaps.java#L794-L814

$> vim assets/www/index.html

Eclipse -> "run as Android Application"

Crosswalk Cordova Android(ARM) ver12.40.278.0
$> cd crosswalk-cordova-12.40.278.0-arm

$> ./bin/create ~/Desktop/issue_302_v12 com.example.googlemap issue_302_v12
Running: android update lib-project --path "/Users/wf9a5m75/Downloads/crosswalk-cordova-12.40.278.0-arm/framework/xwalk_core_library" --target "android-21"
Updated project.properties
Updated local.properties
build.xml: Found version-tag: custom. File will not be updated.
Added file /Users/wf9a5m75/Downloads/crosswalk-cordova-12.40.278.0-arm/framework/xwalk_core_library/proguard-project.txt

Creating Cordova project for the Android platform:
	Path: ../../Desktop/issue_302_v12
	Package: com.example.googlemap
	Name: issue_302_v12
	Android target: android-21
Copying template files...
Running: android update lib-project -p "../../Desktop/issue_302_v12/CordovaLib" --target android-21
Project successfully created.
Updated project.properties
Updated local.properties
No project name specified, using project folder name 'CordovaLib'.
If you wish to change it, edit the first line of build.xml.
Added file ../../Desktop/issue_302_v12/CordovaLib/build.xml
Added file ../../Desktop/issue_302_v12/CordovaLib/proguard-project.txt

$> cd ~/Desktop/issue_302_v12/

$> plugman install --platform android --project . --plugin https://github.com/wf9a5m75/phonegap-googlemaps-plugin#test --variable API_KEY_FOR_ANDROID=...
Fetching plugin "https://github.com/wf9a5m75/phonegap-googlemaps-plugin" via git clone
Plugin "https://github.com/wf9a5m75/phonegap-googlemaps-plugin" checked out to git ref "test".
Installing "plugin.google.maps" for android
Fetching plugin "plugin.http.request" via plugin registry
npm http GET http://registry.cordova.io/plugin.http.request
npm http 304 http://registry.cordova.io/plugin.http.request
Installing "plugin.http.request" for android
Fetching plugin "https://github.com/wf9a5m75/google-play-services" via git clone
Plugin "https://github.com/wf9a5m75/google-play-services" checked out to git ref "v22".
Installing "com.google.playservices" for android
Fetching plugin "android.support.v4" via plugin registry
npm http GET http://registry.cordova.io/android.support.v4
npm http 304 http://registry.cordova.io/android.support.v4
Installing "android.support.v4" for android

             In order to run this plugin, you need to obtain Google Maps API key for Android.
             Visit to https://github.com/wf9a5m75/phonegap-googlemaps-plugin/wiki/Installation

             Please confirm what this version is updated at
             https://github.com/wf9a5m75/phonegap-googlemaps-plugin/wiki/Release-Notes

$> vim src/plugin/google/maps/GoogleMaps.java
// Comment out 794 - 814
https://github.com/wf9a5m75/phonegap-googlemaps-plugin/blob/test/src/android/plugin/google/maps/GoogleMaps.java#L794-L814

$> vim assets/www/index.html

Eclipse -> "run as Android Application"

Hmm, I read the comments and logs, but I can't figure out how to set the background color as transparent.

@bFlood Do you know how to do that?

Hey @wf9a5m75, see
https://github.com/crosswalk-project/crosswalk/compare/25917addda6907b9f6e4606a6ebf3ded42bcc39a...crosswalk-12
Seems like the patch has landed only in 12.41.296.1

Ok, I will try it later.

https://github.com/crosswalk-project/crosswalk/pull/2857#issuecomment-75902864

I reckon this should be working for this version already...
https://download.01.org/crosswalk/releases/crosswalk/android/canary/13.41.310.0/arm/

I'm not sure, but it seems the crosswalk-12 branch is not merged to the master branch.

Oops, I missed that, my bad... The guy from crosswalk said that we should wait for the next canary version and 2 canary releases have been launched since he told you, but it seems it hasn't been merged... we'll have to wait then.

@wf9a5m75 Just checked and the changes are in fact already in master... =)
https://github.com/crosswalk-project/crosswalk/blob/master/runtime/android/core_internal/src/org/xwalk/core/internal/XWalkContent.java#L433
Could you test if the transparency fix is working?

Thank, but I couldn't built crosswalk from github.
They uses multiple repositories for crosswalk.
So I've been waiting new canary version.

I guess this is what you need... It's the new canary version
https://download.01.org/crosswalk/releases/crosswalk/android/canary/13.41.310.0/arm/crosswalk-cordova-13.41.310.0-arm.zip

I'm on a business trip currently. I appreciate if you test it instead of me.

Hello, I' ve been able to build with the canary version above (I did get errors that were coming from the xwalk_core_library, but managed to overcome them). The map did not show up though. I cannot inspect it on chrome because the version of chrome I have is 40 which is older than the version used in crosswalk (41+). Did someone else tried to?

Hello,
Building using the canary version above, returned some errors coming from the xwalk_core_library but I managed to overcome them and build successful.
I added the plugin and tried to build using the test branch and play-services 22 but I get these errors coming from the maps plugin.
[javac] Compiling 22 source files to C:\Users\admin\Desktop\project-Crosswalk\platforms\android\ant-build\classes
   [javac] C:\Users\admin\Desktop\project-Crosswalk\platforms\android\src\plugin\google\maps\GoogleMaps.java:797: error: cannot find symbol
   [javac]     this.webView.showCustomView(dummyLayout, new WebChromeClient.CustomViewCallback() {
   [javac]                 ^
   [javac]   symbol:   method showCustomView(FrameLayout,<anonymous CustomViewCallback>)
   [javac]   location: variable webView of type CordovaWebView
   [javac] Note: C:\Users\admin\Desktop\project-Crosswalk\platforms\android\src\plugin\google\maps\GoogleMaps.java uses or overrides a deprecated API.
   [javac] Note: Recompile with -Xlint:deprecation for details.
   [javac] Note: C:\Users\admin\Desktop\project-Crosswalk\platforms
\android\src\plugin\http\request\HttpRequest.java uses unchecked or unsafe operations.
   [javac] Note: Recompile with -Xlint:unchecked for details.
   [javac] 1 error

BUILD FAILED

Did someone else tried it to?

Hi @JcDenton86, I also tested canary 13.41.310.0 against the phonegap-googlemaps-plugin#test branch (Google Play Services 22). I built it with the Ionic CLI (you've got first to modify the ionic npm package and include the latest canary builds), and it compiles perfectly, no errors... but the map wasn't showing up (blank screen). I left it at that point cos I had to move forward to other tasks but I'll get back to this issue towards the end of the week.

Unfortunately I am not using Ionic but Onsen UI. I' ll check it again though.

Regarding of this graph, I think crosswalk-12 is not merged into crosswalk-13 (master branch).

Look at the file XWalkContent.java in crosswalk-12 and the same file in master. They're the same, both include the patch... at least here in GitHub. If they're building the canary releases from another source, then I don't know. But the changes are certainly in both branches. Maybe the commit has been cherry-pick'ed and not merged and that's why the branch hasn't been "merged"?

I don't have enough time to test for this issue, I appreciate if you help.
I think you just need to modify the pluginInitialize in GoogleMaps.java if the crosswalk supports the background transparent correctly.

I built successful the app and works much better, but I get blank map (black screen) when then map is loaded. That was happening before when I first used this plugin and the cause was the transparency (there were some divs that did not get transparent background). I could solve it by inspecting the app in chrome. Now I can not inspect, because the version of chromium(37) is older than the one in crosswalk (41).. Is there any way to inspect the app when using crosswalk?

In the inspection I see that all of my DOM elements are getting transparent (divs and page backgrounds) so I believe the black screen is crosswalk that is not getting transparent..

That is the same problem i used to have in older versions of the plugin before it started crushing on compilation. I believe that the ptoblem is unrelated to the transparency issue. Even if chrome view did not get transparent you should still be able to see your app since map is placed underneath it, not over it.

I can see my app and the html that I am placing above the map-page (buttons etc). Building the app without crosswalk I can see the map too. Using crosswalk the map-page becomes transparent (as is should - like the version without crosswalk) but the background stays black (which in default cordova the map shows up).

@JcDenton86 I think we all want to move to crosswalk. All the plugin devs are in a rush trying to make them compatible with xwalk since it's the future and also gets rid of Android fragmentation problem. Tomorrow and this w/e I'll look into this bug more deeply, but I'm not a java guy so....

-- it's the future / gets rid of Android fragmentation problem -- That's true. I am going to take a closer look on that too in the next days. I am mostly in to Java but there should be a thorough check in the code. My main job and PhD deadlines making time not my ally here (as for the most of us).

Like me, I can't wait to move to Crosswalk. Crossing Fingers somebody figure out when and how to make this work :). It'll be the first thing to switch, when it's ready.

+1 to get this working ! Right now, having a fallback default google maps V3 javascript map until this gets sorted out :/ Using Ionic and got build errors related to this issue when using the cordova crosswalk plugin. definitely sticking to crosswalk though! Down with default webView fragmentation :)

@wf9a5m75 and everybody:
https://crosswalk-project.org/blog/crosswalk-12-beta.html
Crosswalk-12-beta has support for transparent background. Now we need to check if
a) this plugin does set the background correctly to transparent
b) make some tests to confirm if everything works
I'm not familiar with Crosswalk right now, so please, someone need to test this for us. Thanks

I tested version 12.41.296.5, but the background transparent does not work.

I tried master branch with crosswalk-cordova-12.41.296.4-arm in an ionic project. It works correctly on a Sony Xperia Ion (LT28i) running 4.0.4.
On Android emulator running 4.4 + Google API 19 I also ended up with a black screen.
However it crashed on my OnePlus One running slimsaber (custom rom, 4.4). Not going to blame the plugin here as I'm not using official rom, and Crosswalk migration is not (yet) urgent to me for the time being.
If you like the details, here's what logcat said when the app crashed.
E/qdmemalloc(  741): ion: Failed to map memory in the client: Out of memory
E/qdgralloc(  741): Could not mmap handle 0x91ecad58, fd=306 (Out of memory)
E/qdgralloc(  741): gralloc_register_buffer: gralloc_map failed
W/GraphicBufferMapper(  741): registerBuffer(0x91ecad58) failed -12 (Out of memory)
E/GraphicBuffer(  741): unflatten: registerBuffer failed: Out of memory (-12)
W/Adreno-EGLSUB(  741): <DequeueBuffer:606>: dequeue native buffer fail: Success, buffer=0xae9f2498, handle=0x0
W/Adreno-EGL(  741): <qeglDrvAPI_eglSwapBuffers:3699>: EGL_BAD_SURFACE
E/chromium(  741): [ERROR:gles2_cmd_decoder.cc(9842)] Context lost because SwapBuffers failed.
E/chromium(  741): [ERROR:gles2_cmd_decoder.cc(4028)] Error: 5 for Command kSwapBuffers
E/chromium(  741): [ERROR:gles2_cmd_decoder.cc(3200)]   GLES2DecoderImpl: Context lost during MakeCurrent.
E/chromium(  741): [ERROR:gles2_cmd_decoder.cc(3200)]   GLES2DecoderImpl: Context lost during MakeCurrent.
W/Adreno-GSL(  741): <sharedmem_gpumem_alloc_id:1489>: sharedmem_gpumem_alloc: mmap failed errno 12 Out of memory
E/Adreno-GSL(  741): <ioctl_kgsl_sharedmem_alloc:1590>: ioctl_kgsl_sharedmem_alloc: FATAL ERROR : (null)
I/ActivityManager(  912): Process xxx.xxx.xxx.xxx (pid 741) has died.

Build with version Crosswalk 13.41.309 which is after “2015.02.23.” as mentions [here] (https://github.com/crosswalk-project/crosswalk/pull/2857#issuecomment-78181344). Still black screen.

https://github.com/wf9a5m75/phonegap-googlemaps-plugin/issues/302#issuecomment-76992335

built with crosswalk-cordova-13.41.313.0-arm: black screen

Bug report: Transparent incorrectly
https://crosswalk-project.org/jira/browse/XWALK-3742

LogCat shows me the following output regarding Crosswalk, could that be another issue?

03-18 10:38:30.452: D/GoogleMapsPlugin(20728): (debug)action=getMap args[0]={"backgroundColor":[0,0,0,0]}
03-18 10:38:30.462: D/GoogleMapsPlugin(20728): (debug)action=clear
03-18 10:38:30.462: D/GoogleMapsPlugin(20728): (debug)action=exec args[0]=Map.setOptions
03-18 10:38:30.462: D/GoogleMapsPlugin(20728): (debug)action=getMyLocation args[0]={"enableHighAccuracy":true}

03-18 10:38:30.472: W/XWalkViewInternal(20728): LAYER_TYPE_SOFTWARE is not supported by XwalkView

It then seems to throw an exception, but not sure it is relevant:

03-18 10:38:31.852: W/CordovaPlugin(20728): Attempted to send a second callback for ID: GoogleMaps265083622
03-18 10:38:31.852: W/CordovaPlugin(20728): Result was: "No result"
03-18 10:38:31.872: W/System.err(20728): java.lang.reflect.InvocationTargetException
03-18 10:38:31.872: W/System.err(20728): 	at java.lang.reflect.Method.invokeNative(Native Method)
03-18 10:38:31.872: W/System.err(20728): 	at java.lang.reflect.Method.invoke(Method.java:515)
03-18 10:38:31.872: W/System.err(20728): 	at plugin.google.maps.MyPlugin.execute(MyPlugin.java:50)
03-18 10:38:31.872: W/System.err(20728): 	at plugin.google.maps.GoogleMaps$3.run(GoogleMaps.java:250)
03-18 10:38:31.872: W/System.err(20728): 	at android.os.Handler.handleCallback(Handler.java:733)
03-18 10:38:31.872: W/System.err(20728): 	at android.os.Handler.dispatchMessage(Handler.java:95)
03-18 10:38:31.872: W/System.err(20728): 	at android.os.Looper.loop(Looper.java:136)
03-18 10:38:31.872: W/System.err(20728): 	at android.app.ActivityThread.main(ActivityThread.java:5146)
03-18 10:38:31.872: W/System.err(20728): 	at java.lang.reflect.Method.invokeNative(Native Method)
03-18 10:38:31.872: W/System.err(20728): 	at java.lang.reflect.Method.invoke(Method.java:515)
03-18 10:38:31.872: W/System.err(20728): 	at com.android.internal.os.ZygoteInit$MethodAndArgsCaller.run(ZygoteInit.java:732)
03-18 10:38:31.872: W/System.err(20728): 	at com.android.internal.os.ZygoteInit.main(ZygoteInit.java:566)
03-18 10:38:31.872: W/System.err(20728): 	at dalvik.system.NativeStart.main(Native Method)
03-18 10:38:31.872: W/System.err(20728): Caused by: java.lang.NullPointerException: null camera target
03-18 10:38:31.872: W/System.err(20728): 	at com.google.android.gms.common.internal.o.b(Unknown Source)
03-18 10:38:31.882: W/System.err(20728): 	at com.google.android.gms.maps.model.CameraPosition.(Unknown Source)
03-18 10:38:31.882: W/System.err(20728): 	at com.google.android.gms.maps.model.CameraPosition.(Unknown Source)
03-18 10:38:31.882: W/System.err(20728): 	at com.google.android.gms.maps.model.CameraPosition$Builder.build(Unknown Source)
03-18 10:38:31.882: W/System.err(20728): 	at plugin.google.maps.PluginMap.setOptions(PluginMap.java:116)
03-18 10:38:31.882: W/System.err(20728): 	... 13 more

@trancee That is not related. Even withoug google map, I testes just an image view, crosswalk can not display it under the browser.
Watch here:
https://crosswalk-project.org/jira/plugins/servlet/mobile#issue/XWALK-3742
and if you have enough time, please join to the discussion.

I cloned your test repository and tried out the suggestion by fujunwei, unfortunately it did not change anything.
I did not fully understand his suggestion about the SurfaceView though. I tried to add the flag PixelFormat.TRANSPARENT when adding the appView to the root in the createViews method of CordovaActivity.java, but this did also not help.

Any update for this issue?

Ask to here.
https://crosswalk-project.org/jira/plugins/servlet/mobile#issue/XWALK-3742

It seems the issue have been fixed.
https://crosswalk-project.org/jira/browse/XWALK-3742

I'm busy today. Check it out by yourself @easyalgoltd

I confirmed this plugin (#test branch) worked with CrossWalk version 14.42.329.0
https://github.com/wf9a5m75/phonegap-googlemaps-plugin/wiki/Tutorial-for-CrossWalk-(Android)

alert(navigator.appVersion);

:smile: :+1:

Best news on this sunny day :)

Yay. If anyone could confirm for android 4.2.2 + that'd be great! Can not test it myself today unfortunately :(

Map shows up on my nexus! great and thanks

Works perfect in my OnePlus One running SlimLP (custom 5.0.2). (y)

Could someone make a tutorial how to port an existing project to crosswalk? And what about Intel and arm? Are there any differences? Do we need both binaries? Or is arm enough?

@Hirbod, an tutorial exists here: https://crosswalk-project.org/documentation/cordova/migrate_an_application.html
There are downloads available for both ARM + Intel or just one of them: https://crosswalk-project.org/documentation/downloads.html

How important is it to support x86? If we include both binaries in one apk, the app size is about 50mb, if not, we have to deploy two apks and upload two files to the play store. I would like to know how you guys handle this.

Hi @Hibord:
You can follow the 6 steps described [here] (https://crosswalk-project.org/documentation/cordova/migrate_an_application.html#Migrate-using-command-line-tools). When you are done and you build successfully, the change you Cordova Java class as wf9a5m75 shows in the [wiki page] (https://github.com/wf9a5m75/phonegap-googlemaps-plugin/wiki/Tutorial-for-CrossWalk-(Android)#5-change-the-androidmanifestxml-and-hellomapjava). As for the apk you don't have to support both, just arm (the x86 is for intel cpus)

How important is it to support x86?

I don't think it's too important... http://www.gsmarena.com/results.php3?sFreeText=Intel&sOSes=2
Even though my search may be kinda weak to find all x86 Android phones.

Thanks for the report guys. I will report back later. I have a very complex community based app with a lot of features, crossing fingers everything works as expected.

What about plugin compatibility? Do 3rd party plugins work well with crosswalk? Are there any caveats?

That's the list of the plugin I am using right now.. All working as expected. (now Google maps too)
com.brodysoft.sqlitePlugin 1.0.3 "Brodysoft SQLitePlugin"
com.google.playservices 22.0.0 "Google Play Services for Android"
nl.x-services.plugins.actionsheet 1.1.2 "ActionSheet"
nl.x-services.plugins.socialsharing 4.3.13 "SocialSharing"
nl.x-services.plugins.toast 2.0.2 "Toast"
org.apache.cordova.device 0.2.13 "Device"
org.apache.cordova.dialogs 0.2.11 "Notification"
org.apache.cordova.file 1.3.2 "File"
org.apache.cordova.file-transfer 0.4.8 "File Transfer"
org.apache.cordova.geolocation 0.3.11 "Geolocation"
org.apache.cordova.globalization 0.3.3 "Globalization"
org.apache.cordova.network-information 0.2.14 "Network Information"
org.apache.cordova.splashscreen 0.3.5 "Splashscreen"
plugin.google.maps 1.2.4 "phonegap-googlemaps-plugin"
plugin.http.request 1.0.0 "phonegap-http-request"

Ok, I have similar ones. I'm just crossing fingers with https://github.com/ccsoft/cordova-facebook
Btw, you should update PlayServices to v23, as the #test branch should not work with 22

I uninstalled and re-installed the test branch earlier because I set up the project from the beginning to migrate to crosswalk and it's working as is right now.. I' ll check it though ..

This if OT now, but you need to remove v22 manually and apply it again.

If I build with target 19, I get:
     [aapt] Generating resource IDs...
     [aapt] /Users/Hirbod/Desktop/appdev/Nachbarschaft_NEW/platforms/android/CordovaLib/xwalk_core_library/res/layout/date_time_picker_dialog.xml:20: error: No resource identifier found for attribute 'datePickerMode' in package 'android'
     [aapt]
     [aapt] /Users/Hirbod/Desktop/appdev/Nachbarschaft_NEW/platforms/android/CordovaLib/xwalk_core_library/res/layout/date_time_picker_dialog.xml:31: error: No resource identifier found for attribute 'timePickerMode' in package 'android'
     [aapt]
     [aapt] /Users/Hirbod/Desktop/appdev/Nachbarschaft_NEW/platforms/android/CordovaLib/xwalk_core_library/res/layout-land/date_time_picker_dialog.xml:20: error: No resource identifier found for attribute 'datePickerMode' in package 'android'
     [aapt]
     [aapt] /Users/Hirbod/Desktop/appdev/Nachbarschaft_NEW/platforms/android/CordovaLib/xwalk_core_library/res/layout-land/date_time_picker_dialog.xml:31: error: No resource identifier found for attribute 'timePickerMode' in package 'android'

and If I set level 21 (as described in the migrate docs), I get hundreds of other errors.

Building with target-19 had the same errors and to pass them, I commented out the lines that caused these errors in the corresponding XML files and then it built successfully. Using target-21 built with no errors. Are the errors coming from plugin/cordova files? Try to delete ant-build and ant-gen directories from your project. Also make sure that you are inside CordovaLib directory while you run the commands in the migrate docs.

I was inside of cd platforms/android/ as described in the docs
I get cordova errors on 21

I guess I fail here
Build the projects in this order:

    xwalk_core_library
    CordovaLib
    kitchensink

The sequence of commands you need is as follows (from the top-level project directory):

What do they mean exactly?

I guess I'm close to get it, but know the splashscreen plugin makes problems and also this one here:
MainActivity is not abstract and does not override abstract method onXWalkReady() in XWalkActivity

and from @wf9a5m75 wiki, I don't understand this:
After that, open src/com/example/myapp/HelloMap.java, then add the following two lines like the below image.

where is the full path? My appname is of course different, but I can't find that file.

Your source file is inside the platforms/android/src/your/package/name/YourClass.java

I got it, thanks, but it looks totally different. seems like it did not get updated
/*
       Licensed to the Apache Software Foundation (ASF) under one
       or more contributor license agreements.  See the NOTICE file
       distributed with this work for additional information
       regarding copyright ownership.  The ASF licenses this file
       to you under the Apache License, Version 2.0 (the
       "License"); you may not use this file except in compliance
       with the License.  You may obtain a copy of the License at

         http://www.apache.org/licenses/LICENSE-2.0

       Unless required by applicable law or agreed to in writing,
       software distributed under the License is distributed on an
       "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
       KIND, either express or implied.  See the License for the
       specific language governing permissions and limitations
       under the License.
 */

package net.nachbarschaft;

import android.os.Bundle;
import org.apache.cordova.*;

public class MainActivity extends CordovaActivity
{
    @Override
    public void onCreate(Bundle savedInstanceState)
    {
        super.onCreate(savedInstanceState);
        super.init();
        // Set by <content src="index.html" /> in config.xml
        loadUrl(launchUrl);
    }
}

GOT IT! Thanks guys. It was really Step 6. The documentation is not clear enough. This were the steps:

Go into project
$ export ANDROID_HOME=$(dirname $(dirname $(which android)))
cd platforms/android/CordovaLib/xwalk_core_library/
$ android update project --subprojects --path . --target "android-21"
ant debug
cd ../
$ android update project --subprojects --path . --target "android-21"
ant debug
cd ../../..
cordova build android

Now it works. Just need to apply the patches from wiki know, but build works without any error.

Got it.. My .java file had missing:
import org.xwalk.core.XWalkPreferences;
Seems like migrating does not update the .java file properly.
SplashScreen plugin is not working.
This is my file now:
package net.nachbarschaft;

import android.os.Bundle;
import org.apache.cordova.*;
import org.xwalk.core.XWalkPreferences;

public class MainActivity extends CordovaActivity
{
    @Override
    public void onCreate(Bundle savedInstanceState)
    {
        super.onCreate(savedInstanceState);
    }

    @Override
    protected void onXWalkReady() {
        XWalkPreferences.setValue(XWalkPreferences.ANIMATABLE_XWALK_VIEW, false);  // <!-- Add this line

        super.init();

        this.appView.setZOrderOnTop(true);  // <!-- Add this line

        // Set by <content src="index.html" /> in config.xml
        loadUrl(launchUrl);
    }
}

Could someone share his file please? Want to proof if I haven't miss any import-statement.

It works PERFECTLY! I'm so happy. Thanks to all and Masashi :D .. But I had to implement x86 since I test on GenyMotion and Intel HAXM.

You can download the files for X86 from here.
https://download.01.org/crosswalk/releases/crosswalk/android/canary/14.42.329.0/x86/

I know Masashi, I already did. Everything works perfectly, only SplashScreen plugin does not work, but it is not caused by your plugin

It seems CrossWalk webView does not fire the onScrollChanged event when you scroll the web page.
It means this plugin does not synchronize the position with the map div.

Can someone help with this build error? Im using the test branch with my Ionic app
/home/L/Desktop/0/platforms/android/src/plugin/google/maps/MyPluginLayout.java:53: error: cannot find symbol
this.root = (ViewGroup) webView.getParent();
^
symbol:   method getParent()
location: variable webView of type CordovaWebView
/home/L/Desktop/0/platforms/android/src/plugin/google/maps/MyPluginLayout.java:55: error: cannot find symbol
webView.setBackgroundColor(Color.TRANSPARENT);
^
symbol:   method setBackgroundColor(int)
location: variable webView of type CordovaWebView
/home/L/Desktop/0/platforms/android/src/plugin/google/maps/MyPluginLayout.java:57: error: cannot find symbol
webView.setLayerType(View.LAYER_TYPE_SOFTWARE, null);

@jianbo one possible reason is you target your app to Android SDK 19. Try target to SDK 21.
Check AndroidManifest.xml, project.properties. Also when integrating Crosswalk into your project, android update remember to say --target "android-21".
Good luck...

@wf9a5m75 is onScrollChanged a JAVA event, or a JS event?

Java

@TranceLove I updated project with target=android-21 in project.properties and   in my AndroidManifest.xml. still no luck.

@jianbo Hmm... next place to look for is cordova -v. Is it 4.3.0? Update it if not.
Note however, this will use cordova-android 3.7.1 instead of 3.6.4 as in previous cordova versions. Not affecting me as of now, but again, YMMV.
BTW, I think you will want to ask for further help in Ionic's forum instead of here...

I start a fresh project and getting this when add platform
Failed to install 'org.apache.cordova.engine.crosswalk':CordovaError: Plugin doesn't support this project's cordova-android version. cordova-android: 3.7.1, failed version requirement: >=4.0.0-dev
Then I run 'cordova platform add<EMAIL_ADDRESS>I get
Unable to fetch platform<EMAIL_ADDRESS>Error: version not found: 4.0.0-dev : cordova-android/4.0.0-dev

@jianbo I didn't test org.apache.cordova.engine.crosswalk at all.
Follow this tutorial.
https://github.com/wf9a5m75/phonegap-googlemaps-plugin/wiki/Tutorial-for-CrossWalk-(Android)

Hi all, looking for help with my build errors.  I posted the details here: https://github.com/wf9a5m75/phonegap-googlemaps-plugin/issues/518
As well, I am running Cordova version 5.0.0.  Do I need to downgrade to 4.3.0?

Yes, currently 5.0.0 isn't supported

I just downgraded to Cordova 4.3.0 and am still getting the exact same errors....all 24 of them.
Do I need a specific version of google maps plugin - or additional plugins like webview (but which one, there are many)?

unfortunately I also see build errors like:
/platforms/android/src/plugin/google/maps/GoogleMaps.java:138: error: cannot find symbol
    root = (ViewGroup) webView.getParent();
                              ^
  symbol:   method getParent()
  location: variable webView of type CordovaWebView
/platforms/android/src/plugin/google/maps/GoogleMaps.java:186: error: cannot find symbol
        webView.setBackgroundColor(Color.TRANSPARENT);
               ^
  symbol:   method setBackgroundColor(int)
  location: variable webView of type CordovaWebView
/platforms/android/src/plugin/google/maps/GoogleMaps.java:189: error: cannot find symbol
        if (webView.getParent().getClass().toString().indexOf("XWalkView") > -1) {
                   ^
  symbol:   method getParent()
  location: variable webView of type CordovaWebView
/platforms/android/src/plugin/google/maps/GoogleMaps.java:203: error: cannot find symbol
          webView.setLayerType(View.LAYER_TYPE_SOFTWARE, null);
                 ^
  symbol:   method setLayerType(int,<null>)
  location: variable webView of type CordovaWebView
/platforms/android/src/plugin/google/maps/GoogleMaps.java:210: error: cannot find symbol
          webView.setBackgroundColor(0);

I'm using cordova 4.3.0, crosswalk 14.42.334.0, Play Services v23 and the #test branch aka v1.2.6.
Any help would be highly appreciated.
Thanks!


[Android] crashing bugs

When starting the game on Android, stopping it immediately and starting it again from task manager, it crashes or shows a blackscreen.

Game crashes when resuming from background, looking into it.

Android pause/resume behavior seems to be really solid now.


PagePark routing requests between apps on the same server

The problem
Longstanding problem with PagePark, my homebrew web server.

Suppose two apps are running on the same machine where PP is the http server.

Say one app is on the domain hello.com and the other is goodbye.com.

Suppose the first makes a request of the second.
http://goodbye.com/index.html

It will get a connection refused.

Make the request from another server and it works fine.

Where to look
This is where PP maps requests to domains it's serving.
BTW, it uses request, yes I know it has been deprecated.
The pipe stuff in delegateRequest is like a black box to me, I don't really understand the magic it's doing or if it's really necessary. It probably isn't, but I wrote this code a long time ago, when I wasn't as skilled in Node.
Any help much appreciated. :-)

Please disregard if this is off base, not considering all the details you've shared or is something so basic that you've already ruled it out...
The host machine may need to have ports 1339 and 1340 open (on my Ubuntu dev server, for example, for Node.js development, when I'm ready to test from another machine on my network, I have to use UFW to specifically OPEN the custom ports I'm using.
And I think I saw a reference to port 80 in the code as well, so nothing else can be running on that port also.
That would be my starting point at least.  Next I would look to see if I can identify any networking related issues that may come into play -- same ip range?  same VLAN?
Good luck!

I think this is related to https://github.com/scripting/Scripting-News/issues/110 where the PREROUTING to map 80 to the pagepark listener is never even seen by connections that originate from the same host. That is, processes on that server try to connect to port 80, and get blocked because nothing is listening there. You can diagnose this by opening a terminal and using sudo nc -k -l -v 80 < /dev/null to see what clients connects to port 80 locally, and then trying the relevant cross-site requests.

I was about to point to a ServerFault entry about OUTPUT rules, but @mcenirm beat me by 30 seconds. 😄  Here it is anyway: https://serverfault.com/questions/211536/iptables-port-redirect-not-working-for-localhost

Thanks to all esp @mcenirm. That was the problem. Whew. Glad I asked.
I posted this note in my development diary.

Updated the docs.
https://github.com/scripting/pagePark#mapping-port-80-to-1339


Remove the libc dependency

Right now we only use libc to cast the kevent to get the data field for handling receipts. It shouldn't be too hard to remove it, as long as we get a way to get the raw field on the rustix structure.

As of now, it's only used for a couple of casts.
https://github.com/smol-rs/polling/blob/5e4410c937b9e4c23920e9b74df3f480ee4a019e/src/epoll.rs#L155-L158
https://github.com/smol-rs/polling/blob/5e4410c937b9e4c23920e9b74df3f480ee4a019e/src/kqueue.rs#L124
Once the data field is exposed in rustix it should be easy to take care of.


Update url for conll2003

Following https://github.com/huggingface/datasets/issues/3582 I'm changing the download URL of the conll2003 data files, since the previous host doesn't have the authorization to redistribute the data

Hi. lhoestq

What is the solution for it?
you can see it is still doesn't work here.
https://colab.research.google.com/drive/1l52FGWuSaOaGYchit4CbmtUSuzNDx_Ok?usp=sharing
Thank you.

For now you can specify load_dataset(..., revision="master") to use the fix on master.
We'll also do a new release of datasets tomorrow I think


Lots of automated corrections by the Gulp robot

Hopefully these are all safe; there are a lot of them. I waded through all the affected files, and they seemed ok. But please skim at least to look for any wackiness before approving.

Let's try this again. Theoretically should not be conflicts, since I just rebased everything.


Project build

In this project I was able to do the following

Chose an API to base the development of the web app.

followed these design guidelines, including:

Colors (selected one main color for my website).
Typography: font face, size, and weight.
Layout: composition and space between elements.

Added Home page

When the page loads, the web app shows the list of categories that could be filtered out by some parameter, for example
by the category name.
Along with the category name, I displayed some numeric values per category that come from the API.
When the user clicks (or taps) on a category item, the application navigates to the details page.

Added Details page

In the details page, the web app retrieves data from the API to show detailed data in the category.
When the user clicks on the "Back" button (<), the user navigates to the home page.

Created unit tests for some components.

Technical requirements

The project is a single-page application (SPA) built with React and Redux.

I store the data retrieved from the API  in the Redux store.

Filtered the data that was retrieved from the API using a Filter stateless component.

Every page (the main page and the pages for each item) has a unique route within the SPA.

The project was deployed and accessible online using Render.

Added a link to the online version of my app to my README file.

Recorded a video presenting the features of the project.

Checked and fix linters errors

Thanks for the approval 👍


Events Sent

It would be useful on this page or another page (for all first-party (Microsoft) apps)) if it stated what exactly is brought in from these connectors. Since we cannot see the query, it's hard to sometimes determine what is being brought in. For instance, with Azure Identity Protection, is it bringing in the risk detection or risky sign-in? Is it pulling the real-time or aggregate risk level?

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: ad00a028-6eba-2fd4-3c97-d3a38e7cee6d
Version Independent ID: 0a9a8642-d712-6000-bb4c-4db33c36db79
Content: Connect Azure AD Identity Protection data to Azure Sentinel
Content Source: articles/sentinel/connect-azure-ad-identity-protection.md
Service: azure-sentinel
Sub-service: azure-sentinel
GitHub Login: @yelevin
Microsoft Alias: yelevin

Thank you for your detailed feedback.  We are looking into the issue, and we will respond when we have more information.

@FrankMcGovern Also, we will try to be more specific on the MS service-to-service connector pages about the exact information ingested.
Have we answered your question?
Can I close this issue?

@yelevin - That does help. It would be good if the documentation relays that same information, like you said you will add. The alerts are coming into Sentinel and already have a priority of Low/Medium/High on them. It would be good to know exactly what priority is being picked up and assigned. The connector allows you to only bring in alerts above a certain threshold, but it's not clear what field of the alert is being referenced for the low/medium/high. That's what I mean by the real-time or aggregate risk level being used for the low/medium/high.

Hi @FrankMcGovern - thanks for your feedback on Microsoft docs. We're currently taking a fresh look at our connector docs and will keep your feedback in mind when making our updates.
I'm working through our GitHub issues and am going to close this item for now. Please feel free to continue commenting here if you have more to add.
We appreciate your contributions to docs!
#please-close


[Enhancement] optimize windows sort property when one tablet

What type of PR is this：

[ ] BugFix
[ ] Feature
[ ] Enhancement
[ ] Refactor
[ ] UT
[ ] Doc
[ ] Tool

Which issues of this PR fixes ：

Fixes #
Problem Summary(Required) ：

Optimize window required sort property,  scan node can support sort property when only one tablet
Checklist:

[ ] I have added test cases for my bug fix or my new feature
[ ] I have added user document for my new feature or new function

run starrocks_fe_unittest


Support delta-sharing-capabilities header in DeltaSharingRestClient

Support delta-sharing-capabilities header in DeltaSharingRestClient, if responseFormat=delta, then we don't parse the returned lines, just return them as a Seq[String]. In the tests, we are still trying to check the returned fields by directly matching the string.
For tests on exceptions, we use DeltaSharingRestClientSuite as the responseFormat shouldn't matter. For tests with successfully returned rpcs, we add a new DeltaSharingRestClientDeltaSuite to check the returned lines.
Please only review the changes under client/ in this PR, changes under server/ should be reviewed with https://github.com/delta-io/delta-sharing/pull/335.
This is part 2 for issue https://github.com/delta-io/delta-sharing/issues/341

@wchau Can you please also look at this change?


Create tooltip list

User Story Requirments: Write out list of tooltips sentences and what they are applied to
Task requirements: Creat a list of items on the simulator that need to have tool tips, then create short concise definitions for what those tooltips should be

I think we also need: Add Staff, Filter by Shift, Show Budget, Staff Type, Quantity, Total Staff Expenses.


docs add extra \ to regex examples

In pr https://github.com/manastech/crystal/pull/1254 I found that examples like scan(/\w+/) would show up as scan(/\\w+).
I tried to figure out where the extra \ was coming from to submit a fix myself, but wasn't able to, sorry.

Thanks, couldn't find that :)


MySQL Connection Spike from Workflow

Problem statement: We have multiple MySQL shards, and only one shard has abnormal connections spike(keep for 3 mins) at one time.
And we have own client throttle logic which limits max on-the-fly request concurrency and use round robin for load balance.
If it is our throttle limit bug, all shards should have connections spikes at the same time instead only one.
Please help on this issue.

You may limit the concurrency of accessing any resource by using WFResourcePool.
Here is an example of limiting the max concurrent connections to MySQL server to 50:
#include "workflow/WFResourcePool.h"
#include "workflow/WFTaskFactory.h"

WFResourcePool respool(50);  // resource numbers

void mysql_callback(WFMySQLTask *task)
{
    respool.post(NULL);  // post back the resource
    ...
}

void my_func()
{
    WFMySQLTask *mysql_task = WFTaskFactory::create_mysql_task(..., mysql_callback);
    // get a resource from resource pool.
    WFConditional *cond = respool.get(mysql_task);
    cond->start(); // or series->push_back(cond);
}

More information about resource pool: https://github.com/sogou/workflow/blob/master/docs/about-conditional.md

I wonder it's a bug of your client:)
And you may limit the concurrency of accessing any resource by using WFResourcePool. Here is an example of limiting the max concurrent connections to MySQL server to 50:
#include "workflow/WFResourcePool.h"
#include "workflow/WFTaskFactory.h"

WFResourcePool respool(50);  // resource numbers

void mysql_callback(WFMySQLTask *task)
{
    respool.post(NULL);  // post back the resource
    ...
}

void my_func()
{
    WFMySQLTask *mysql_task = WFTaskFactory::create_mysql_task(..., mysql_callback);
    // get a resource from resource pool.
    WFConditional *cond = respool.get(mysql_task);
    cond->start(); // or series->push_back(cond);
}

More information about resource pool: https://github.com/sogou/workflow/blob/master/docs/about-conditional.md

Hey Barenboim,
Can this pool size be dynamiclly changed?

I wonder it's a bug of your client:)
And you may limit the concurrency of accessing any resource by using WFResourcePool. Here is an example of limiting the max concurrent connections to MySQL server to 50:
#include "workflow/WFResourcePool.h"
#include "workflow/WFTaskFactory.h"

WFResourcePool respool(50);  // resource numbers

void mysql_callback(WFMySQLTask *task)
{
    respool.post(NULL);  // post back the resource
    ...
}

void my_func()
{
    WFMySQLTask *mysql_task = WFTaskFactory::create_mysql_task(..., mysql_callback);
    // get a resource from resource pool.
    WFConditional *cond = respool.get(mysql_task);
    cond->start(); // or series->push_back(cond);
}

More information about resource pool: https://github.com/sogou/workflow/blob/master/docs/about-conditional.md

Hey Barenboim,
Can this pool size be dynamiclly changed?

The may try to subclass WFResroucePool and make it's size dynamic.

It seems that you are using a pretty old version of workflow. Please update to the latest release.

It is because one of mysql servers becomes slower.

You may use the kernel scheudler's load balancing to solve this problem. Just add all the mysql server's IP addresses to a single domain name. The scheduler will consider the load of each IP when selecting communication target.


Disable the "global" switch for FritzBox in Homekit?

Is there a way to disable the global switch for the FritzBox itself? I would mainly like to use the switch for the guest WLAN and want to avoid that kids or wife click on the FritzBox Button and thereby reboot the FritzBox.

If I am not wrong this is set with "readOnly": true (Device section)

If I am not wrong this is set with "readOnly": true (Device section)

I think @ChrWi is right.

I would like this too. It would be nice to disable the global switch, but keep the guest wifi switch as a separate tile.

I would like this too. It would be nice to disable the global switch, but keep the guest wifi switch as a separate tile.

This is totally possible. Just set the following parameter "readOnly": to true In your Master device. All other Switches will be still able to clickx

As mentioned above
"readOnly": true


Brackets not loading

the LinkManager patch seems to break on production with:

This looks like bad cache, I can't reproduce anywhere.

Yep


Provide Tag and Event source locations.

I want to suggest that Events and Tags retain their source location and for it to be accessible when they are consumed.
Currently, if the CommonMark parses something as an element, there's no way of restoring it back to source form (without possibly losing spacing/symbols).
This would allow multi-line Events to capture raw contents which would make it straightforward to fix issues like #716.
It also addresses extensibility as non-standard parsers could detect markers/delimiters in Event::Text and reinterpret all intermediate events/tags as raw text for processing. That means that extensions could be implemented as structs implementing Iterator<Item = MyEvent> and wrapping pulldown-cmark::Parser which would make them very composable.
Also, bare CommonMark parser could be separated and extended as needed by end-users, while an extension layer that takes in current Options could provide currently supported non-standard functionality.

It seems a pretty big change, but it may be very useful and it will be considered. Thanks for your suggestion

For reference, I have implemented it in my fork here.
Tags don't need to pass it as providing it with Events effectively does that (Tag wrapped in Event::Start and Event::End).
As I had a lot of code already working with events the way they are currently structured, I ended up:

Renaming Event to EventData.
Adding Event that contains EventData.
Implementing Deref on Event.

Using Deref meant that in my code that was doing match event {...} I just had to dereference the variable (match &*event {...}) and the rest of the code didn't have to change.
As all places that were constructing Event already had access to span this ended up being a pretty trivial change to implement, although it touches a lot and breaks semver.
Adding Span into Event seemed like a worse choice because of repetition.
If you want I can make a PR, but I'm not entirely happy with Span interface (though it's usable).

FWIW, I don't see how this external API change would help fixing #716. The span of the inline code item is known when the content is collected, but the challenge is trimming indentation from subsequent lines.
The idea for a more composable extension system is certainly interesting. It becomes challenging when you want to parse something with higher priority than something else, after the fact. If, for example, strikethrough was implemented as an extension that runs after the fact (or before other inline passes), ~~*x~~*y* or *~~x*~~ couldn't be parsed the same as they are now.

FWIW, I don't see how this external API change would help fixing #716.

I misunderstood the issue. You're right. I wasn't familiar with the codebase yet and assumed too much.

It becomes challenging when you want to parse something with higher priority than something else

That is also true. From my experiments I've found that parts that are missing for proper composition support are:

being able to halt the inner parser when the outer one detects a start tag (to prevent double parsing)
being able to run the inner parser from a certain point forward

I think only forward seek is necessary as the first start tag should take precedence

Unless it's unclosed... uhm...

I'll do some more testing once I catch up with other stuff and create another issue/PR for composition if someone doesn't do it first.

Interesting idea but out of the scope for the 0.10 version. Maybe it is more for mid term than long term, however.
Thanks!


[wip] reproduce issue #494

Attempt to reproduce #494 in CI

Should we close this @markspanbroek @AuHau @emizzle ?

I leave it up to Mark but I would say so.


StreamListener debug param deprecated

There is an small error using function prices_file_to_data_frame.

~/.local/lib/python3.8/site-packages/betfairutil/init.py in prices_file_to_csv_file(path_to_prices_file, path_to_csv_file, **kwargs)
715     path_to_prices_file: str, path_to_csv_file: str, **kwargs
716 ) -> None:
--> 717     prices_file_to_data_frame(path_to_prices_file, **kwargs).to_csv(
718         path_to_csv_file, index=False
719     )
~/.local/lib/python3.8/site-packages/betfairutil/init.py in prices_file_to_data_frame(path_to_prices_file, should_output_runner_names, should_format_publish_time, max_depth)
752     stream = trading.streaming.create_historical_generator_stream(
753         file_path=path_to_prices_file,
--> 754         listener=StreamListener(
755             max_latency=None, lightweight=True, debug=False, update_clk=False
756         ),
TypeError: init() got an unexpected keyword argument 'debug'

Checking the historic commit at bflw I see that:

debug param to be deprecated from v2.15.0 and handled explicitly

This was fixed in version 0.1.1: https://github.com/mberk/betfairutil/pull/8/commits/68fe5229efda865f844d86016678013bbed0c7ba
Please update your copy of the package and try again

Yes, you are right!
Sorry for the ticket.


Tests: Migrate core test to generic bidder

testOpenrtb2AuctionCoreFunctionality migrated to generic bidder

Files is used for the another test
org.prebid.server.it.RubiconTest#testOpenrtb2AuctionCoreFunctionality


Cannot install in macOS Ventura 13.0

Hi
i'm having issue when trying installing  katana latest version in macOS ventura 13.0 with error message below
katana version:
installation with go install , latest version
error message :
github.com/projectdiscovery/katana/cmd/katana
ld: warning: -no_pie is deprecated when targeting new OS versions
ld: warning: non-standard -pagezero_size is deprecated when targeting macOS 13.0 or later

@Masriyan
GOFLAGS="-buildmode=pie" go install github.com/projectdiscovery/katana/cmd/katana@latest


Add custom partitioner to streaming tutorial

Closes #77. I don't think README.md needs any additions because of this after all.

Thank you @noah-weingarden !

No problem! :D


Try to fix Jitpack build failed with duplicate BuildConfig.dex

Seems like there are two duplicate module paths leading to duplicate BuildConfigs.
#87
Migrate to ViewBinding

Correct the wrong artifactId!
Thanks to @ivanisidrowu   🙏


Add references to backend functions in pynipap docs

Allright, I managed to bust up the original PR for this, #758, so here's a new one. I've added explanations regarding the mapping of functions in pynipap to backend functions to each reference. During offline discussions we debated whether the references should be to the XML-RPC functions or all the way to the backend functions, but from what I remember we agreed on referring to the backend (as that's where the information of interest actually is available), even though there is an XML-RPC layer in between.
Original message:
To avoid duplicating information the pynipap documentation is very brief as most data is passed straight to the backend anyway. This PR tries to make this more clear by adding references to the corresponding backend function to each of the pynipap class methods which involve backend operations.

Oh, and the docs generated from this branch can be seen at http://nipap-garberg.readthedocs.org/en/712-update_pynipap_docs/pynipap.html.

From #758:
"In addition, in the backend module, perhaps we should have a section explaining the XML-RPC API and how it wraps around the backend and for every backend function we have a reference saying something along the lines of "This is the documentation of the internal backend function. It is exposed over XML-RPC, please also see the documentation of the XML-RPC function for full understanding."."
Ie, I'd like to see a notice in the backend function that there is a XML-RPC wrapper around it. For example, see https://github.com/SpriteLink/NIPAP/issues/750 where the user was confused over the backend vs xml-rpc argument discrepancy. Or should that be another PR?

Apart from that I think it looks good!

Oh, and can we have a link in the menu to each class (or each function)? Right now it just says "Classes" which isn't very easy to understand or navigate...

My thought was to leave the reference to XML-RPC in the backend to another PR, but what the heck. I might just as well include it here.
I'll see if we can get links to the classes i the menu as well.

Ok, trying to brush this off so we can get moving (this PR has celebrated 1 year!!!! :/)
Seems readthedocs doesn't build properly - compare sections in the menu for http://nipap-garberg.readthedocs.org/en/712-update_pynipap_docs/authlib.html with http://nipap.readthedocs.org/en/v0.28.4/nipap.html  guess we need to fix that first but @garberg feel free to rebase this on master as well :)

OK, problem solved and rebased on current master. I looked through the result briefly, looks good to me. Should be ready to go :smile:
What's implemented is references:

pynipap -> backend
Backend -> XML-RPC

What's missing is reference:

XML-RPC -> backed

... but let't create a separate issue for that!

Ok, I still think I would prefer pynipap -> XML-RPC -> backend mapping but we can discuss that some other time over a beer or whatnot ;)


fix: hide *-config warnings for directories or non-exectuable files

[x] Have you followed the guidelines in our Contributing document?
[x] Have you checked to ensure there aren't other open Pull Requests for the same change?
[x] Have you added an explanation of what your changes do and why you'd like us to include them?
[ ] Have you written new tests for your changes? Here's an example.

[x] Have you successfully run brew typecheck with your changes locally?
[ ] Have you successfully run brew tests with your changes locally?

When I run brew install pkg-config on Ventura it creates a directory /opt/homebrew/opt/pkg-config which shows this brew doctor warning:
Warning: "config" scripts exist outside your system or Homebrew directories.
`./configure` scripts often look for *-config scripts to determine if
software packages are installed, and which additional flags to use when
compiling and linking.

Having additional scripts in your path can confuse software installed via
Homebrew if the config script overrides a system or Homebrew-provided
script of the same name. We found the following "config" scripts:
  /opt/homebrew/opt/pkg-config

As I mentioned though: that file isn't a script, it's a directory. I added a filter to not report directories or non-executable files in the check_for_config_scripts diagnostic.

When I run brew install pkg-config on Ventura it creates a directory /opt/homebrew/opt/pkg-config which shows this brew doctor warning:

I can't reproduce this. I have that directory present and don't have this warning. What's your brew config and full brew doctor output?

You likely have /opt/homebrew/opt in your PATH. Note that /opt/homebrew/opt should not contain any executables, so you shouldn't have it in your PATH.

Yes, I think the PATH issue is what is happening:
❯ PATH="$(brew --prefix)/opt:$PATH" brew doctor
[snip]

Warning: "config" scripts exist outside your system or Homebrew directories.
`./configure` scripts often look for *-config scripts to determine if
software packages are installed, and which additional flags to use when
compiling and linking.

Having additional scripts in your path can confuse software installed via
Homebrew if the config script overrides a system or Homebrew-provided
script of the same name. We found the following "config" scripts:
  /usr/local/opt/pkg-config

Passing on this given above!

I've reproduced this issue on a different computer running on Monterey, I think this should work on any computer:
$ mkdir ~/.local/bin/foo-config
$ brew doctor
...
Warning: "config" scripts exist outside your system or Homebrew directories.
`./configure` scripts often look for *-config scripts to determine if
software packages are installed, and which additional flags to use when
compiling and linking.

I realize it's somewhat of an edge case and I'm not sure why /opt/homebrew/opt is in my $PATH—it likely shouldn't be. I still think it's weird for brew to be complaining about though.

I don't view it as outside the realm of possibility for build scripts to sniff a foo-config directory and decide foo is installed, or even try to use that foo-config and fail.
Given that, it seems to me that brew doctor complaining about *-config directories is probably still a good move.

fair point, thanks for taking the time to consider this!

fair point, thanks for taking the time to consider this!


Fix gometalinter issues

Hi @mattn,
I fixed here some trivial errors reported by gometalinter.

Coverage remained the same at 58.344% when pulling d2d0bf1bf1b780cd7cf73de96519d45f50bc47f9 on mjtrangoni:fix-gometalinter-issues into 1ef6010539226ec13e5c35b5b6fcfcd1101f62e8 on mattn:master.

Coverage remained the same at 58.344% when pulling d2d0bf1bf1b780cd7cf73de96519d45f50bc47f9 on mjtrangoni:fix-gometalinter-issues into 1ef6010539226ec13e5c35b5b6fcfcd1101f62e8 on mattn:master.

Coverage remained the same at 58.344% when pulling d2d0bf1bf1b780cd7cf73de96519d45f50bc47f9 on mjtrangoni:fix-gometalinter-issues into 1ef6010539226ec13e5c35b5b6fcfcd1101f62e8 on mattn:master.

Coverage remained the same at 58.344% when pulling d2d0bf1bf1b780cd7cf73de96519d45f50bc47f9 on mjtrangoni:fix-gometalinter-issues into 1ef6010539226ec13e5c35b5b6fcfcd1101f62e8 on mattn:master.

Coverage remained the same at 58.344% when pulling d2d0bf1bf1b780cd7cf73de96519d45f50bc47f9 on mjtrangoni:fix-gometalinter-issues into 1ef6010539226ec13e5c35b5b6fcfcd1101f62e8 on mattn:master.

Thank you


Add node engine specification / standardize node version

The Data Portal (and likely Explorer) does not specify the requisite node version / node engine in package.json. The developer has to figure out which node version range works; if I recall correctly it can't be the latest (~22) but has to at least be ~12. Might require settling on a common node version manager (nvm?) for scripting purposes.

I think we just need a .node_version file in the frontend root folder!

@danieljhegeman / @seve : Is this >1 year old issue still relevant?

@seve please either update or close, thanks!


Error when copying VHD to Azure Blob Storage using Azure Storage Explorer

Which version of the AzCopy was used?
10.7.0
Which platform are you using? (ex: Windows, Mac, Linux)
Windows 10
What command did you run?
$env:AZCOPY_CRED_TYPE = "Anonymous";
./azcopy.exe copy "C:\Users\Public\Documents\Hyper-V\Virtual hard disks\NUM-RDS01.vhd" "https://blobstoragelocation" --overwrite=prompt --from-to=LocalBlob --blob-type Detect --follow-symlinks --put-md5 --follow-symlinks --recursive;
$env:AZCOPY_CRED_TYPE = "";
What problem was encountered?
I keep getting getting errors when uploading a VHD to blob storage using Azure Storage Explorer 1.17.0. After the upload runs for about an hour or get's to around 10% then I get the following error in the log;

RESPONSE Status: 403 This request is not authorized to perform this operation using this permission.
Content-Length: [279]
Content-Type: [application/xml]
Date: [Wed, 03 Feb 2021 22:40:50 GMT]
Server: [Windows-Azure-Blob/1.0 Microsoft-HTTPAPI/2.0]
X-Ms-Client-Request-Id: [b98dacb4-9e5e-4db9-6d4f-5b3c154e1d0d]
X-Ms-Error-Code: [AuthorizationPermissionMismatch]
X-Ms-Request-Id: [b7e19060-001e-0005-1b7d-fab20a000000]
X-Ms-Version: [2019-12-12]
Response Details: AuthorizationPermissionMismatchThis request is not authorized to perform this operation using this permission.
How can we reproduce the problem in the simplest way?
N/A
Have you found a mitigation/solution?
No, please help!

This issue can be closed. I needed to give my account Blob Storage Owner permissions.
Thanks


Bad contrast in IntelliJ's target folder

Issue:
When I expand the target folder of a Java project, the names of the files and folders inside it becomes illegible due a bad contrast between the font and the background:

System Info:

Operating System: MacOS Big Sur 11.6
IntelliJ version: 2021.2.2 (Build #IU-212.5284.40, built on September 14, 2021)

Duplicates #57

Hi @heliommsfilho :wave:
This is already a known problem that is tracked in #57, please subscribe to this issue for more details and updates.


✨ New PositiveDouble type

📝 Description
We would like to introduce an experimental PositiveDouble type, in the kotools.types.number package, for representing a floating-point number of type Double that is greater than or equals zero.

Here's an example of Kotlin code that encodes and decodes this type using the JavaScript Object Notation (JSON) format from kotlinx.serialization:
val number: PositiveDouble = PositiveDouble.create(42)
val encoded: String = Json.encodeToString(number)
println(encoded) // 42.0
val decoded: PositiveDouble = Json.decodeFromString(encoded)
println(decoded == number) // true

✅ Checklist

[ ] Add the type with a private constructor, update the public API binaries and the unreleased changelog.
[ ] Add the create(Number) function, test its behaviour with Kotlin and its compatibility with Java, then update the public API binaries.
[ ] Add the createOrNull(Number) function, test its behaviour with Kotlin and its compatibility with Java, then update the public API binaries.
[ ] Override the toString() function, test its behaviour with Kotlin and its compatibility with Java, then update the public API binaries.
[ ] Override the equals(Any?) and the hashCode() functions, test their behaviour with Kotlin and their compatibility with Java, then update public API binaries.
[ ] Add the toDouble() function, test its behaviour with Kotlin and its compatibility with Java, then update the public API binaries.
[ ] Make the type serializable, test its serialization and deserialization processes, then update the public API binaries.
[ ] Close this issue as completed and update the tracking ones if present.

See #628 for more details on why we are not going to implement this issue for now.


Proof of concept: CR operation custom elements

(note: updated with latest PR code…)
I've had an idea in the back of my head for a while now to enable Turbo Stream tag-like functionality but for Cable Ready operations. By updating CableCar to output HTML in addition to JSON, and then adding a custom element to CR's JavaScript which translates the HTML attributes to a JSON payload for CR to perform, by golly it actually works!
What's particularly interesting about this implementation is you don't even need to import CableReady per se. All you need to do is this:
import { CableReadyOperationElement } from "cable_ready/javascript/custom_elements"
CableReadyOperationElement.define()

And that's it. The cable-ready-operation tag will be loaded and registered, and then any time the tag gets inserted into any part of the page anywhere, boom, the operation will be performed and the tag immediately removed from the DOM.
Using CableCar is a breeze:
CableReady::CableCar.instance
    .console_log(message: "Super duper!")
    .append("#root", html: "And a hearty hello to CableCar!")
    .dispatch(elements: true)

that would output:
<cr-op operation="console_log" message=""Super duper!""></cr-op>
<cr-op operation="append" html=""\u003cstrong\u003eAnd a hearty hello to CableCar!\u003c/strong\u003e"" selector=""#root""></cr-op>

A proof of concept in a Bridgetown site is here: https://raw.githubusercontent.com/jaredcwhite/testcableready/main/src/index.md
(note: if you want to run the site you'll need to download this PR branch locally, run yarn link, and then run yarn link cable_ready in the Bridgetown site)
Future ideas would be to make the custom element a little smarter in that not every attribute needs to be encoded with JSON per se (selector for example doesn't need to have " wrapping the attribute value). It also might be interesting to explore certain operations looking at a template with HTML inside the tag rather than need an html attribute/option.
Let me know what you think!

That is a really clever idea and implementation!
Could you give some examples of what you'd use this for? What's the killer app? 😉
Specifically, a couple of "I frequently use CR to X, which currently involves me doing Y, but this would allow me to do Z instead."
As you see with our efforts to make cable_car work effortlessly with mrujs, we're all for championing the CR standard format JSON across all sorts of really interesting domains. I just need a bit of help with the "why" on this one. 💙

Let's say I'm getting an HTML partial back from the server I'll swap in somewhere in the DOM (using any library, vanilla JS, whatever). Contained within that HTML partial, I could add one or more CR operations. No need for any sort of special processing or handling. Since they're just web component tags, it means there doesn't need to be a certain request that's only a CableCar dispatch and thus JS that knows to receive it and run CableReady.perform.

I can work up a more elaborate scenario of what that might look like in practice if you think it's worthwhile.

Maybe another way to put it is essentially it means you can have a "zero JS frontend￼" — not really because you need the one-liner to import and register the custom element – so in any context or codebase where you don't want to (or can't) change much of how the frontend works, you could still "sneak" in CR operations.

Zero-JS is actually (explicitly!) not a goal of SR/CR, but that doesn't detract from the potency of this PR/concept in my mind.
I feel like I get what this does, and how it does it, but I'm still a bit stuck on what I'd use it for. To be clear: this is a failure of my imagination, not a problem with the proposal. (I'm also a bit sleepy today, which doesn't help me see higher dimensions.)
Using web components to carry out an action and then self-destruct feels exciting and radical. I'm just trying to figure out what I'd be doing where the obvious solution is to embed operations in the page itself. For example, are you going to dispatch events? Remove DOM elements? Console log? Play sounds? I actually don't know!
Usually when people are learning SR and working with Page Morphs, they will often ask how to know when the Reflex is finished so their client-side JS can operate on the page. The answer is usually that if they render the page so that it's already done when it's delivered, they won't need to run any client-side JS. This doesn't always cover their problem case, but it does help them :bulb: on the mental model of serving finished HTML.
So that brings me back to <cable-ready-operation operation-name="remove" selector="#foo">. Specifically, if I don't want #foo in my DOM anymore... why not just remove it from the DOM before sending the HTML to the client?

I'm just trying to figure out what I'd be doing where the obvious solution is to embed operations in the page itself.

Hmm, trying to figure out a different way to explain this… This shouldn't be considered an additional solution beyond the current JSON-over-the-wire solution thus requiring a new set of use cases. It's quite possibly a 100% replacement for anyone who's interested. By sending operations as web components over the wire—like Turbo Streams—you can process them on the client side differently. In fact, to underscore this, you could easily use Turbo Streams to facilitate processing Cable Car operations. (wut)
def some_controller_action
  render turbo_stream: turbo_stream.append("root",
    cable_car
      .console_log(message: "Super duper!")
      .dispatch(elements: true)
  )
end

By allowing Cable Car to ride (heh) on top of an existing HTML-based transport mechanism (Turbo Streams), there's literally no extra setup of any kind required (other than the one-liner JS import for the custom element).

Also updated the Bridgetown demo code so the operations are contained within a template tag and thus inert, and there's a button you can click which then appends the operations to the body. Which in turn calls the confetti custom operation which does a little poof of confetti on the page. And you can click it over and over again. 🤩 Custom operations are rad!

I appreciate the additional context (and comments on Discord) - helps a ton. I think I get it, now.
How would you feel about a plugin route? Just taking your temperature, here.
My current take is: the bigger the tent, the better. I think it's really powerful to tell TurboStreams folks that they have 35 new operations. (I wish that they'd just use cable_car, to be honest... it would be a transparent upgrade.)
We do need to make sure that people learning the stack aren't overwhelmed by the sheer number of comparable options, which is why I'm curious about the plugin approach. (We've already started extracting modules, like the play_sound operation...)
Others from the team will have plenty to say, I'm confident.

How would you feel about a plugin route?

Do you mean like a separate gem/NPM package? Possibly, but I'd want to make sure there's some kind of official way in so I don't have to monkey-patch stuff. Is there a desire to make CR more modular/plugin oriented?

I mean, we're working towards it! It's not something you can just flip a switch on, though.
It does sound like you have a lower estimation of monkey patching than I do, which is fine - a lot of folks don't like doing it. I'm just trying to figure out a way to make sure folks who want to use CR with TurboStreams can do so... while keeping all of the considerations in my last comment in mind.
Thinking out loud: what if we changed the dispatch function signature to elements: nil and then changed line 12 to:
payload = elements ? send(elements) : operations_payload

Then you can safely reopen OperationBuilder and add your operations_custom_elements method. Now you could do:
dispatch(elements: :operations_custom_elements)

(or a shorter method name!)
I recognize that this might not be as silky smooth but I'm looking for the BATNA.

I think in the long run it's better for the community if this is a first-party concept, assuming there's interest. If I do set up a gem, I'd probably just define an elements method in lieu of dispatch entirely. The more I think about it, that's probably the only thing I'd have to touch within existing CR code.

I like your elements method idea, since it would mean no re-writing dispatch. However, I have a different suggestion in the same extended universe: cable_ready and cable_car both subclass OperationBuilder...
Perhaps what you're really looking for is a third Thing that emits HTML components instead of JSON? After all, the actual implementation of CableCar is like 15 lines soaking wet.
Still just thinking out loud.

First off, I want to say this is pretty genius. When the element connects, it runs the CR operations and then removes itself. Pretty wild tbh. Secondly, the question I'm asking myself is where do we draw the line at Plugin vs Core?
I still dont have the proper gauge here as to whether this should live as a plugin or in core. I totally get both angles. Having a web component first class citizen opens up some cool opportunities especially for people streaming in DOM updates to the browser.
I dont know how often Turbo Streams are combined with CR / SR....so perhaps this may be better as a plugin? Maybe we put this to a vote? Trust me, I totally get not wanting to have to setup a Gem + NPM package just to use this especially where its fairly minimal.
I do worry about potential sneaky bugs with JSON embedded inside HTML, but thats a different story for a different day.

However we decide to move forward on this, I'd love to make progress so let me know @leastbad what you'd need to know in order for me to put a bow on this PR, or alternatively, extract it out into a plugin. I still think having HTML-over-the-wire WCs as a first-party transport mechanism for CR is a compelling idea, but even as a separate gem/NPM package, it feels worth pursuing.

Sorry to leave you hanging! Waiting for feedback from the boss.

I think I'll go ahead and close this so I can experiment with implementing it as a plugin. That way I can iterate faster towards a comprehensive solution and also try it out in some real-world scenarios. Always happy to talk about merging the plugin into "core" down the road.

I really like the idea of encapsulating client side implementation details of DOM operations inside of custom elements. I can see a possible future where a foundational lib of custom elements exists that maps most/all standard DOM operations which could prove to be a low level building block for implementations like CableReady, TurboStreams, et al.

That's really interesting - you sort of "pivot tabled" Jared's proposal, right?
If I understand correctly, you could install a package and have access to a 1:1 set of custom elements (and matching Rails helpers) that correspond to CR operations?

I really like the idea of encapsulating client side implementation details of DOM operations inside of custom elements. I can see a possible future where a foundational lib of custom elements exists that maps most/all standard DOM operations which could prove to be a low level building block for implementations like CableReady, TurboStreams, et al.

So, that would mean instead of a single custom element which simply infers and passes JSON data along to CableReady.perform, there'd be multiple elements, each one of which would "wrap" a single operation? That does sound nifty…I'll have to think if there's a semi-automated way we could facilitate that. Maybe something that can run through the list of operations the JS library supports and "emit" an element for each operation.
Or are you saying the "current" JS library itself would switch gears—it would simply append these custom elements to the DOM and they would then handle the various CR operations internally? 🤔

there'd be multiple elements, each one of which would "wrap" a single operation

there'd be multiple elements, each one of which would "wrap" a single operation

☝🏻 This option. A lot of DOM operations get pretty complex and I really like the idea of having a discreet element for each.

Imagine a library of custom elements that encapsulate all the meaningful DOM operations that you may possibly want to trigger from the server. https://developer.mozilla.org/en-US/docs/Web/API/Document_Object_Model

I know it's out of the blue, but I'm reopening this because in the year that's passed I've seen enough scenarios where a markup embedded solution would add value that I've fully bought in to what Jared was so patiently explaining.
Where I sort of lost the thread was when the scope started blowing up (love you, @hopsoft).
From my perspective, there's three main paths that this concept could take:

One generic web component that has an operation attribute and a Rails helper that would set it up. Call this the 1:1 operation:element approach, and I think it's what Jared proposes in this PR (I need to review).
One web component for each operation, as per Nate's vision. This is still a 1:1 approach, but instead of a generic component there's a component for each operation.
My proposal, which is a departure from the above, would be a single web component that represents the payload instead of the operation. This is literally just a container for encoded JSON that gets passed to perform.

My reasons for preferring door number three are:

adding boilerplate and virtually identical shells to represent each operation seems like a lot of extra work, LOC and maintenance for questionable benefit (since most people will be using a helper to generate the markup)
someone adding custom operations to CR would need to create web components, which really ramps up the currently straight-forward process of defining custom operations today
some of my favourite features of CR 5 are related to the chaining of operations; indeed, the mental model of CR is that you can chain logical groups of operations together and they will be executed together, potentially in numbered batches

I'm picturing something like this:
<cable-ready payload="[{\"message\":\"Super duper!\",\"operation\":\"consoleLog\"},{\"message\":\"Super duper!\",\"operation\":\"consoleLog\"},{\"message\":\"Super duper!\",\"operation\":\"consoleLog\"},{\"message\":\"Super duper!\",\"operation\":\"consoleLog\"},{\"elements\":true,\"operation\":\"dispatchEvent\"}]"/>

I'm sorry that the above isn't properly escaped, but you get the idea.
Could we rally around this?

Excited to see this get picked up again @leastbad. I think your door number three is a good first step. For that payload concept, I might suggest a couple of alternatives to a literal payload attribute…either using <template> or </cable-ready>

I think <template> is more for holding HTML fragments than JSON, but OTOH it could be slightly less brittle in cases where the HTML is getting filtered by something which doesn't let </cable-ready>

and
<cable-ready><template>[{"message":"Super duper!","operation":"consoleLog"},{"message":"Super duper!","operation":"consoleLog"},{"elements":true,"operation":"dispatchEvent"}]
</template></cable-ready>

why can't we just
<cable-ready>[{"message":"Super duper!","operation":"consoleLog"},{"message":"Super duper!","operation":"consoleLog"},{"elements":true,"operation":"dispatchEvent"}]</cable-ready>

Pardon my ignorance! It just seems a bit ugly to nest an element, doesn't it?
Does wrapping it in a script element convey any advantage in terms of parsing it? Or is it functionally equivalent to a template in this scenario?

Well you need the JSON payload not to be in a visible part of the DOM tree…otherwise it could show up in a FOUC scenario and mess up SEO and screen reading. The script tag is most ideal because the only thing really you'd need to escape in the payload is a literal </script> string. For a template tag, you'd need to escape things in an XML-y fashion because the browser attempts to parse HTML tags and entities.

Personally, I agree with the first approach of making the payload a JSON string.

It seems like its the safest way to embed the JSON in a declarative way without having to worry about DOM parsing or any other shenanigans.

@ParamagicDev Yeah, you may be right and I'm overthinking it. 😄

I'm currently partial to the


doc: fix the internal libraries section formatting

Use the standard Sphinx heading level conventions to mark content within the internal libraries documentation as subsections. This makes the sections nest correctly in the tables of contents, rather than being hoisted up to the chapter level.

[ci approve]

Looks like the rocks build environment is stale:
+ source /opt/rh/gcc-toolset-11/enable
<EMAIL_ADDRESS>line 4: /opt/rh/gcc-toolset-11/enable: No such file or directory

And again autest failed inscrutably #9772 :
'/home/jenkins/workspace/Github_Builds/autest/src/tests/gold_tests/pluginTest/TSVConnFd/.libs/TSVConnFd.so' to '/tmp/sandbox/TSVConnFd/ts/plugin' - Passed
     Test : Checking that ReturnCode == 0 - Failed
        Reason: Returned Value -9 != 0

[approve ci rocky]

[approve ci autest]

[approve ci rocky]

Cherry-picked to v9.2.x


[express] Make ExpressAdapter fields protected instead of private

Hi, it make it difficult to extends the ExpressAdapter provided because of private fields. Why not use protected fields instead?

Hi, what is the usecase?

I just want to create my own adapter based on your ExpressAdapter.


Release Google.Cloud.Speech.V1P1Beta1 version 2.0.0-beta06

Changes in this release:

Commit 3f9793d: feat: Add transcript normalization
Commit ac367e2: feat: Regenerate all APIs to support self-signed JWTs

Created release for Google.Cloud.Speech.V1P1Beta1-2.0.0-beta06


Fix test_allow_volume_creation_with_degraded_availability_restore

Set replica-replenishment-wait-interval to 0 so the test will not get blocked.
https://github.com/longhorn/longhorn/issues/3183

@c3y1huang let's backport to 1.2 and 1.1 if needed.


how velox  support with spark  in  java /scala ,does velox  has  java version package?

Bug description
I know velox is writen by  c++,but we most time just use scala  spark ,how to use velox with spark  and scala,
System information
java jdk 8
scala  2.12
spark  3.2
Relevant logs
no

Hi @mullerhai, we have one project to support offloading spark sql plan to velox.
https://github.com/oap-project/gluten

Hi @mullerhai, we have one project to support offloading spark sql plan to velox. https://github.com/oap-project/gluten

does gluten support sql plan exec on GPU?

does gluten support sql plan exec on GPU?

No, it doesn't support GPU.


Add Chip Interaction model Event support

Problem
CHIP IM data model can use read request and subscribe request to retrieve events from device, event delivery is a part of the reportData.
Client sends 2 pieces of information in its Subscribe Request or Read request
An indication whether it wants all events from all clusters.
The last event Number for each event priority level it has received from this receiver.
A responder would then deliver to the initiator with all events between the event Number specified in the Request and the most current event in ReportData.

https://github.com/project-chip/connectedhomeip/pull/6366
https://github.com/project-chip/connectedhomeip/pull/6594


Data privacy and data protection regulations

I noticed that the Add User component exposes full email addresses.

I know this is nasty stuff, but given that users don't have to accept any T&C to use the service and that a new regulation on data protection will soon take effect in the EU, I think we should be careful with user data.

yeps, you're right; we should switch to just a fuzzy search by name + surname.

i'm actually going to close this one as it's for the server, nothing to do with speckle core. opened a new one where it belongs: https://github.com/speckleworks/SpeckleServer/issues/74


fix: sum type tag elision logic reversed

Welcome to Codecov :tada:
Once you merge this PR into your default branch, you're all set! Codecov will compare coverage reports and display results in all future pull requests.
Thanks for integrating Codecov - We've got you covered :open_umbrella:


feat(Chromium): roll Chromium to r551292

This roll includes:

https://crrev.com/551261 - DevTools: page.navigate should fail when server returned HTTP 204
https://crrev.com/550319 - DevTools: fix resource mimetype for request interception of file:// urls

References #1879
References #1506

@JoelEinbinder Yeah I'll add in a follow up to close the bugs


regression add external regression-test base on emr environment 1.0 11-29

Proposed changes
Issue Number: close none
Problem summary
Describe your changes.
add external regression-test base on emr environment
external table test about hive,mysql,postgresql,pg
Checklist(Required)

Does it affect the original behavior:

[ ] No

Has unit tests been added:

[ ] No

Has document been added or modified:

[ ] No

Does it need to update dependencies:

[ ] No

Are there any changes that cannot be rolled back:

[ ] No

Further comments
we will add more cases in Further
If this is a relatively large or complex change, kick off the discussion at<EMAIL_ADDRESS>by explaining why you chose the solution you did and what alternatives you considered, etc...

LGTM


PDL missing for new Geos.

The PDL codes are missing for the United Arab Emirates and South Africa

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: fdf84db6-c7e8-9a68-0b60-eb0af2de593a
Version Independent ID: bc0ed520-fccd-c390-b706-71ddfeab4085
Content: Office 365 Multi-Geo
Content Source: Enterprise/office-365-multi-geo.md
Service: o365-solutions
GitHub Login: @MikePlumleyMSFT
Microsoft Alias: mikeplum

@cimares - Thank you for submitting feedback.
I will get this issue over to the Enterprise writing team for investigation.
Thank you for reporting and making the docs better. Much appreciated.
I made a note to request the team to update this when the work is complete.

@cimares The article was updated and now contains the PDLs for South Africa and United Arab Emirates

@cimares - From our understanding, the issue has been resolved. If you feel it hasn't been resolved, please re-open this issue.
Thank you for your contribution to make the docs better! Much appreciated!


Create issue templates

Description
Currently there are no issue templates for this repo.
Steps to reproduce
Click New Issue button on GitHub repo.
Current result
No issue templates are used.
Desired result
The user should be able to choose from several issues types (e.g., Bug Report, Feature Request, Help & Other Questions)
Affected version

[x] ?.?.?

Any update, @ashishpd ?


Merge this into awesim-cli?

Should this be merged into the awesim-cli repo? This would simplify the installation of new apps and guarantee the use of our approved Rails version (even if we install later Rails versions).
For example
awesim new myapp [--skip-bundle-local/--without-skip-bundle-local]

This would setup using Rails v4.0.0 even if we have Rails v4.2.0 installed. This would give us time to update the scaffolding in osc_machete_rails and the template/assets in awesim-rails-template to take into account all the new changes in Rails v4.2.0 (for example, turn off Spring which causes issues on our system).
A guess on how this could be done in awesim-cli is adding to the awesim.gemspec
spec.add_dependency "rails", "~> 4.0.0"

And creating a Thor class that inherits from the Rails thor class that create new apps...
require '...'

module AweSim
  class AppGenerator < Rails::Generators::AppGenerator
  end
end

This was actually done for the old version. The new version will not have this done.