TA-lib indicators not working

When I try back testing using the TA-lib indicators (even the MACD implemented here in the code on GitHub) it throws an error.
TAlib is enabled
Serving Gekko UI on http://localhost:3000/
[…]
/Users/jellevandevelde/gekko/core/talib.js:11
if(result.error)
^
TypeError: Cannot read property 'error' of null
at /Users/jellevandevelde/gekko/core/talib.js:11:22
xxx POST /api/backtest 500 412ms -
Error: non-error thrown: Child process has died.
at Object.onerror (/Users/jellevandevelde/gekko/node_modules/koa/lib/context.js:105:40)
at process._tickCallback (internal/process/next_tick.js:103:7)

The talib dependency just updated, and Gekko still relies on the old version. You can install the correct one by running:
npm remove talib
npm install<EMAIL_ADDRESS>
I think we should add this to the docs somewhere..

That did the trick!

great :)


Issue in your documentation, ".code" -> ".language" in output objects

Hi,
your documentation says the output objects has the attribute "code". But the attribute names "language".
Just a little thing. :)

@dragonprojects thanks I updated the README.md


Build warning Problem

Describe the bug
Type mismatch in FindPayloadInRemoteDetourSection:
~/detours/creatwth.cpp: In function ‘void* FindPayloadInRemoteDetourSection(HANDLE, const GUID&, DWORD*, PVOID)’:
~/detours/creatwth.cpp:194:20: warning: converting to non-pointer type ‘DWORD’ {aka ‘long unsigned int’} from NULL [-Wconversion-null]
  194 |         *pcbData = NULL;
      |                    ^~~~

Should the assignment be to 0 since *pcbData  is not a pointer type?

Good catch! Fixing this right away

@bgianfo Sure thing. There quite a few more with -Wreorder and -Wsign-compare are those worthy of an issue as well?

If you are willing to file them, we are willing to look and triage them.


Is it possible to support types or any additional parsing options for custom annotation types

I couldn't find suitable tags in the closure compiler docs, so I used custom ones, which I'm reading with doctrine.
Unfortunately, it seems like only when I use tags like @param I get type parsing, in my custom tags all the contents of the comment goes into the description property. Is there a way to allow custom tags to have additional features or parsing rules?
Thanks

Thanks for this issue. We have decided to officially end-of-life JSDoc support in ESLint. As a result, this repository and project will no longer be maintained.
Thanks for understanding and we apologize for any inconvenience.


[Feature request/Bug] No way to control padding added when Avatar is disabled

Is your feature request related to a problem? Please describe.
When showCurrentUserAvatar is false  in MessageOptions you have no way to control the padding that gets added (10). Our way around was to return a SizedBox.shrink() in the avatarBuilder. However, it looks like if showCurrentUserAvatar is set to true it will add a phantom avatar with the same user.id (not the other person id in the convo). This means that in our avatarBuilder we are not able to hide this avatar which exists in the stack but it set to a opacity of 0.
Describe the solution you'd like
A way to control the padding or not add a phantom avatar. Example 3 gets us close to being able to do what we want. But there is a nagging overflow issue because the phantom avatar exists in the stack.
Example 1 - in avatar builder returning SizedBox.shrink() for current user + showCurrentUserAvatar: false
https://user-images.githubusercontent.com/825344/236341244-c0d4eb57-1f4a-45c4-a1ed-0c7ce86cb02b.png
Example 2 - in avatar builder returning avatar for both +  showCurrentUserAvatar: true
https://user-images.githubusercontent.com/825344/236341213-cc8870a1-ad4a-4638-a769-aaf3aad89e12.png
Example 3 - in avatar builder returning SizedBox.shrink() for current user + showCurrentUserAvatar: true
https://user-images.githubusercontent.com/825344/236341684-4b86eea8-d234-499f-843e-2f3c52d777b5.png

PR open to address this https://github.com/molteo-engineering-team/Dash-Chat-2/pull/47

Hey, just to be sure that I understand your issue, what you don't want (or would like to custom) is this small 10px padding that I highlighted in red, is that correct?

Yes, that would be ideal. I worked on it in https://github.com/SebastienBtr/Dash-Chat-2/pull/47 but not in love with the naming.


Please publish these on Chef's community site Supermarket.chef.io

Feel free to contact<EMAIL_ADDRESS>and we can help get these added as Chef Partner Cookbooks: https://www.chef.io/blog/2016/02/23/chef-launches-partner-cookbook-program-to-expand-devops-ready-technology-ecosystem/

+1
First you need to separate, the cookbooks in our owns repos.
But please, Include them on Chef Supermarket!!!


Add reveal style for NavigationViewItems in navigation top mode

Summary
Added reveal style for NavigationViewItem when NavigationView is in top mode. See #1236 for additional context.
Changes
Added Reveal border to the NavigationViewItem and added entries for the NavigationViewItemPresenter keys in top mode so the background has revel brushes applied.
Motivation
Added Reveal style to the NavigationViewItems when NavigationView is in top mode, so all NavigationView items behave the same as requested by @kaiguo in #1236.
Screenshots

Looks good to me. @YuliKl or @kikisaints to double check on the styles : )

/azp run

/azp run


⚠ Bofrost.be has degraded performance

In 8e4bc8e, Bofrost.be (https://www.bofrost.be) experienced degraded performance:

HTTP code: 200
Response time: 1259 ms

Resolved: Bofrost.be performance has improved in f214db6 after 6 minutes.


Fix select multiple behavior

Proposed changes

I think <select multiple> behavior is wrong.
Currentry it is as follows:

no
screenshoot
operation

1

initial view

2

Opened dropdown options

3

Clicked option1 and then deselected placeholder option.

4

Closed dropdown options. But the placeholder option is input. I think this is wrong.

5

Opened dropwon options again. But the placeholder option is selected again...

6

Deselected option1, but the placeholder option is not selected. However the placeholder option is input after closing dropdown options.

The fixed behavior
So I fixed it as follows:
The operation 1 ~ 3 are the same as above.

no
screenshoot
operation

4

Selected option1 and then deselect placeholder and closed dropdwon option.  In the fixed version, the placeholder option is not input.

5

Deselected option1 and then the placeholder option is selected.

6

Closed dropdown option. the placeholder option is input.

About he definition of placeholder option
This fixed changes also the definition of placeholder option.
In fixed version, the definition of placeholder option is as follows:

the attribute of value is "".
the attribute of disabled is true.

<select id="select" multiple>
    <option value="" disabled>This is placeholder option</option>
    <option value="1"> Option1 </option>
    <option value="2"> Option2 </option>
    <option value="3" selected> Option3 </option>
</select>

The above is as follows:

no
screenshoot
operation

1

initial view

2

Deselected option3 and then the placeholder option is selected.

That's all.
This framework is great.
Thanks.
Screenshots (if appropriate) or codepen:

Types of changes

[x] Bug fix (non-breaking change which fixes an issue).
[ ] New feature (non-breaking change which adds functionality).
[ ] Breaking change (fix or feature that would cause existing functionality to change).

Checklist:

[x] I have read the CONTRIBUTING document.
[ ] My change requires a change to the documentation.
[ ] I have updated the documentation accordingly.
[x] I have added tests to cover my changes.
[x] All new and existing tests passed.

Could you maybe solve the conflicts? I'd love for this issue to be fixed

I tried to solve this conflict but I couldn't because I didn't know how I add the modified codes of v1-dev into my codes.
Once I'll adopt v1-dev and add my code.
I would like to contribute to this project.
Thank you.'

Sorry for replaying so late.
I fixed the conflict.
Please review this.
Thanks.


add: vishal065 profile and public data added

Description

Hello, I have added my Profile in the Data section please review, This is my first contribution to open source, and the first time a pull request was created I completed all the instructions as it was given CONTRIBUTING.md and README.md hope it soon gets merged into the main
Related Issues

Changes Proposed

Checklist

[✔] I have read and followed the Contribution Guidelines.
[✔] All new and existing tests passed.
[✔] I have updated the documentation to reflect the changes I've made.
[✔] My code follows the code style of this project.
[✔] The title of my pull request is a short description of the requested changes.

Screenshots
Note to reviewers

@vishal065 Sorry for reviewing late.
Thank you so much for your contribution! Your efforts are greatly appreciated and will go a long way in improving our project. Please feel free to share it with others and help us grow even further!


IntelliJ IDEA 2020.3 EAP - You aren't using a compiler supported by lombok, so lombok will not work and has been disabled.

Short description
Using IntelliJ IDEA 2020.3 EAP, Lombok plugin version 0.32 EAP and JDK 1.8 I cannot compile Java code with Lombok annotations anymore due to:
You aren't using a compiler supported by lombok, so lombok will not work and has been disabled.

Expected behavior
Compiling Lombok annotated classes should work as before.
Version information

IDEA Version: IntelliJ IDEA 2020.3 EAP (Ultimate Edition) Build #IU-203.4449.2, built on October 6, 2020
JDK Version: Java(TM) SE Runtime Environment (build 1.8.0_221-b11)
OS Type & Version: Microsoft Windows [Version 10.0.18363.1082]
Lombok Plugin Version: 0.32-EAP
Lombok Dependency Version: 1.18.12

Steps to reproduce

Install IntelliJ IDEA 2020.3 EAP and Lombok plugin 032-EAP
Use Lombok dependency version 1.18.12 in you Maven / Gradle dependencies
Compile Lombok annotated code

Sample project
N/A
Additional information

Building the code using Maven from the command line works fine
Used to work fine from IntelliJ IDEA as well, until a week or so ago. So I am guessing it might be some incompatibility issue either with the newer IntelliJ IDEA version or Lombok plugin version.
Probably related to: https://github.com/rzwitserloot/lombok/issues/2592

Stacktrace
java: You aren't using a compiler supported by lombok, so lombok will not work and has been disabled.
  Your processor is: org.jetbrains.jps.javac.$Proxy19
  Lombok supports: OpenJDK javac, ECJ

Is there a workaround for this issue?

Closing as it is a duplicate of https://github.com/mplushnikov/lombok-intellij-plugin/issues/950

Found a potential workaround in rzwitserloot/lombok#2592 and https://youtrack.jetbrains.com/issue/IDEA-250718#focus=Comments-27-4418347.0-0
Go to File | Settings | Build, Execution, Deployment | Compiler | Build process VM options field and add
-Djps.track.ap.dependencies=false

it works!

it woeks

Closing as it is a duplicate of #950

It definitely works!
for Mac : IntellIJ IDEA -> Preferences -> Build, Execution, Deployment -> Compiler
-> User-local build process VM options (overrides Shared options): -Djps.track.ap.dependencies=false

Closing as it is a duplicate of #950

It definitely works!
for Mac : IntellIJ IDEA -> Preferences -> Build, Execution, Deployment -> Compiler
-> User-local build process VM options (overrides Shared options): -Djps.track.ap.dependencies=false

It definitely works!

Found a potential workaround in rzwitserloot/lombok#2592 and https://youtrack.jetbrains.com/issue/IDEA-250718#focus=Comments-27-4418347.0-0
Go to File | Settings | Build, Execution, Deployment | Compiler | Build process VM options field and add
-Djps.track.ap.dependencies=false

It definitely works!
for Mac : IntellIJ IDEA -> Preferences -> Build, Execution, Deployment -> Compiler
-> User-local build process VM options (overrides Shared options): -Djps.track.ap.dependencies=false

it works for mac !!

don't work.
If don't use this option - not work one module.
If use this option - not wlrk 50% modules...

It really works


Error compiling with webpack

Hello,
This isn't a error of formio, but I hope that somebody help me with this issue.
When I launch "ng serve" ....
** NG Live Development Server is listening on localhost:4200, open your browser on http://localhost:4200/ **
Date: 2018-02-19T17:09:44.747Z
Hash: 37551eb9884f298f9dc2
Time: 43225ms
chunk {inline} inline.bundle.js (inline) 3.85 kB [entry] [rendered]
chunk {main} main.bundle.js (main) 2.44 MB [initial] [rendered]
chunk {polyfills} polyfills.bundle.js (polyfills) 599 kB [initial] [rendered]
chunk {scripts} scripts.bundle.js (scripts) 1.23 MB [initial] [rendered]
chunk {styles} styles.bundle.js (styles) 2.84 MB [initial] [rendered]
chunk {vendor} vendor.bundle.js (vendor) 19.5 MB [initial] [rendered]

ERROR in multi webpack-dev-server/client?http://<IP_ADDRESS>:0 ./src/main.ts
Module not found: Error: Can't resolve 'webpack-dev-server/client?http://<IP_ADDRESS>:0' in 'C:\Desarrollo\vsn_cms_formio\client'
ERROR in Error: Metadata version mismatch for module C:/Desarrollo/vsn_cms_formio/client/node_modules/angular-formio/index.d.ts, found version 4, expected 3, resolving symbol AppModule in C:/Desarrollo/vsn_cms_formio/client/src/app/app.module.ts, resolving symbol AppModule in C:/Desarrollo/vsn_cms_formio/client/src/app/app.module.ts
    at syntaxError (C:\Desarrollo\vsn_cms_formio\client\node_modules\@angular\compiler\bundles\compiler.umd.js:1729:34)
    at simplifyInContext (C:\Desarrollo\vsn_cms_formio\client\node_modules\@angular\compiler\bundles\compiler.umd.js:24979:23)
    at StaticReflector.simplify (C:\Desarrollo\vsn_cms_formio\client\node_modules\@angular\compiler\bundles\compiler.umd.js:24991:13)
    at StaticReflector.annotations (C:\Desarrollo\vsn_cms_formio\client\node_modules\@angular\compiler\bundles\compiler.umd.js:24418:41)
    at _getNgModuleMetadata (C:\Desarrollo\vsn_cms_formio\client\node_modules\@angular\compiler-cli\src\ngtools_impl.js:138:31)
    at _extractLazyRoutesFromStaticModule (C:\Desarrollo\vsn_cms_formio\client\node_modules\@angular\compiler-cli\src\ngtools_impl.js:109:26)
    at Object.listLazyRoutesOfModule (C:\Desarrollo\vsn_cms_formio\client\node_modules\@angular\compiler-cli\src\ngtools_impl.js:53:22)
    at Function.NgTools_InternalApi_NG_2.listLazyRoutes (C:\Desarrollo\vsn_cms_formio\client\node_modules\@angular\compiler-cli\src\ngtools_api.js:91:39)
    at AotPlugin._getLazyRoutesFromNgtools (C:\Desarrollo\vsn_cms_formio\client\node_modules\@angular\cli\node_modules\@ngtools\webpack\src\plugin.js:240:66)
    at _donePromise.Promise.resolve.then.then.then.then.then (C:\Desarrollo\vsn_cms_formio\client\node_modules\@angular\cli\node_modules\@ngtools\webpack\src\plugin.js:493:24)
    at <anonymous>
    at process._tickCallback (internal/process/next_tick.js:188:7)

I am using in package.json :
"angular-formio": "^1.16.0",
And in app.module.ts:
import { FormioModule } from 'angular-formio';
..
imports:
   FormioModule,
..

PD: With old version of formio 1.12 works
PD2: I tried with version 1.15 too and doesn't works
Thank you

Yep, this happens because the build routine creates a index.metadata.json file based on the version of Angular when I compiled it. As it turns out, I was on Angular 5 when compiling the library and it added the version 4 for that (I know it is confusing but Angular 5 = version 4).  Let me do some digging and figure out how to get the index.metadata.json not care about your version.

Thank you travist.  I will also investigate about this

Hi,
Finally, after reading some about this I updated the @angular versions on package.json from 4.0.0 to 5.2.5
"@angular/animations": "^5.2.5",
"@angular/cdk": "^5.2.1",
"@angular/common": "^5.2.5",
"@angular/compiler": "^5.2.5",
"@angular/core": "^5.2.5",
"@angular/forms": "^5.2.5",
"@angular/http": "^5.2.5",
"@angular/material": "^5.2.1",
"@angular/platform-browser": "^5.2.5",
"@angular/platform-browser-dynamic": "^5.2.5",
"@angular/router": "^5.2.5"

I have another doubt but I will open another ticket.
Thank you


Pass target type into reference

In a few cases we had issues resolving to the expected type of a reference. This is due to AstReflection.getReferenceType not always working correctly in cases such as fragments.
This change stores the target type on the reference when it is created, removing the need for getReferenceType altogether.

This change has a cost: it adds an additional property to every instance of a reference, which can mean a lot for large ASTs.
Could you identify a specific grammar example where reference resolution fails with the previous approach?

Can this be closed in favor of #822?


Remove password protection from Zendesk panel

The Zendesk panel on the 2nd line dashboard required a username and password to be supplied: https://govuk-2ndline-dashboard.herokuapp.com/
The Zendesk ticket count is not particularly sensitive information, and it's a pain to have to dig out the credentials every time, which might put some 2nd liners off using the dashboard.

@ChrisBAshton What information is the password protecting?

Responded offline (as GitHub was being slow with uploading screenshots) but yes, it only shows the counts 👍


line-customTooltips.html doesn't take the scroll offset into account

The example file line-customTooltips.html doesn't take the window scroll offset into account, which leads to some confusion when you're trying to use the example to figure out how custom tooltips work, and they show up off-screen making you think something is wrong when it's maybe not!
Just needs this small change:
https://github.com/el-ee/Chart.js/commit/d851295930b2d6f3a6ecccaf8cbd4637a1e1fb59

@el-ee good catch! Could you PR a fix for that?

Resolved in #4039


Issue opening PWA via links on android devices while offline

i am using vite pwa to build and run PWAs on both windows and android.
the PWA currently works fine in offline mode once open on both platforms, but i am having an issue on android devices.
in particular on android it is possible to associate a PWA to a FQDN when opening a link, so that android opens the link in the PWA by default.
in such instances it seems that when clicking on different links in offline mode, the PWA won't be started by android due to "You are offline". The PWA would be started however in case the link used was already open at least once by the PWA, but not with new links (e.g. with different query params).
is this a limitation of vite-pwa, or am i missing something in the manifest / SW file ?
thanks

Try adding ignoreURLParametersMatching: [/.*/], in workbox pwa option, if your're using custom service worker use:
precacheAndRoute(self.__WB_MANIFEST, { ignoreURLParametersMatching: [/.*/] })

https://developer.chrome.com/docs/workbox/modules/workbox-precaching


Autocorrect broken paths

Would be nice to have a config option which fixes the broken paths for you

I don't believe Webpack has any way to go back and edit the source code. What you're looking for would be something more like an eslint plugin.


Remove deprecated RenameActorReminder methods

Signed-off-by: Anindita Das<EMAIL_ADDRESS>Description
Remove deprecated RenameActorReminder methods
Issue reference
Fixes #617
Checklist
Please make sure you've completed the relevant tasks for this PR, out of the following list:

[ ] Code compiles correctly
[ ] Created/updated tests
[ ] Extended the documentation

@dasanind
Thanks for the contribution. Welcome to the community.
Can you check the issues with the examples and build?

@mukundansundar Can you please approve the build?

@dasanind I'm the maintainer of the repo. Can you please tell me which version of grpctools you used? I'd like the protos to be generated with at least version 1.54.0 or higher. I see a lot of differences in the generates protos here that should not exist, so please check the version.

I pushed a commit with the latest generated protos using 1.60.0 tools.

Technically this PR does not address #617 because that issue itself requires no action. We did not expose the RenameActorReminder in any way.
Everything Actor related in the Python SDK uses HTTP - not protos. See clients/http/dapr_actor_http_client.py.
But we have to updates protos ahead of each Dapr release anyway. So I'll merge this PR so it can count as a contribution for you.

Thank you @berndverst


MERN_React: 3.2 using event listeners in components Video

Instructions

Video must be in mp4 format and drive link to be uploaded

Project directory
Branch MERN>MERN/Topic/Frontend/React/

Please read the contributing guidelines to get started
Event listeners_Video

Show a brief summary on event listeners.
Explain with the help of working examples

Task

[ ] Video

Domain of contribution

[X] MERN

/assign

/assign

@manjeetdhayal Plz review my PR.


How to send email anonymously in backgroud ?

Hi,
I want to send emails in the background without user interaction, even to track if someone wants to authenticate which is not authorized. I already send such information to my Application Insights config in Azure. So I get the info anyway. But for convenience it would be great if I can specifiy a To: (sender) like<EMAIL_ADDRESS>. Currently when the app attempts to send an email the standard android email program choose dialog pops up where a user would have to choose its own email account, which is not the desired behaviour.
thanks,
Eric

Sending an email in the background falls outside of the scope of the plugin.  The plugin specifically only uses what is already setup on the device in terms of email.  It does not try to configure any email account settings etc. to send under a different identity.


Added progress indication when downloading mbtiles

even if it is a % in the info it will be better than nothing. Progressbar would be ideal.

Added % when selecting tileset that is currently downloading.


Debian packaging scripts are missing in tedge debian package

Describe the bug
Observation is that preinst postinst and prerm scripts are missing in the tedge debian package.
The other packages seem to be fine.
As a result tedge does not prepare and cleanup upon removal and installation.
We missed this probably for some time as purging and installing did not remove files, so the ones from the last installation got used.
Scripts seem to be there when we build manually, unclear if it is an issue in CI !
To Reproduce
Remove and install the package :)
Observe that users and groups are beeing crated and removed
cat /etc/group /etc/passwd | grep tedge
Otherwise, download, decompress and analyze the content of the DEBIAN folder.
https://github.com/thin-edge/thin-edge.io/actions/runs/1698585933
Scripts seem to be there when we build manually, unclear if it is an issue in CI !
Expected behavior
Packaging scripts are there.
Screenshots

Environment (please complete the following information):
Rpi 3B+ & PC
Additional context

Stopped to work with a recent cargo-deb version
$ cargo deb --version
1.29.0
$ cargo install cargo-deb
$ cargo deb --version
1.34.2

Was fixed with #765


Fix enabled file installed from horizon-extensions

Add the angularjs module containing the Rackspace Solutions
panel code to the Horizon application so it works.
Requires accompanying patch
https://github.com/rcbops/horizon-extensions/pull/7
for the panel to work with this change.
closes #891
(cherry picked from commit b535dcc490f56a54b92443172ad0b5828bc5a540)
Signed-off-by: Matthew Thode<EMAIL_ADDRESS>

recheck

recheck_swift

recheck_swift

recheck_swift

recheck_swift

recheck_swift - repobuild fail

recheck_swift
recheck_ceph

recheck_swift
recheck_ceph

should we care about the upgrade job for a 12.0 commit?

@prometheanfire we can ignore the upgrade job on this branch as it won't work - the upgrade related work is only on the master branch right now.
Based on that, and the fact this is a straight up cherry-pick :+1:

ok, since I only backported here's my :+1:
I would still like confirmation that I am allowed to +1 a backport that I backported (as it wasn't my commit) maybe only clean backports?

:+1:


parseInt: value out of range exception while adding data points using graphite protocol

The timestamp I'm trying to send is in millis.
Shouldn't "math/big" package be used instead of "strconv" package for parsing long integers ?
Ref : https://github.com/influxdb/influxdb/blob/master/graphite/graphite.go#L81

Can you please provide the logs which show this error occurring? Are you running 0.9? If so, what version?

Influx version : 0.8.8
Data : sample.falkonry.internal.PNT004<PHONE_NUMBER>738380
Log : [2015/03/09 10:37:16 IST] [EROR] (github.com/influxdb/influxdb/api/graphite.(*Server).handleClient:261) GraphiteServer:%!(EXTRA *strconv.NumError=strconv.ParseUint: parsing "142560000099": value out of range)
[2015/03/09 10:37:16 IST] [DEBG] (github.com/influxdb/influxdb/api/graphite.(*Server).handleClient:258) GraphiteServer: Client closed graphite connection


Trying to install pymongoarrow on aws linux 2

Having updated pip to latest version and installed libbson with yum I am still getting the following error any pointers would be great
The exit code: 1 The error output of the command: Collecting pymongoarrow~=1.5.0 Using cached pymongoarrow-1.5.0.tar.gz (59 kB) Installing build dependencies: started Installing build dependencies: finished with status 'done' Getting requirements to build wheel: started Getting requirements to build wheel: finished with status 'error' error: subprocess-exited-with-error × Getting requirements to build wheel did not run successfully. │ exit code: 1 ╰─> [25 lines of output] Compiling pymongoarrow/lib.pyx because it changed. [1/1] Cythonizing pymongoarrow/lib.pyx  :28: UserWarning: Package libbson-1.0 was not found in the pkg-config search path. Perhaps you should add the directory containing `libbson-1.0.pc' to the PKG_CONFIG_PATH environment variable No package 'libbson-1.0' found Traceback (most recent call last): File "/home/ec2-user/.virtualenvs/database_flattening/lib/python3.10/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 353, in   main() File "/home/ec2-user/.virtualenvs/database_flattening/lib/python3.10/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 335, in main json_out['return_val'] = hook(**hook_input['kwargs']) File "/home/ec2-user/.virtualenvs/database_flattening/lib/python3.10/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 118, in get_requires_for_build_wheel return hook(config_settings) File "/tmp/pip-build-env-t_745ygk/overlay/lib/python3.10/site-packages/setuptools/build_meta.py", line 327, in get_requires_for_build_wheel return self._get_build_requires(config_settings, requirements=[]) File "/tmp/pip-build-env-t_745ygk/overlay/lib/python3.10/site-packages/setuptools/build_meta.py", line 297, in _get_build_requires self.run_setup() File "/tmp/pip-build-env-t_745ygk/overlay/lib/python3.10/site-packages/setuptools/build_meta.py", line 497, in run_setup super().run_setup(setup_script=setup_script) File "/tmp/pip-build-env-t_745ygk/overlay/lib/python3.10/site-packages/setuptools/build_meta.py", line 313, in run_setup exec(code, locals()) File " ", line 175, in   File " ", line 169, in get_extension_modules File " ", line 105, in append_libbson_flags ValueError: Could not find "libbson-1.0" library [end of output] note: This error originates from a subprocess, and is likely not a problem with pip. error: subprocess-exited-with-error × Getting requirements to build wheel did not run successfully. │ exit code: 1 ╰─> See above for output. note: This error originates from a subprocess, and is likely not a problem with pip. Non-zero exit code (1)

yum install libbson

On 13 Aug 2024, at 12:48, Steven Silvester @.***> wrote:
Hi @covatic-john https://github.com/covatic-john, I'm trying to reproduce your setup on an amazonlinux:2 docker image. What steps did you use to install libbson? amazonlinux is not one of the supported platforms: https://mongoc.org/libmongoc/1.17.0/installing.html#install-libbson-with-a-package-manager.
—
Reply to this email directly, view it on GitHub https://github.com/mongodb-labs/mongo-arrow/issues/231#issuecomment-2286052779, or unsubscribe https://github.com/notifications/unsubscribe-auth/BC3KZVMN7WZGRUPE2JBMSXLZRHXATAVCNFSM6AAAAABMMIXMGGVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDEOBWGA2TENZXHE.
You are receiving this because you were mentioned.

--
This email and any attachments are confidential, may contain privileged
material and are intended solely for the use of the individual to whom it
is addressed. Any views or opinions expressed are solely those of the
author and do not necessarily represent those of Covatic. If you are not
the intended recipient of this email, you must neither take any action
based upon its content, nor copy nor show it to anyone.
Covatic is a
limited company registered in England & Wales. Registration number:
10422855. Registered office: 412-413 Scott House, The Custard Factory, Gibb
Street, Birmingham, B9 4AA.

Do you have any extra sources configured?  When I tried that from the docker image I get: No package libbson available..  I ran:
docker run -it amazonlinux:2 /bin/bash
$ yum update
$ yum install libbson
Loaded plugins: ovl, priorities
No package libbson available.
Error: Nothing to do

Sorry. been on Annual leave and stacked out. I'll go back and see what I tried to get it working. I may may give up on this as AWS linux 2 hits end of life next year


Mat-radio-group selects another radio beside clicked one

Reproduction
Here you can see code:

https://stackblitz.com/edit/components-issue-2vg68d

Expected Behavior
Should select clicked one
Actual Behavior
E.g. When clicked first, second one is getting selected too
Environment

Angular: 7.0.2
CDK/Material: 8.1.3
Browser: Chrome
Operating System  Windows

Since your array is made of primitives, ngFor is unsure how to track the repeated elements. E.g. When both rows are "a", then ngFor sees them as equal.
To fix this, add a trackBy function to tell ngFor to track by index instead of reference.
In addition, switch from ngModel to explicitly defining the value of the toggles and responding to the changes by modifying your array.
https://stackblitz.com/edit/components-issue-hymcru?file=app/app.component.html


Backing source not available. Verify backing source settings.

Hi,
I have configured the back source node in config.ncconfig as below:
<configuration>
<cache-config cache-name="TestCacheName">
...
<backing-source>
<read-thru enable-read-thru="True">
<provider provider-name="sqlreadthruprovider" assembly-name="BackingSource.Providers.Sql, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=null" class-name="Alachisoft.NCache.Samples.Providers.SqlReadThruProvider" full-name="BackingSource.Providers.Sql.dll" default-provider="False">
<parameters name="connstring" value="Data Source=localhost;Database=northwind;User Id=admin;password=xxxxxxxx;"/>
</provider>
</read-thru>
</backing-source>
</cache-config>
</configuration>
And deploy the read through provider under NCache/deploy/TestCacheName folder.
But the read through is not working: error is Backing source not available. Verify backing source settings.
Does anyone know how to make Read through work with open source edition?

Hi @PagePinner , can you share some more details.
Please share snippets of the Cache logs where this error is logged if they're being created. Where are you getting the error "Backing source not available. Verify backing source settings.". You can even attach the complete log file as well.

It is working now. I put backing-source node under the wrong node.  Should be under  Thanks.


Run golangci-lint on generated files

As mentioned in #395, golangci-lint does not run on generated files. This PR adds a hack that removes the "generated by" comments before running golangci-lint in the CI staticcheck test. This should trick it into examining them. I expect this PR's CI checks to fail until these findings are fixed, probably in other PRs.

nice hack, will fix in separate PR 👍


[KOGITO-5674] Improve error reporting related to kogito-legacy-api

https://issues.redhat.com/browse/KOGITO-5674
At the moment, if users try to use a legacy use case (ruleflowgroup in a process or kieSession in DRL) must include kogito-legacy-api as dependency.
This is not enforced at the moment and the compilation might fail with a very cryptic message like compilation failure in one of the generated classes (i.e. KOGITO-5643).
This PR introduces a similar check both for processes and rules
Many thanks for submitting your Pull Request :heart:!
Please make sure that your PR meets the following requirements:

[ ] You have read the contributors guide
[ ] Your code is properly formatted according to this configuration
[ ] Pull Request title is properly formatted: KOGITO-XYZ Subject
[ ] Pull Request title contains the target branch if not targeting main: [0.9.x] KOGITO-XYZ Subject
[ ] Pull Request contains link to the JIRA issue
[ ] Pull Request contains link to any dependent or related Pull Request
[ ] Pull Request contains description of the issue
[ ] Pull Request does not include fixes for issues other than the main ticket

How to retest this PR or trigger a specific build:

Run all builds
Please add comment: Jenkins retest this

Run (or rerun) specific test(s)
Please add comment: Jenkins (re)run [runtimes|optaplanner|apps|examples] tests

Quarkus LTS checks
Please add comment: Jenkins run LTS

Run (or rerun) LTS specific test(s)
Please add comment: Jenkins (re)run [runtimes|optaplanner|apps|examples] LTS

Native checks
Please add comment: Jenkins run native

Run (or rerun) native specific test(s)
Please add comment: Jenkins (re)run [runtimes|optaplanner|apps|examples] native

Full Kogito testing (with cloud images and operator BDD testing)
Please add comment: Jenkins run BDD
This check should be used only if a big change is done as it takes time to run, need resources and one full BDD tests check can be done at a time ...

The (build) Runtimes check has failed. Please check the logs.

The (build) Runtimes check has failed. Please check the logs.

The (build) Examples check has failed. Please check the logs.

The (build) Examples check has failed. Please check the logs.

The (build) Apps check has failed. Please check the logs.

Build is green, OptaPlanner cancelled job is an error at GitHub reporting level because it seems that there are two builds: one success and one cancelled


[bookie] InvalidCookieException on fresh install of Pulsar chart v3.0.0

Describe the bug
When initializing a new Pulsar cluster on k8s v1.22.17 the bookkeepers crashloop with InvalidCookieException.
pulsar-bookie 2023-02-09T12:41:47,136+0000 [main] ERROR org.apache.bookkeeper.server.Main - Failed to build bookie server pulsar-bookie org.apache.bookkeeper.bookie.BookieException$InvalidCookieException: instanceId 70fa10af-86ef-4ced-b307-75f998c2ab8d is not matching with 2024bf46-92f4-4

It's as if something has gone wrong with the initializing processes, wrong IDs that are stored in Zookeeper?
I have retried and made sure to delete previous PVCs and secrets between installs, to no avail.
To Reproduce
Our values file:
affinity:
  anti_affinity: true
  type: preferredDuringSchedulingIgnoredDuringExecution
auth:
  authentication:
    enabled: false
bookkeeper:
  replicaCount: 3
  resources:
    requests:
      cpu: 0.2
      memory: 1Gi
  volumes:
    journal:
      local_storage: false
      name: journal
      size: 10Gi
      storageClassName: idlab-ssd
    ledgers:
      local_storage: false
      name: ledgers
      size: 100Gi
      storageClassName: idlab-ssd
    persistence: true
broker:
  replicaCount: 3
  resources:
    requests:
      cpu: 0.2
      memory: 1Gi
components:
  autorecovery: true
  bookkeeper: true
  broker: true
  functions: false
  proxy: false
  pulsar_manager: false
  toolset: true
  zookeeper: true
initialize: true
kube-prometheus-stack:
  enabled: false
namespace: v3-pulsar
namespaceCreate: false
tls:
  enabled: false
toolset:
  useProxy: false
volumes:
  local_storage: false
  persistence: true
zookeeper:
  replicaCount: 3
  resources:
    requests:
      cpu: 0.1
      memory: 256Mi
  volumes:
    data:
      local_storage: false
      name: data
      size: 20Gi
      storageClassName: idlab-ssd
    persistence: true

Steps to reproduce the behavior:

Create v1.22.x cluster
helm install pulsar apache/pulsar -f values.yaml
Check status of bookies

Expected behavior
Bookies come up and are initiated with a correct instance ID.
Desktop (please complete the following information):

k8s: v1.22.17
helm: v3.11.1

Additional context
I know we are deploying on a no longer supported version of Kubernetes, but this is to test an upgrade path for a "neglected" cluster in dire need of seemless upgrading.

Update: managed to resolve the issue but not sure what actually caused this. I ended up removing all resources from the namespace and rebooting all my cluster nodes, after which I was able to bring up a clean install. Seems that there must've been some hidden remnants that appeared deleted to the Kubernetes API but were in fact still present somehow?


cursor.execute returing error 'NoneType' object is not iterable

Whereas cursor.columns is working which shows that the connection with Databricks account is correct.

Uploading log file.
results.log

Output of cursor.columns -

@MrKushank Thank you for reporting this issue. I'd like to ask you for few things - it will help us a lot with debugging:

please share your script (minimal reproducible example)
if possible - try the same query using Nodejs connector or Go connector, and check if you have the same error or not.

Thank you!

import os, logging
from databricks import sql
import pandas as pd
logging.getLogger("databricks.sql").setLevel(logging.DEBUG)
logging.basicConfig(filename = "results.log",
level    = logging.DEBUG)
host = os.getenv("DATABRICKS_HOST")
http = os.getenv("DATABRICKS_HTTP_PATH")
token = os.getenv("DATABRICKS_TOKEN")
with sql.connect(server_hostname=host,
http_path=http,
auth_type="databricks-oauth") as connection:
with connection.cursor() as cursor:
#cursor.columns(schema_name="platforms", table_name="iop_import_sessions")
cursor.execute('SELECT * FROM samples.nyctaxi.trips LIMIT 2')
result = cursor.fetchall()
cursor.close()
for row in result:
print(row)

Meanwhile pyodbc worked -
import pyodbc
import os
conn = pyodbc.connect(
"Driver=Simba Spark ODBC Driver;" +
f"Host={os.getenv('DATABRICKS_HOST')};" +
"Port=443;" +
f"HTTPPath={os.getenv('DATABRICKS_HTTP_PATH')};" +
"SSL=1;" +
"ThriftTransport=2;" +
"AuthMech=3;" +
"UID=token;" +
f"PWD={os.getenv('DATABRICKS_TOKEN')}",
autocommit = True
)

Thank you! I need some time to investigate this. Will get back to you soon

P.S. One more question: are you using AWS or Azure instance?

Microsoft Azure Databricks Instance.

@MrKushank I tried a lot, but unfortunately wasn't able to reproduce this issue. Few things that may differ in my case:

are you using sql warehouse or compute cluster?
which DBR version is it running?
are you trying to run that exact SQL query from your example?
are you trying to run the only SQL query which immediately fails, or there are other queries that succeed before the other one fails?

@MrKushank I tried a lot, but unfortunately wasn't able to reproduce this issue. Few things that may differ in my case:

are you using sql warehouse or compute cluster?  compute cluster
which DBR version is it running?  11.3 LTS (includes Apache Spark 3.3.0, Scala 2.12)
are you trying to run that exact SQL query from your example? yes and i have tried other queries as well and not working with cursor.execute. Although cursor.columns works.
are you trying to run the only SQL query which immediately fails, or there are other queries that succeed before the other one fails? every SQL query with cursor.execute fails. but cursor.columns works.

I recommend replacing your call to cursor.columns with a SHOW COLUMNS FROM :table query. The cursor.columns method has been flaky for awhile, but even when it works it's much slower than a SHOW COLUMNS query.

cursor.columns is working. problem is with cursor.execute.

@MrKushank Okay, so - seems it's a buggy behavior of CloudFetch feature in older DBR versions. I managed to reproduce this error in other connectors as well. I'll report it to a corresponding team. Meanwhile, the only workaround I can suggest is to pass use_cloud_fetch=False option to sql.connect(). Please try it and let me know if it helped

Yes, this helped. Thanks a lot.


Generate output HTML

What do you think about generate HTML output functionality in plugin - something like this ?

That is likely out of scope for this plugin right now. Perhaps in the future
However, I do plan to eventually add an option to generate the javascript connection (would get rid of this file as an example https://github.com/EMH333/esbuild-svelte/blob/main/example/entry.js). Still trying to flesh out the best API, but hopefully it will reduce the amount of boilerplate for simple use cases.

Maybe… I’m not sure too, just interesting idea for development behaviour 🤓 and there are  standalone plugins for html generation…


Issue processing backgrounder logs server version - 2020.2.4 (20202.20.0721.1350)

Hi, I am getting a number of errors in the backgrounder process. The produced workbook is blank. The repeated error I am getting is "Failed to process string as Backgrounder event. This is expected for logs prior to 10.4" Has anyone experienced this before? Have tried both running the full ziplog and just using the background plugin, same error occurs. Thanks

Hi,
Only the latest version of LogShark (4.2) published here is able to process Backgrounder logs from 2020.x. Plz make sure that you are running the latest version.
Similar issue was reported not that long ago (https://github.com/tableau/Logshark/issues/129) and the problem there was PATH variable pointing at the old version. One way to rule out all issues like that is to try the latest version of LogShark on the different machine that never had LogShark before.
If the issue still reproduces on 4.2 - please lmk.


Fix find and replace typo in dockerimages

fixes #17920
Thanks for reporting, @sbasyal

ping @jamtur01 @SvenDowideit @moxiegirl ptal :smile:

LGTM

danke!

author LGTM thanks!


Improve logger config

kept the logback.xml now for local custom logging config

@yanapanchenko please merge with devel if ok


Rename child-prefix to advertise-network

Instead of nexd --child-prefix rename it to --advertise-network.
This can be broken up into multiple PRs. One for the nexd agent side and one for the api-server schema. Feel free to close this and open two separate ones if you would prefer that or are only comfortable tackling the agent side.
An example of doing a database rename migration can be found here: https://github.com/nexodus-io/nexodus/blob/main/internal/database/migration_20230314_0000/20230314-0000.go
Note , in that example, I unnecessarily added all of the structs. You would only need to add the struct you are renaming. Feel free to ping @nerdalert with any questions!!

Hey, i'd like to attempt this.

Awesome! Thanks @cyneptic just hit me in Discord if you run into any issues!


marker shape

Hi
I you trying to use a marker shape as the following code, but the marker does not appear on the map.
$marker = new Marker();
$markerShape = new MarkerShape();
$markerShape->setPrefixJavascriptVariable('marker_shape_');
$markerShape->setType('poly');
$markerShape->setCoordinates(array(1, 1, 1, -1, -1, -1, -1, 1));
$marker->setShape($markerShape);
In addition, other markers with icons, also stop working. Can you help me. Maybe I'm doing something wrong.
Thank you and best regards

Here, a functional test using a marker shape: https://github.com/egeloen/ivory-google-map/blob/master/tests/Helper/Functional/Overlay/MarkerFunctionalTest.php#L73-L84


[jvm-packages] training failed at XGBoost$.postTrackerReturnProcessing

For bugs or installation issues, please provide the following information.
The more information you provide, the more easily we will be able to offer
help and advice.
So I was training a model from hdfs json files. I used spark.sql.dataframe. I first processed the data with my own feature processing. Then the data is a dataframe of label and features( dense vector):
+------+------
| label   | features             |
| 1.0     |  [1.0,20.0,20.0] |
Every time I started training, it threw exceptions like below:
2017-10-10T09:34:25.682 INFO  [XGBoostSpark] - Rabit returns with exit code 1
Exception in thread "main" ml.dmlc.xgboost4j.java.XGBoostError: XGBoostModel training failed
at ml.dmlc.xgboost4j.scala.spark.XGBoost$.postTrackerReturnProcessing(XGBoost.scala:363)
at ml.dmlc.xgboost4j.scala.spark.XGBoost$.trainDistributed(XGBoost.scala:334)
at ml.dmlc.xgboost4j.scala.spark.XGBoostEstimator.train(XGBoostEstimator.scala:139)
at ml.dmlc.xgboost4j.scala.spark.XGBoostEstimator.train(XGBoostEstimator.scala:36)
at org.apache.spark.ml.Predictor.fit(Predictor.scala:90)
at ml.dmlc.xgboost4j.scala.spark.XGBoost$.trainWithDataFrame(XGBoost.scala:191)
at com.netease.epay.rm.XGboostTrain$.main(XGboostTrain.scala:111)
at com.netease.epay.rm.XGboostTrain.main(XGboostTrain.scala)
2017-10-10T09:34:25.692 ERROR [ml.dmlc.xgboost4j.java.RabitTracker] - Uncaught exception thrown by worker:
java.lang.InterruptedException
at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1302)
at scala.concurrent.impl.Promise$DefaultPromise.tryAwait(Promise.scala:202)
at scala.concurrent.impl.Promise$DefaultPromise.ready(Promise.scala:218)
at scala.concurrent.impl.Promise$DefaultPromise.ready(Promise.scala:153)
at org.apache.spark.scheduler.DAGScheduler.runJob(DAGScheduler.scala:623)
at org.apache.spark.SparkContext.runJob(SparkContext.scala:1873)
at org.apache.spark.SparkContext.runJob(SparkContext.scala:1886)
at org.apache.spark.SparkContext.runJob(SparkContext.scala:1899)
at org.apache.spark.SparkContext.runJob(SparkContext.scala:1913)
at org.apache.spark.rdd.RDD$$anonfun$foreachPartition$1.apply(RDD.scala:902)
at org.apache.spark.rdd.RDD$$anonfun$foreachPartition$1.apply(RDD.scala:900)
at org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:151)
at org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:112)
at org.apache.spark.rdd.RDD.withScope(RDD.scala:358)
at org.apache.spark.rdd.RDD.foreachPartition(RDD.scala:900)
at ml.dmlc.xgboost4j.scala.spark.XGBoost$$anon$1.run(XGBoost.scala:326)
[Stage 2:>                                                          (0 + 1) / 4]
Environment info
Operating System: macOS, Siera 10.12.6
Compiler: CXX="/usr/local/Cellar/gcc/7.2.0/bin/g++-7"
Package used (python/R/jvm/C++): jvm
xgboost version used: 0.7
Steps to reproduce
The code to reproduce:
val inputPath = "/path/to/data"
// create SparkSession
val spark = SparkSession
  .builder()
  .appName("SimpleXGBoost Application")
  .config("spark.executor.memory", "1G")
  .config("spark.executor.cores", "2")
  .config("spark.driver.memory", "1G")
  .config("spark.serializer", "org.apache.spark.serializer.KryoSerializer")
  .config("spark.default.parallelism", "4")
  .master("local[1]")
  .getOrCreate()

val now = Calendar.getInstance()
val date = java.time.LocalDate.now
val currentHour = now.get(Calendar.HOUR_OF_DAY)
val currentMinute = now.get(Calendar.MINUTE)
val direct = "/Users/SamJia/Desktop/test/results/" + date + "-" + currentHour + "-" + currentMinute + "/"
println(direct)

val trainDataSet: DataFrame = spark.read.json(inputPath)
trainDataSet.cache()
/* transform convert dataframe to dataframe of label and features
val df : DataFrame = transform(trainDataSet, spark)
val Array(trainingDataSplit, testDataSplit) = df.randomSplit(Array(0.8, 0.2), seed = 0)

// number of iterations
val numRound = 10
val numWorkers = 4
// training parameters
val paramMap = List(
  "eta" -> 0.023f,
  "max_depth" -> 10,
  "min_child_weight" -> 3.0,
  "subsample" -> 1.0,
  "colsample_bytree" -> 0.82,
  "colsample_bylevel" -> 0.9,
  "base_score" -> 0.005,
  "eval_metric" -> "auc",
  "seed" -> 49,
  "silent" -> 1,
  "objective" -> "binary:logistic").toMap
println("Starting Xgboost ")
val xgBoostModelWithDF = XGBoost.trainWithDataFrame(trainingDataSplit, paramMap,round = numRound, nWorkers = numWorkers, useExternalMemory = true)
val predictions = xgBoostModelWithDF.setExternalMemory(true).transform(testDataSplit).select("label", "probabilities")

Can someone help look at the problem?

Are you running in local mode or on YARN/Mesos? If the latter, could you attach all the logs for the job?

This is a "local[1]", these are all the log I got from the console.

How long does it take to fail? Are you running this locally on a Mac?
I actually had some networking issues running the Spark package in local mode on a mac. The workers could not connect to the rabit tracker at <user>-MBP.local/<IP_ADDRESS>. It has no problem connecting to localhost/<IP_ADDRESS>, though.

It was not long before the process failed. I was running on local Mac. So I could change rabit tracker?

Can you include the full log?

You want info log included? superbobry?
I will run it tomorrow and get the log attached.

Yep, I want everything which is printed/logged before the failure.

I ran this program again, but this time it did not throw the previous exception. It hang for infinitely long and went to sleep.
logs as below:
2017-11-06 21:04:46 INFO  FileScanRDD:54 - Reading File path: file:///Users/SamJia/Desktop/test/20170728-16_10_07/part-r-00287-3ed9f28d-d1e3-4f05-8497-0f1f7bbb09be.json, range: 0-45369, partition values: [empty row]
2017-11-06 21:04:46 INFO  MemoryStore:54 - Block rdd_5_11 stored as values in memory (estimated size 296.5 KB, free 1938.0 MB)
2017-11-06 21:04:46 INFO  BlockManagerInfo:54 - Added rdd_5_11 in memory on <IP_ADDRESS>:57928 (size: 296.5 KB, free: 1938.4 MB)
2017-11-06 21:04:46 INFO  Executor:54 - Finished task 11.0 in stage 1.0 (TID 299). 2820 bytes result sent to driver
2017-11-06 21:04:46 INFO  TaskSetManager:54 - Finished task 11.0 in stage 1.0 (TID 299) in 105 ms on localhost (12/12)
2017-11-06 21:04:46 INFO  TaskSchedulerImpl:54 - Removed TaskSet 1.0, whose tasks have all completed, from pool
2017-11-06 21:04:46 INFO  DAGScheduler:54 - ShuffleMapStage 1 (repartition at XGBoost.scala:109) finished in 27.199 s
2017-11-06 21:04:46 INFO  DAGScheduler:54 - looking for newly runnable stages
2017-11-06 21:04:46 INFO  DAGScheduler:54 - running: Set()
2017-11-06 21:04:46 INFO  DAGScheduler:54 - waiting: Set(ResultStage 2)
2017-11-06 21:04:46 INFO  DAGScheduler:54 - failed: Set()
2017-11-06 21:04:46 INFO  DAGScheduler:54 - Submitting ResultStage 2 (ZippedPartitionsRDD2[22] at zipPartitions at XGBoost.scala:118), which has no missing parents
2017-11-06 21:04:46 INFO  MemoryStore:54 - Block broadcast_4 stored as values in memory (estimated size 6.2 KB, free 1938.0 MB)
2017-11-06 21:04:46 INFO  MemoryStore:54 - Block broadcast_4_piece0 stored as bytes in memory (estimated size 3.8 KB, free 1938.0 MB)
2017-11-06 21:04:46 INFO  BlockManagerInfo:54 - Added broadcast_4_piece0 in memory on <IP_ADDRESS>:57928 (size: 3.8 KB, free: 1938.4 MB)
2017-11-06 21:04:46 INFO  SparkContext:54 - Created broadcast 4 from broadcast at DAGScheduler.scala:1012
2017-11-06 21:04:46 INFO  DAGScheduler:54 - Submitting 4 missing tasks from ResultStage 2 (ZippedPartitionsRDD2[22] at zipPartitions at XGBoost.scala:118)
2017-11-06 21:04:46 INFO  TaskSchedulerImpl:54 - Adding task set 2.0 with 4 tasks
2017-11-06 21:04:46 INFO  TaskSetManager:54 - Starting task 0.0 in stage 2.0 (TID 300, localhost, partition 0, ANY, 5759 bytes)
2017-11-06 21:04:46 INFO  Executor:54 - Running task 0.0 in stage 2.0 (TID 300)
2017-11-06 21:04:46 INFO  ShuffleBlockFetcherIterator:54 - Getting 12 non-empty blocks out of 12 blocks
2017-11-06 21:04:46 INFO  ShuffleBlockFetcherIterator:54 - Started 0 remote fetches in 4 ms
2017-11-06 21:34:08 INFO  BlockManagerInfo:54 - Removed broadcast_3_piece0 on <IP_ADDRESS>:57928 in memory (size: 60.4 KB, free: 1938.4 MB)

The previous log was too long, so I deleted majority of my partitions to reduce log size. Below is the full log until going to sleep:
2017-11-07 08:53:43 INFO  SparkContext:54 - Running Spark version 2.0.2
2017-11-07 08:53:43 WARN  NativeCodeLoader:62 - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2017-11-07 08:53:43 INFO  SecurityManager:54 - Changing view acls to: SamJia
2017-11-07 08:53:43 INFO  SecurityManager:54 - Changing modify acls to: SamJia
2017-11-07 08:53:43 INFO  SecurityManager:54 - Changing view acls groups to:
2017-11-07 08:53:43 INFO  SecurityManager:54 - Changing modify acls groups to:
2017-11-07 08:53:43 INFO  SecurityManager:54 - SecurityManager: authentication disabled; ui acls disabled; users  with view permissions: Set(SamJia); groups with view permissions: Set(); users  with modify permissions: Set(SamJia); groups with modify permissions: Set()
2017-11-07 08:53:44 INFO  Utils:54 - Successfully started service 'sparkDriver' on port 63313.
2017-11-07 08:53:44 INFO  SparkEnv:54 - Registering MapOutputTracker
2017-11-07 08:53:44 INFO  SparkEnv:54 - Registering BlockManagerMaster
2017-11-07 08:53:44 INFO  DiskBlockManager:54 - Created local directory at /private/var/folders/jq/ky_9nq_14qz100gmg2fxsf_h0000gn/T/blockmgr-10d7dc21-8b1d-422f-92a0-5e555bdae63f
2017-11-07 08:53:44 INFO  MemoryStore:54 - MemoryStore started with capacity 2004.6 MB
2017-11-07 08:53:44 INFO  SparkEnv:54 - Registering OutputCommitCoordinator
2017-11-07 08:53:44 INFO  log:186 - Logging initialized @2709ms
2017-11-07 08:53:44 INFO  Server:327 - jetty-9.2.z-SNAPSHOT
2017-11-07 08:53:44 INFO  ContextHandler:744 - Started o.s.j.s.ServletContextHandler@3f07b12c{/jobs,null,AVAILABLE}
2017-11-07 08:53:44 INFO  ContextHandler:744 - Started o.s.j.s.ServletContextHandler@4bd1f8dd{/jobs/json,null,AVAILABLE}
2017-11-07 08:53:44 INFO  ContextHandler:744 - Started o.s.j.s.ServletContextHandler@7096b474{/jobs/job,null,AVAILABLE}
2017-11-07 08:53:44 INFO  ContextHandler:744 - Started o.s.j.s.ServletContextHandler@3e14c16d{/jobs/job/json,null,AVAILABLE}
2017-11-07 08:53:44 INFO  ContextHandler:744 - Started o.s.j.s.ServletContextHandler@3c989952{/stages,null,AVAILABLE}
2017-11-07 08:53:44 INFO  ContextHandler:744 - Started o.s.j.s.ServletContextHandler@784b990c{/stages/json,null,AVAILABLE}
2017-11-07 08:53:44 INFO  ContextHandler:744 - Started o.s.j.s.ServletContextHandler@3d3ba765{/stages/stage,null,AVAILABLE}
2017-11-07 08:53:44 INFO  ContextHandler:744 - Started o.s.j.s.ServletContextHandler@25bc0606{/stages/stage/json,null,AVAILABLE}
2017-11-07 08:53:44 INFO  ContextHandler:744 - Started o.s.j.s.ServletContextHandler@5d1659ea{/stages/pool,null,AVAILABLE}
2017-11-07 08:53:44 INFO  ContextHandler:744 - Started o.s.j.s.ServletContextHandler@793138bd{/stages/pool/json,null,AVAILABLE}
2017-11-07 08:53:44 INFO  ContextHandler:744 - Started o.s.j.s.ServletContextHandler@1951b871{/storage,null,AVAILABLE}
2017-11-07 08:53:44 INFO  ContextHandler:744 - Started o.s.j.s.ServletContextHandler@5c18016b{/storage/json,null,AVAILABLE}
2017-11-07 08:53:44 INFO  ContextHandler:744 - Started o.s.j.s.ServletContextHandler@33aeca0b{/storage/rdd,null,AVAILABLE}
2017-11-07 08:53:44 INFO  ContextHandler:744 - Started o.s.j.s.ServletContextHandler@43aaf813{/storage/rdd/json,null,AVAILABLE}
2017-11-07 08:53:44 INFO  ContextHandler:744 - Started o.s.j.s.ServletContextHandler@57ac5227{/environment,null,AVAILABLE}
2017-11-07 08:53:44 INFO  ContextHandler:744 - Started o.s.j.s.ServletContextHandler@4ba302e0{/environment/json,null,AVAILABLE}
2017-11-07 08:53:44 INFO  ContextHandler:744 - Started o.s.j.s.ServletContextHandler@e98770d{/executors,null,AVAILABLE}
2017-11-07 08:53:44 INFO  ContextHandler:744 - Started o.s.j.s.ServletContextHandler@1ae67cad{/executors/json,null,AVAILABLE}
2017-11-07 08:53:44 INFO  ContextHandler:744 - Started o.s.j.s.ServletContextHandler@2f6e28bc{/executors/threadDump,null,AVAILABLE}
2017-11-07 08:53:44 INFO  ContextHandler:744 - Started o.s.j.s.ServletContextHandler@7c098bb3{/executors/threadDump/json,null,AVAILABLE}
2017-11-07 08:53:44 INFO  ContextHandler:744 - Started o.s.j.s.ServletContextHandler@31e4bb20{/static,null,AVAILABLE}
2017-11-07 08:53:44 INFO  ContextHandler:744 - Started o.s.j.s.ServletContextHandler@18cebaa5{/,null,AVAILABLE}
2017-11-07 08:53:44 INFO  ContextHandler:744 - Started o.s.j.s.ServletContextHandler@463b4ac8{/api,null,AVAILABLE}
2017-11-07 08:53:44 INFO  ContextHandler:744 - Started o.s.j.s.ServletContextHandler@765f05af{/stages/stage/kill,null,AVAILABLE}
2017-11-07 08:53:44 INFO  ServerConnector:266 - Started ServerConnector@aa549e5{HTTP/1.1}{<IP_ADDRESS>:4040}
2017-11-07 08:53:44 INFO  Server:379 - Started @2851ms
2017-11-07 08:53:44 INFO  Utils:54 - Successfully started service 'SparkUI' on port 4040.
2017-11-07 08:53:44 INFO  SparkUI:54 - Bound SparkUI to <IP_ADDRESS>, and started at http://<IP_ADDRESS>:4040
2017-11-07 08:53:44 INFO  Executor:54 - Starting executor ID driver on host localhost
2017-11-07 08:53:44 INFO  Utils:54 - Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 63314.
2017-11-07 08:53:44 INFO  NettyBlockTransferService:54 - Server created on <IP_ADDRESS>:63314
2017-11-07 08:53:44 INFO  BlockManagerMaster:54 - Registering BlockManager BlockManagerId(driver, <IP_ADDRESS>, 63314)
2017-11-07 08:53:44 INFO  BlockManagerMasterEndpoint:54 - Registering block manager <IP_ADDRESS>:63314 with 2004.6 MB RAM, BlockManagerId(driver, <IP_ADDRESS>, 63314)
2017-11-07 08:53:44 INFO  BlockManagerMaster:54 - Registered BlockManager BlockManagerId(driver, <IP_ADDRESS>, 63314)
2017-11-07 08:53:44 INFO  ContextHandler:744 - Started o.s.j.s.ServletContextHandler@733c423e{/metrics/json,null,AVAILABLE}
2017-11-07 08:53:44 WARN  SparkContext:66 - Use an existing SparkContext, some configuration may not take effect.
2017-11-07 08:53:44 INFO  ContextHandler:744 - Started o.s.j.s.ServletContextHandler@173b9122{/SQL,null,AVAILABLE}
2017-11-07 08:53:44 INFO  ContextHandler:744 - Started o.s.j.s.ServletContextHandler@7646731d{/SQL/json,null,AVAILABLE}
2017-11-07 08:53:44 INFO  ContextHandler:744 - Started o.s.j.s.ServletContextHandler@2449cff7{/SQL/execution,null,AVAILABLE}
2017-11-07 08:53:44 INFO  ContextHandler:744 - Started o.s.j.s.ServletContextHandler@62da83ed{/SQL/execution/json,null,AVAILABLE}
2017-11-07 08:53:44 INFO  ContextHandler:744 - Started o.s.j.s.ServletContextHandler@6b9267b{/static/sql,null,AVAILABLE}
2017-11-07 08:53:45 INFO  SharedState:54 - Warehouse path is 'file:/Users/SamJia/Desktop/antifraud_engineering/dubbo-test/spark-warehouse'.
/Users/SamJia/Desktop/test/results/2017-11-07-8-53/
2017-11-07 08:53:45 INFO  MemoryStore:54 - Block broadcast_0 stored as values in memory (estimated size 146.0 KB, free 2004.5 MB)
2017-11-07 08:53:45 INFO  MemoryStore:54 - Block broadcast_0_piece0 stored as bytes in memory (estimated size 16.4 KB, free 2004.4 MB)
2017-11-07 08:53:45 INFO  BlockManagerInfo:54 - Added broadcast_0_piece0 in memory on <IP_ADDRESS>:63314 (size: 16.4 KB, free: 2004.6 MB)
2017-11-07 08:53:45 INFO  SparkContext:54 - Created broadcast 0 from json at XGboostSingleThreadTest.scala:81
2017-11-07 08:53:46 INFO  FileInputFormat:253 - Total input paths to process : 1
2017-11-07 08:53:46 INFO  SparkContext:54 - Starting job: json at XGboostSingleThreadTest.scala:81
2017-11-07 08:53:46 INFO  DAGScheduler:54 - Got job 0 (json at XGboostSingleThreadTest.scala:81) with 2 output partitions
2017-11-07 08:53:46 INFO  DAGScheduler:54 - Final stage: ResultStage 0 (json at XGboostSingleThreadTest.scala:81)
2017-11-07 08:53:46 INFO  DAGScheduler:54 - Parents of final stage: List()
2017-11-07 08:53:46 INFO  DAGScheduler:54 - Missing parents: List()
2017-11-07 08:53:46 INFO  DAGScheduler:54 - Submitting ResultStage 0 (MapPartitionsRDD[2] at json at XGboostSingleThreadTest.scala:81), which has no missing parents
2017-11-07 08:53:46 INFO  MemoryStore:54 - Block broadcast_1 stored as values in memory (estimated size 5.5 KB, free 2004.4 MB)
2017-11-07 08:53:46 INFO  MemoryStore:54 - Block broadcast_1_piece0 stored as bytes in memory (estimated size 3.4 KB, free 2004.4 MB)
2017-11-07 08:53:46 INFO  BlockManagerInfo:54 - Added broadcast_1_piece0 in memory on <IP_ADDRESS>:63314 (size: 3.4 KB, free: 2004.6 MB)
2017-11-07 08:53:46 INFO  SparkContext:54 - Created broadcast 1 from broadcast at DAGScheduler.scala:1012
2017-11-07 08:53:46 INFO  DAGScheduler:54 - Submitting 2 missing tasks from ResultStage 0 (MapPartitionsRDD[2] at json at XGboostSingleThreadTest.scala:81)
2017-11-07 08:53:46 INFO  TaskSchedulerImpl:54 - Adding task set 0.0 with 2 tasks
2017-11-07 08:53:46 INFO  TaskSetManager:54 - Starting task 0.0 in stage 0.0 (TID 0, localhost, partition 0, PROCESS_LOCAL, 5468 bytes)
2017-11-07 08:53:46 INFO  Executor:54 - Running task 0.0 in stage 0.0 (TID 0)
2017-11-07 08:53:46 INFO  HadoopRDD:54 - Input split: file:/Users/SamJia/Desktop/test/20170728-16_10_07/part-r-00000-3ed9f28d-d1e3-4f05-8497-0f1f7bbb09be.json:0+646885
2017-11-07 08:53:46 INFO  deprecation:996 - mapred.tip.id is deprecated. Instead, use mapreduce.task.id
2017-11-07 08:53:46 INFO  deprecation:996 - mapred.task.id is deprecated. Instead, use mapreduce.task.attempt.id
2017-11-07 08:53:46 INFO  deprecation:996 - mapred.task.is.map is deprecated. Instead, use mapreduce.task.ismap
2017-11-07 08:53:46 INFO  deprecation:996 - mapred.task.partition is deprecated. Instead, use mapreduce.task.partition
2017-11-07 08:53:46 INFO  deprecation:996 - mapred.job.id is deprecated. Instead, use mapreduce.job.id
2017-11-07 08:53:46 INFO  Executor:54 - Finished task 0.0 in stage 0.0 (TID 0). 9024 bytes result sent to driver
2017-11-07 08:53:46 INFO  TaskSetManager:54 - Starting task 1.0 in stage 0.0 (TID 1, localhost, partition 1, PROCESS_LOCAL, 5468 bytes)
2017-11-07 08:53:46 INFO  Executor:54 - Running task 1.0 in stage 0.0 (TID 1)
2017-11-07 08:53:46 INFO  HadoopRDD:54 - Input split: file:/Users/SamJia/Desktop/test/20170728-16_10_07/part-r-00000-3ed9f28d-d1e3-4f05-8497-0f1f7bbb09be.json:646885+646886
2017-11-07 08:53:46 INFO  TaskSetManager:54 - Finished task 0.0 in stage 0.0 (TID 0) in 265 ms on localhost (1/2)
2017-11-07 08:53:46 INFO  Executor:54 - Finished task 1.0 in stage 0.0 (TID 1). 9061 bytes result sent to driver
2017-11-07 08:53:46 INFO  TaskSetManager:54 - Finished task 1.0 in stage 0.0 (TID 1) in 70 ms on localhost (2/2)
2017-11-07 08:53:46 INFO  DAGScheduler:54 - ResultStage 0 (json at XGboostSingleThreadTest.scala:81) finished in 0.329 s
2017-11-07 08:53:46 INFO  TaskSchedulerImpl:54 - Removed TaskSet 0.0, whose tasks have all completed, from pool
2017-11-07 08:53:46 INFO  DAGScheduler:54 - Job 0 finished: json at XGboostSingleThreadTest.scala:81, took 0.414902 s
2017-11-07 08:53:47 INFO  BlockManagerInfo:54 - Removed broadcast_1_piece0 on <IP_ADDRESS>:63314 in memory (size: 3.4 KB, free: 2004.6 MB)
2017-11-07 08:53:48 INFO  FileSourceStrategy:54 - Pruning directories with:
2017-11-07 08:53:48 INFO  FileSourceStrategy:54 - Post-Scan Filters:
2017-11-07 08:53:48 INFO  FileSourceStrategy:54 - Pruned Data Schema: struct<X_Cnt_BindAccount_ID: string, X_Cnt_BindAccount_ID_24h: string, X_Cnt_BindAccount_ID_3h: string, X_Cnt_BindAccount_IP_24h: string, X_Cnt_BindAccount_Mobile: string ... 231 more fields>
2017-11-07 08:53:48 INFO  FileSourceStrategy:54 - Pushed Filters:
2017-11-07 08:53:48 INFO  MemoryStore:54 - Block broadcast_2 stored as values in memory (estimated size 145.4 KB, free 2004.3 MB)
2017-11-07 08:53:48 INFO  MemoryStore:54 - Block broadcast_2_piece0 stored as bytes in memory (estimated size 16.3 KB, free 2004.3 MB)
2017-11-07 08:53:48 INFO  BlockManagerInfo:54 - Added broadcast_2_piece0 in memory on <IP_ADDRESS>:63314 (size: 16.3 KB, free: 2004.6 MB)
2017-11-07 08:53:48 INFO  SparkContext:54 - Created broadcast 2 from cache at XGboostSingleThreadTest.scala:82
2017-11-07 08:53:48 INFO  FileSourceStrategy:54 - Planning scan with bin packing, max size: 4194304 bytes, open cost is considered as scanning 4194304 bytes.
2017-11-07 08:53:48 WARN  Utils:66 - Truncated the string representation of a plan since it was too large. This behavior can be adjusted by setting 'spark.debug.maxToStringFields' in SparkEnv.conf.
=========== Transform done
Starting Xgboost
2017-11-07 08:53:49 INFO  BlockManagerInfo:54 - Removed broadcast_0_piece0 on <IP_ADDRESS>:63314 in memory (size: 16.4 KB, free: 2004.6 MB)
2017-11-07 08:53:50 INFO  CodeGenerator:54 - Code generated in 257.761968 ms
Tracker started, with env={DMLC_NUM_SERVER=0, DMLC_TRACKER_URI=<IP_ADDRESS>, DMLC_TRACKER_PORT=9091, DMLC_NUM_WORKER=4}
2017-11-07 08:53:50 INFO  RabitTracker$TrackerProcessLogger:57 - 2017-11-07 08:53:50,459 INFO start listen on <IP_ADDRESS>:9091
2017-11-07 08:53:50 INFO  XGBoostSpark:108 - repartitioning training set to 4 partitions
2017-11-07 08:53:50 INFO  SparkContext:54 - Starting job: foreachPartition at XGBoost.scala:326
2017-11-07 08:53:50 INFO  DAGScheduler:54 - Registering RDD 17 (repartition at XGBoost.scala:109)
2017-11-07 08:53:50 INFO  DAGScheduler:54 - Got job 1 (foreachPartition at XGBoost.scala:326) with 4 output partitions
2017-11-07 08:53:50 INFO  DAGScheduler:54 - Final stage: ResultStage 2 (foreachPartition at XGBoost.scala:326)
2017-11-07 08:53:50 INFO  DAGScheduler:54 - Parents of final stage: List(ShuffleMapStage 1)
2017-11-07 08:53:50 INFO  DAGScheduler:54 - Missing parents: List(ShuffleMapStage 1)
2017-11-07 08:53:50 INFO  DAGScheduler:54 - Submitting ShuffleMapStage 1 (MapPartitionsRDD[17] at repartition at XGBoost.scala:109), which has no missing parents
2017-11-07 08:53:50 INFO  MemoryStore:54 - Block broadcast_3 stored as values in memory (estimated size 201.2 KB, free 2004.2 MB)
2017-11-07 08:53:50 INFO  MemoryStore:54 - Block broadcast_3_piece0 stored as bytes in memory (estimated size 60.1 KB, free 2004.2 MB)
2017-11-07 08:53:50 INFO  BlockManagerInfo:54 - Added broadcast_3_piece0 in memory on <IP_ADDRESS>:63314 (size: 60.1 KB, free: 2004.5 MB)
2017-11-07 08:53:50 INFO  SparkContext:54 - Created broadcast 3 from broadcast at DAGScheduler.scala:1012
2017-11-07 08:53:50 INFO  DAGScheduler:54 - Submitting 1 missing tasks from ShuffleMapStage 1 (MapPartitionsRDD[17] at repartition at XGBoost.scala:109)
2017-11-07 08:53:50 INFO  TaskSchedulerImpl:54 - Adding task set 1.0 with 1 tasks
2017-11-07 08:53:50 INFO  TaskSetManager:54 - Starting task 0.0 in stage 1.0 (TID 2, localhost, partition 0, PROCESS_LOCAL, 5976 bytes)
2017-11-07 08:53:50 INFO  Executor:54 - Running task 0.0 in stage 1.0 (TID 2)
2017-11-07 08:53:50 INFO  FileScanRDD:54 - Reading File path: file:///Users/SamJia/Desktop/test/20170728-16_10_07/part-r-00000-3ed9f28d-d1e3-4f05-8497-0f1f7bbb09be.json, range: 0-1293771, partition values: [empty row]
2017-11-07 08:53:50 INFO  CodeGenerator:54 - Code generated in 122.038477 ms
2017-11-07 08:53:50 INFO  MemoryStore:54 - Block rdd_5_0 stored as values in memory (estimated size 312.1 KB, free 2003.9 MB)
2017-11-07 08:53:50 INFO  BlockManagerInfo:54 - Added rdd_5_0 in memory on <IP_ADDRESS>:63314 (size: 312.1 KB, free: 2004.2 MB)
2017-11-07 08:53:51 INFO  CodeGenerator:54 - Code generated in 4.3222 ms
2017-11-07 08:53:51 INFO  CodeGenerator:54 - Code generated in 79.928029 ms
2017-11-07 08:53:51 INFO  CodeGenerator:54 - Code generated in 69.50777 ms
2017-11-07 08:53:51 INFO  CodeGenerator:54 - Code generated in 83.168369 ms
2017-11-07 08:53:51 INFO  CodeGenerator:54 - Code generated in 7.325556 ms
2017-11-07 08:53:51 INFO  CodeGenerator:54 - Code generated in 23.028841 ms
2017-11-07 08:53:51 INFO  CodeGenerator:54 - Code generated in 7.696399 ms
2017-11-07 08:53:51 INFO  CodeGenerator:54 - Code generated in 6.407725 ms
2017-11-07 08:53:51 INFO  CodeGenerator:54 - Code generated in 8.13226 ms
2017-11-07 08:53:51 INFO  Executor:54 - Finished task 0.0 in stage 1.0 (TID 2). 2893 bytes result sent to driver
2017-11-07 08:53:51 INFO  TaskSetManager:54 - Finished task 0.0 in stage 1.0 (TID 2) in 1307 ms on localhost (1/1)
2017-11-07 08:53:51 INFO  TaskSchedulerImpl:54 - Removed TaskSet 1.0, whose tasks have all completed, from pool
2017-11-07 08:53:51 INFO  DAGScheduler:54 - ShuffleMapStage 1 (repartition at XGBoost.scala:109) finished in 1.309 s
2017-11-07 08:53:51 INFO  DAGScheduler:54 - looking for newly runnable stages
2017-11-07 08:53:51 INFO  DAGScheduler:54 - running: Set()
2017-11-07 08:53:51 INFO  DAGScheduler:54 - waiting: Set(ResultStage 2)
2017-11-07 08:53:51 INFO  DAGScheduler:54 - failed: Set()
2017-11-07 08:53:51 INFO  DAGScheduler:54 - Submitting ResultStage 2 (ZippedPartitionsRDD2[22] at zipPartitions at XGBoost.scala:118), which has no missing parents
2017-11-07 08:53:51 INFO  MemoryStore:54 - Block broadcast_4 stored as values in memory (estimated size 6.2 KB, free 2003.9 MB)
2017-11-07 08:53:51 INFO  MemoryStore:54 - Block broadcast_4_piece0 stored as bytes in memory (estimated size 3.8 KB, free 2003.9 MB)
2017-11-07 08:53:51 INFO  BlockManagerInfo:54 - Added broadcast_4_piece0 in memory on <IP_ADDRESS>:63314 (size: 3.8 KB, free: 2004.2 MB)
2017-11-07 08:53:51 INFO  SparkContext:54 - Created broadcast 4 from broadcast at DAGScheduler.scala:1012
2017-11-07 08:53:51 INFO  DAGScheduler:54 - Submitting 4 missing tasks from ResultStage 2 (ZippedPartitionsRDD2[22] at zipPartitions at XGBoost.scala:118)
2017-11-07 08:53:51 INFO  TaskSchedulerImpl:54 - Adding task set 2.0 with 4 tasks
2017-11-07 08:53:51 INFO  TaskSetManager:54 - Starting task 0.0 in stage 2.0 (TID 3, localhost, partition 0, ANY, 5759 bytes)
2017-11-07 08:53:51 INFO  Executor:54 - Running task 0.0 in stage 2.0 (TID 3)
2017-11-07 08:53:51 INFO  ShuffleBlockFetcherIterator:54 - Getting 1 non-empty blocks out of 1 blocks
2017-11-07 08:53:51 INFO  ShuffleBlockFetcherIterator:54 - Started 0 remote fetches in 5 ms

If you use the Scala rabit tracker, does it time out?

How can I use Scala rabit tracker? Is there some configuration I need to change?

I know what I did wrong.I previously set the spark    .master("local[1]") and then val numWorkers = 4. Then I changed the spark config to master("local[2]") and set the numWorkers to be 2,  it works.
I did some test:
======= Successfully ==========
val spark = SparkSession
.builder()
.appName("SimpleXGBoost Application")
.config("spark.executor.memory", "1G")
.config("spark.executor.cores", "4")
.config("spark.driver.memory", "1G")
.config("spark.serializer", "org.apache.spark.serializer.KryoSerializer")
.config("spark.default.parallelism", "4")
.master("local[2]")
.getOrCreate()
val numWorkers = 2
====== WAITING =========
val spark = SparkSession
.builder()
.appName("SimpleXGBoost Application")
.config("spark.executor.memory", "1G")
.config("spark.executor.cores", "4")
.config("spark.driver.memory", "1G")
.config("spark.serializer", "org.apache.spark.serializer.KryoSerializer")
.config("spark.default.parallelism", "4")
.master("local[1]")
.getOrCreate()
val numWorkers = 2
====== Successfully =========
val spark = SparkSession
.builder()
.appName("SimpleXGBoost Application")
.config("spark.executor.memory", "1G")
.config("spark.executor.cores", "4")
.config("spark.driver.memory", "1G")
.config("spark.serializer", "org.apache.spark.serializer.KryoSerializer")
.config("spark.default.parallelism", "4")
.master("local[1]")
.getOrCreate()
val numWorkers = 1
====== WAITING ==========
val spark = SparkSession
.builder()
.appName("SimpleXGBoost Application")
.config("spark.executor.memory", "1G")
.config("spark.executor.cores", "4")
.config("spark.driver.memory", "1G")
.config("spark.serializer", "org.apache.spark.serializer.KryoSerializer")
.config("spark.default.parallelism", "4")
.master("local[2]")
.getOrCreate()
val numWorkers = 4
Does that mean the numWorkers should be equal to the number of threads running at local? Then if the numWorkers > number of threads, the process just waits?


Static class properties: [property name] is not defined error

Following this resolved issue I added eslint-parser to my configuration, and now static class properties are correctly parsed. Great. However, i'm running into another issue where I get a [property name] is not defined error.
Standard.js config:
"standard": {
    "ignore": [
      "__mocks__/**/*"
    ],
    "parser": "babel-eslint"
  }

Example code:
class Layout extends Component {
  static propTypes = {
    title: PropTypes.string,
    children: PropTypes.any
  }
}

Standars.js output
'propTypes' is not defined

Am I missing something? Is this already addressed?
Thank you.

Does the output actually read propTypes, not PropTypes? Keep in mind that you’ll need to import PropTypes from 'prop-types' since React v15.5 (see React’s docs).
Also, extend should be extends in your example.

@sonicdoe thanks much for the prompt response. I have indeed imported PropTypes via import PropTypes from 'prop-types' - corrected the extends typo in the issue as well.
I can verify that the issue is with lowercase propType

Your issue sounds similar to https://github.com/standard/standard/issues/1049. Are you using decorators by any chance?
If not, could you post a full example and your standard and babel-eslint version?

@sonicdoe Not using decorators.
Versions:
"babel-eslint": "^8.2.2",
"standard": "^10.0.3"

Standard.js config via package.json:
"standard": {
    "ignore": [
      "__mocks__/**/*"
    ],
    "parser": "babel-eslint"
  },

Example code:
/* Third Party */
import React, { Component, Fragment } from 'react'
import PropTypes from 'prop-types'
import Head from 'next/head'

export default class ArchitizerLayout extends Component {
  static propTypes = {
    title: PropTypes.string,
    children: PropTypes.any
  }

  static defaultProps = {
    title: 'Architizer'
  }

  render () {
    const {
      title,
      children
    } = this.props

    return (
      <Fragment>
        <Head>
          <title>
            { title }
          </title>
        </Head>
        { children }
      </Fragment>
    )
  }
}

As the example demonstrates, i'm using Next.js.
Thanks.

Thank you, I was now able to reproduce this issue. It seems like standard v11 fixes this (probably due to updating eslint from ~3.19.0 to ~4.18.0). Could you try updating standard?

@sonicdoe updating standard to 11 fixed it. Thank you! ✨

@sonicdoe Feel free to close this. 🙏


Selected color with alpha add extra colors

This is my java code:
public class JavaFxTest8 extends Application {

   @Override
    public void start(Stage primaryStage) {
        var text = """
                   aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
                   bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb
                   cccccccccccccccccccccccccccccccccccccccccccc
                   dddddddddddddddddddddddddddddddddddddddddddd
                   eeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee
                   """;
        var codeArea = new CodeArea(text);
        VBox.setVgrow(codeArea, Priority.ALWAYS);
        Scene scene = new Scene(new VBox(codeArea), 500, 200);
        var css= this.getClass().getResource("test8.css").toExternalForm();
        scene.getStylesheets().add(css);
        primaryStage.setScene(scene);
        primaryStage.show();
        codeArea.selectRange(30, 200);
    }

    public static void main(String[] args) {
        launch(args);
    }
}

This is CSS code:
.root {
    -fx-font-size: 16;
}
.styled-text-area {
    -fx-background-color: #666666;
}

.styled-text-area .main-selection {
    -fx-fill: rgba(255, 0, 0, 0.4);
}

And this is result:

As you see selected text is "underlined". Is this a bug or I do something wrong?

It looks like there's a single pixel space between each line, and that pixel is being colored red without the alpha being applied ???
Or maybe it's an overlap of one pixel with the alpha's being combined ???

So I've figured it out and it's coming from the overlap of the top highlight line with the one underneath it.
I've tried various ways of trying to get it perfectly aligned but there's always either a slight overlap or a slight gap ?
This problem is only noticeable when using a highlight color using an alpha component.
The relevant code section is in ParagraphText.getRangeShapeSafely
https://github.com/FXMisc/RichTextFX/blob/9695091c74d9b5adbd2e957027040ded76acca5c/richtextfx/src/main/java/org/fxmisc/richtext/ParagraphText.java#L353-L410


Schedule Finder: aria-controls fix-up

Summary of changes
Asana Ticket: No ticket
Noticed a missing id for an aria-controls element when looking over my PR from last week.

Assigned to: @phildarnowsky

@phildarnowsky I rebased out those commits


React & Redux group project: Project setup

React & Redux group project
In this pull request we have setup the project using create-react-app  and installed all dependencies

Hi @jeanbuhendwa.
Your work is complete, well done 👍
Now, it's

Thanks @Patfarmurs for the approval


Error: ROI17_TOI-failed to compute the signal

I am getting bunch of errors while running the command  python dfxdemo.py measure make vid.mp4. The error dump is below:

You might be loading two sets of Qt binaries into the same process. Check that all plugins are compiled against the right Qt binaries. Export DYLD_PRINT_LIBRARIES=1 and check that only one set of binaries are being loaded.
QObject::moveToThread: Current thread (0x7fb42e521030) is not the object's thread (0x7fb43682b660).
Cannot move to target thread (0x7fb42e521030)

You might be loading two sets of Qt binaries into the same process. Check that all plugins are compiled against the right Qt binaries. Export DYLD_PRINT_LIBRARIES=1 and check that only one set of binaries are being loaded.
Sent chunk 1
Extraction complete, waiting for results
Received chunk 1
  Status: ANALYSIS_ERROR: ROI16_TOI-failed to compute the signal/ ROI13_TOI-failed to compute the signal/ ROI6_TOI-failed to compute the signal/ ROI8_TOI-failed to compute the signal/ ROI7_TOI-failed to compute the signal/ HR_BPM-failed to compute the signal/ SNR-failed to compute the signal/ ROI2_TOI-failed to compute the signal/ ROI1_TOI-failed to compute the signal/ ROI23_TOI-failed to compute the signal/ ROI4_TOI-failed to compute the signal/ ROI15_TOI-failed to compute the signal/ ROI9_TOI-failed to compute the signal/ ROI5_TOI-failed to compute the signal/ ROI11_TOI-failed to compute the signal/ ROI10_TOI-failed to compute the signal/ ROI14_TOI-failed to compute the signal/ ROI3_TOI-failed to compute the signal/ ROI22_TOI-failed to compute the signal/ ROI19_TOI-failed to compute the signal/ ROI17_TOI-failed to compute the signal/ ROI21_TOI-failed to compute the signal/ ROI18_TOI-failed to compute the signal/ ROI12_TOI-failed to compute the signal/
Measurement was cancelled by user.
None
None
Measurement 3243ad13-be70-4ed1-8bfa-95e4dde92ec2 failed

I installed pip install opencv-python-headless and now it says:
Created DFX Collector:
    mode: discrete
    number chunks: 2
    chunk duration: 5.010000228881836s
Created measurement b3376627-6633-405b-abda-6a099d36710a
Extraction started
Sent chunk 1
Extraction complete, waiting for results
None
Status 400 for req#:QZYuPINBlB, Code: VALIDATION_ERROR, Message: '', Description: '{}'.
None
Measurement b3376627-6633-405b-abda-6a099d36710a failed

Hello @kadnan ,
Please make sure that you are using the latest Python demo client. You should see a message saying Loaded: mobile20200702 before you see Created DFX Collector.
If the issue persists, please send us the payloads generated with --debug_save_chunks_folder as an argument when making a measurement, or the video you used.

@YukeSW
I just cloned a couple of days back. ARe you saying to run a git pull of this repo?

If you just cloned a few days ago, it should be the latest version. You can still run a git pull to make sure.
If you still see that error, please send us the payloads or the video.

@YukeSW Here I got the error dump:
➜  dfx-demo-py git:(master) ✗ python dfxdemo.py measure make --no_render  vid2.mp4
Created DFX Factory: libdfx2 version 4.4.1 - Jun 26, 2020
Retrieved new DFX SDK config data with md5: 24d0bb4bde33fc9d0a7cdc9ec5354d6b
Config updated in ./config.json
[2020-12-02 00:58:44.089] [dfx] [info] Loading: mobile20200702 (64-bit version)
[2020-12-02 00:58:44.093] [dfx] [info] Loading:
[2020-12-02 00:58:44.093] [dfx] [info] Loaded:
[2020-12-02 00:58:44.093] [dfx] [info] Loaded: mobile20200702
Created DFX Collector:
    mode: discrete
    number chunks: 2
    chunk duration: 5.010000228881836s
Created measurement 4ce4677b-f69c-4558-880b-eac81ba299ff
Extraction started
Sent chunk 1
Extraction complete, waiting for results
Config updated in ./config.json
Measurement 4ce4677b-f69c-4558-880b-eac81ba299ff completed
Use 'python dfxdemo.py measure get' to get comprehensive results
Task exception was never retrieved
future: <Task finished coro=<main.<locals>.receive_results() done, defined at dfxdemo.py:296> exception=ValueError("Status 400 for req#:VczJtMCDYb, Code: VALIDATION_ERROR, Message: '', Description: '{}'.")>
Traceback (most recent call last):
  File "dfxdemo.py", line 299, in receive_results
    status, request_id, payload = dfxapi.Measurements.ws_decode(msg)
  File "/Users/Me/Data/XXX/X/deepaffex/dfx-demo-py/dfx_apiv2_client/Base.py", line 63, in ws_decode
    raise ValueError(f"Status {status} for req#:{request_id}, Code: {error.Code}, Message: '{error.Message}', "

By enabling debugging it generated 3 files:
DOwnlaod from here: https://www.dropbox.com/s/6xo62foqob1h62j/debug_error.zip?dl=0

From your payload, it seems your video has a low FPS. The expected FPS for Deepaffex to work is 30.
Please try if our sample video works for you. You can find it in Sample Data at https://deepaffex.ai/developers-sdk when you scroll the page to the bottom.

@YukeSW The sample file worked well and I can see graph on Deepaffex website. My measurementId is 851ce148-f729-40f8-bf05-e1bef2d061c6 in case if you want to check further

In general, a mobile camera (iPhone preferable) should work for a 30 FPS camera, and a rear camera is better than the front one.
The FPS of your video was about 17 FPS based on the payload. You might want to try to record a new video or try a new camera.


Add support for SQL Server memory-optimized tables

Add ForSqlServerIsMemoryOptimized() EntityBuilder extension method
Add support for conventions to run on annotation set
Change conventions to not set cascade delete on foreign keys on on memory-optimized tables
Add convention to configure keys and indexes as nonclustered on memory-optimized tables
Change IsClustered extension method on builders to take a bool?
Add AlterDatabaseOperation and AlterTableOperation
Add OldAnnotations to all alter operations
Add migrations annotations providers for IModel and ISequence
Diff migrations annotations for IModel, IEntityType and ISequence
Set migrations annotations on drop operations
Add support for memory-optimized tables to RelationalDatabaseCleaner
Fixes #6405
Fixes #3122

@bricelam Could you take a look? I will add more tests.

:+1: Looking good

Updated with more tests

Updated migrations scaffolding

:shipit:


Two-way data binding and negation expression

Docs says that Polymer supports negation expressions:
<template>

</template>

As {{}} suggests two-way binding I thought it works both ways. However it seems it doesn't, at least within dom-bind.
Am I doing something wrong? Do you have any plans to support binding negated value back?
I found it quite useful, even for some basic cases like: <input type="checkbox" checked="{{!booleanSwitch::change}}">

Closing as duplicate of https://github.com/Polymer/polymer/issues/1715.
We are considering supporting this, although there are some corner-cases that need to be evaluated; for example, if you bind {{!stuff.enabled}} to checked and stuff.enabled is undefined, negating it will send true to the checkbox, which will round-trip back and set stuff.enabled to false (i.e. changing it from its undefined value), and there may be cases where that is undesirable.
In the meantime, you can manually perform the two-way negation as follows:
<input type="checkbox" checked="{{!booleanSwitch}}" on-change="checkedChanged">

checkedChanged: function(e) {
  this.booleanSwitch = !e.target.checked;
}


Added ProxyEventHandler

@KnowledgeGarden via email:

It has a new class ProxyEventHandler and a devtest which exercises it by adding two new proxies to the index and showing the sent results.
The output is below, where there are two instance topics made, then they are related to each other with a Causes relation.
Getting this to work required updating pom.xml (which somewhat implies the need to look closely at the pom.xml for tq-elastic-nodeprovider, though it's probably ok for compiling, just not running my  dev tests.
I am going to attempt to commit this to the repo now assuming there have been no changes to that repo.

Rebased on master and rewrote @KnowledgeGarden devtest as ProxyEventIntegrationTest. It's still fragile because it's relying on Thread.sleep to wait for the Callable to subscribe and collect all writes on the socket.
Shall we touch up that test before merging?


Fix clippy

Which issue does this PR close?

Closes #.
Rationale for this change

What changes are included in this PR?

Are these changes tested?

Are there any user-facing changes?

I intend to merge this once CI goes green, as maser is currently failing CI


Option to re-install for wipe and do a clean install on an existing VM with Hassos

To allow redoing the complete reinstall without deleting the VM.

This may be simply achieved with the script checking if any VM has hass.io installed and therefore asking for any indication of re-installing or installing in a new VM.
If re-installing, ask the user to indicate the VM Proxmox number, backup the VM config file and create a brandnew restoring the same config file.


DBZ-8451 Support Mongo 8.0

closes https://issues.redhat.com/browse/DBZ-8451

@ani-sha Thanks. I think we can replace 7 with 8 in this PR to keep time down and add it to internal Jenkins so we will test both 7 and 8 there.

@ani-sha Applied, thanks


Fix branch name in clone command in multimodule README.md

The clone command in the multimodule README points at the base branch instead of the multimodule branch. This PR fixes this.

Thanks! Fixed in another PR


readme instructions don't seem to line up with downloaded contents

When I download the contents, I get a csproj file, among other things. I don't get an executable, which seems to be addressed in the readme. Please provide additional instructions for executing the modder.
"2: Navigate to the downloaded folder and run the "Generation Zero Save File Modder"

You have to right-click on the files in the downloaded directory, open properties, choose unblock option and confirm with ok. It's easier to do it manually to each file. After that, run Modder in Visual Studio, compile with a green arrow button in the upper part of the tool field. After that the GUI will start


Network_Camera GUID

The GUID for Network_Camera is invalid. Appears to be missing a character from last grouping of characters.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: c5122881-e5b4-69e5-3ea9-4d89baf6d014
Version Independent ID: e0547f0c-ec2e-2b88-9792-f01e3884bb23
Content: KSCATEGORY_NETWORK_CAMERA - Windows drivers
Content Source: windows-driver-docs-pr/install/kscategory-network-camera.md
Product: windows-hardware
Technology: windows-devices
GitHub Login: @tedhudek
Microsoft Alias: tedhudek

Thanks for the report @SMailman, I've just pushed a fix.  There was a missing 9 at the end.

Thank you.
On Wed, Jul 1, 2020, 7:08 PM Ted Hudek<EMAIL_ADDRESS>wrote:

Thanks for the report @SMailman https://github.com/SMailman, I've just
pushed a fix. There was a missing 9 at the end.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/MicrosoftDocs/windows-driver-docs/issues/2344#issuecomment-652705200,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AOULR44VTWG5P3LIH3QNKZTRZPFYRANCNFSM4OLOQPRA
.


add package to conda-forge

This already has a PR now https://github.com/conda-forge/staged-recipes/pull/24408

Taking forever, but there is at least some progress.

Done!!


Then again from 2024.1.2 to 2024.1.6
My solution:
1.) Disable WireGuard client (Uncheck “Start on boot”)
2.) Reboot system
3.) Update your system
4.) Re-activate WireGuard as desired

Home Assistant OS 11.4
Core 2024.1.6
Pi4
Following issue is likely related:
When WireGuard client is active, restarting the HA core will somewhat fail.
After restarting core (with WireGuard running, but no connections ), the HA Webinterface is no longer accessible.
Following gets displayed when trying to access Web GUI.
IP address of my WireGuard Server is xx.xx.xx.xx
{"peer_1":{"endpoint":"xx.xx.xx.xx:51820","latest_handshake":"Thu Feb  1 12:44:13 CET 2024","transfer_rx":25828,"transfer_tx":19308}}
The OS needs to be rebooted for everything to work again.


Fix React 18 Concurrent Mode drag glitches

Hi! 👋
Firstly, thanks for your work on this project! 🙂
Today I used patch-package to patch<EMAIL_ADDRESS>for the project I'm working on.
In React 18 concurrent mode setState updates gets batched by default. That means they never run synchronously — always deferred.
I've faced an issue when drag parameters got out of sync after React 18 update on slow machine.
Visual manifestation were:
https://user-images.githubusercontent.com/2434839/212761083-648aca50-0b14-403b-82ad-2a778ebdc3d4.mov
items were dragged more far away than the cursor moved when CPU was throttled / occupied.
My investigation brought me to setState that is used for in-between drag events state and that this.state can and returns stale (old) values until rerender occurs in React 18.
As this state is not used inside render() function and updates do not need to trigger rerender, being motivated to make minimal change that would work for me and likely not break anything,
Here is the diff that solved my problem:
diff --git a/node_modules/react-draggable/build/cjs/DraggableCore.js b/node_modules/react-draggable/build/cjs/DraggableCore.js
index 07b05f1..d9ea373 100644
--- a/node_modules/react-draggable/build/cjs/DraggableCore.js
+++ b/node_modules/react-draggable/build/cjs/DraggableCore.js
@@ -175,12 +175,7 @@ var DraggableCore = /*#__PURE__*/function (_React$Component) {
       // touchpoint was set to this element.

       var touchIdentifier = (0, _domFns.getTouchIdentifier)(e);
-
-      _this.setState({
-        touchIdentifier: touchIdentifier
-      }); // Get the current drag point from the event. This is used as the offset.
-
-
+      this.state.touchIdentifier = touchIdentifier; // Get the current drag point from the event. This is used as the offset.
       var position = (0, _positionFns.getControlPosition)(e, touchIdentifier, _assertThisInitialized(_this));
       if (position == null) return; // not possible but satisfies flow

@@ -201,11 +196,9 @@ var DraggableCore = /*#__PURE__*/function (_React$Component) {
       // so we know how much we've moved during the drag. This allows us
       // to drag elements around even if they have been moved, without issue.

-      _this.setState({
-        dragging: true,
-        lastX: x,
-        lastY: y
-      }); // Add events to the document directly so we catch when the user's mouse/touch moves outside of
+      _this.state.dragging = true;
+      _this.state.lastX = x;
+      _this.state.lastY = y; // Add events to the document directly so we catch when the user's mouse/touch moves outside of
       // this element. We use different events depending on whether or not we have detected that this
       // is a touch-capable device.

@@ -262,10 +255,8 @@ var DraggableCore = /*#__PURE__*/function (_React$Component) {
         return;
       }

-      _this.setState({
-        lastX: x,
-        lastY: y
-      });
+      _this.state.lastX = x
+      _this.state.lastY = y
     });

     _defineProperty(_assertThisInitialized(_this), "handleDragStop", function (e) {
@@ -303,11 +294,9 @@ var DraggableCore = /*#__PURE__*/function (_React$Component) {

Thank you for this!! Just resolved the same issue I was having.

We noticed that with this fix the deltaX and x values jump back and fourth like 23, 22, 23, 22, 21, 22, 20, etc... which makes the drag incorrect (disconnects from speed of the cursor as the user drags and feels slow). Reverting to v4.4.5 fixes the issue in React 18 for us.