Read software versions / serial number on startup?

Not sure whether we need to / where we'd display them.... I don't really want to poll them all the time, as they're unlikely to change.

See https://github.com/TonyM1958/HA-FoxESS-Modbus/issues/5

for what it's worth, I added scan_interval_static for loading model number, serial number, inverter firmware versions and battery firmware version info to my secrets and set this to 3600 so they just get scanned once an hour. Thought this was a compromise that would load the values at startup and not put a significant on-going load on the system but reflect changes in versions.

We now read software versions on start-up.


Add functions for measuring text bounds

This PR adds missing functions for measuring text bounds for text and text-box.
The only difference between this and c version of nanovg is that bounds are not passed as 'out' parameter to function (they are instead returned from function) and are not optional (user can ignore the return value).
Passing by optional out parameter to function felt really weird and the usage of the function was not optimal.

lgtm


Made Android Studio support unit testing and fixed the complex class issue of NewsListAdapter

I like the integration tests of this project. I think it would be better if the gradle configuration of this project could support running unit tests. I inspected the code of this project using Android Studio and found the class NewsListAdapter was overly complex. The cyclomatic complexity of this class is 92. I want to add a unit test for this class and then refactor it. Unit tests are running faster than integration tests without connecting to a real Android phone or an emulator. After referring to the blog (https://sites.google.com/a/android.com/tools/tech-docs/unit-testing-support), I changed the version of Android gradle plugin to be 1.1.0 and added junit in the dependencies. I added 18 unit tests for class IconAndViewTextManager. Now both the unit test and the original integration tests can be run smoothly in the Android Studio.

Refactored 17 if-else-if statements into enum constant-specific classes so that the complex class issue of class NewsListAdapter was fixed.

fixes #733

Removed the empty file header.

@wubin28 we just merged a fairly significant PR that updates the project structure. If you're willing to update the PR to be mergable with that, I'd be happy to merge it

@hzsweers Just got that. Let me have a try. Thx.

Merged and fixed conflicts.


chore(docs,examples): snapshot docs and vanillajs example

This is a first go at the snapshot docs, looks forward to corrections.

https://githubbox.com/RikuVan/valtio/tree/valtio-vanilla-docs/examples/photo-booth-vanillajs

wow, it's such a rich example.


Cannot build Angular example

@shiv19 the readme is somewhat difficult to interpret for this plugin. Should the angular demo be runnable? I unfortunately cannot build the demo. I have also tried to build the native demo, this also does not build and prints plenty of errors. In case the demo builds for you, please add a comment to the README what is needed. The build scripts in the src/package.json do not work for me.
Which platform(s) does your issue occur on?

only checked IOS yet on emulator ( but is independent of emulator or device as the demo does not build)

Please, provide the following version numbers that your issue occurs with:

CLI: 7.0.8
Cross-platform modules: modules are exactely according to the repo sources here

Please, tell us how to recreate the issue in as much detail as possible.
-clone repository

go to src folder
npm run build
npm run demo-angular.ios

> @ ngcc /Users/cjohn/Entwicklung/IMS_Help/nativescript-ui-charts/demo-angular
> ngcc --properties es2015 module main --first-only

Compiling @angular/core : es2015 as esm2015
Compiling @angular/animations : es2015 as esm2015
Compiling @angular/compiler/testing : es2015 as esm2015
Compiling @angular/common : es2015 as esm2015
Compiling @angular/animations/browser : es2015 as esm2015
Compiling @angular/core/testing : es2015 as esm2015
Compiling @angular/platform-browser : es2015 as esm2015
Compiling @angular/common/http : es2015 as esm2015
Compiling @angular/animations/browser/testing : es2015 as esm2015
Compiling @angular/router : es2015 as esm2015
Compiling @angular/forms : es2015 as esm2015
Compiling @angular/common/testing : es2015 as esm2015
Compiling @angular/platform-browser/testing : es2015 as esm2015
Compiling @angular/platform-browser-dynamic : es2015 as esm2015
Compiling @angular/platform-browser/animations : es2015 as esm2015
Compiling @angular/common/http/testing : es2015 as esm2015
Compiling @angular/platform-browser-dynamic/testing : es2015 as esm2015
Compiling @angular/router/testing : es2015 as esm2015
Compiling @nativescript/angular : es2015 as esm2015
Compiling @nativescript/angular/testing : es2015 as esm2015
Compiling nativescript-angular : es2015 as esm2015
Compiling @nativescript/ui-charts-angular : es2015 as esm2015
Warning: Unable to fully load<EMAIL_ADDRESS>for source-map flattening: ENOENT: no such file or directory, open<EMAIL_ADDRESS>npm notice created a lockfile as package-lock.json. You should commit this file.
npm WARN notsup Unsupported engine for<EMAIL_ADDRESS>wanted: {"node":"<8.10.0"} (current: {"node":"12.16.1","npm":"6.14.8"})
npm WARN notsup Not compatible with your version of node/npm<EMAIL_ADDRESS>
added 729 packages from 415 contributors and audited 729 packages in 48.114s

27 packages are looking for funding
  run `npm fund` for details

found 0 vulnerabilities

Copying template files...
⠏ (node:16026) Warning: Setting the NODE_TLS_REJECT_UNAUTHORIZED environment variable to '0' makes TLS connections and HTTPS requests insecure by disabling certificate verification.
⠙ ⸨       ░░░░░░░░░░░⸩ ⠹ extract:tns-ios: verb lock using /Users/cjohn/.npm/_locks/staging-a2a8f526aae9a197.lock for /Users/cjohn/Entwicklung/IMS_Help/nativescrip⠹ ⸨       ░░░░░░░░░░░⸩ ⠹ extract:tns-ios: verb lock using /Users/cjohn/.npm/_locks/staging-a2a8f526aae9a197.lock for /Users/cjohn/Entwicklung/IMS_Help/nativescrip⠸ ⸨       ░░░░░░░░░░░⸩ ⠹ extract:tns-ios: verb lock using /Users/cjohn/.npm/_locks/staging-a2a8f526aae9a197.lock for /Users/cjohn/Entwicklung/IMS_Help/nativescrip⠼ ⸨       ░░░░░░░░░░░⸩ ⠹ extract:tns-ios: verb lock using /Users/cjohn/.npm/_locks/staging-a2a8f526aae9a197.lock for /Users/cjohn/Entwicklung/IMS_Help/nativescrip⠴ ⸨       ░░░░░░░░░░░⸩ ⠹ extract:tns-ios: verb lock using /Users/cjohn/.npm/_locks/staging-a2a8f526aae9a197.lock for /Users/cjohn/Entwicklung/IMS_Help/nativescrip⠦ ⸨       ░░░░░░░░░░░⸩ ⠹ extract:tns-ios: verb lock using /Users/cjohn/.npm/_locks/staging-a2a8f526aae9a197.lock for /Users/cjohn/Entwicklung/IMS_Help/nativescrip⠧ ⸨       ░░░░░░░░░░░⸩ ⠹ extract:tns-ios: verb lock using /Users/cjohn/.npm/_locks/staging-a2a8f526aae9a197.lock for /Users/cjohn/Entwicklung/IMS_Help/nativescrip⠇ ⸨       ░░░░░░░░░░░⸩ ⠹ extract:tns-ios: verb lock using /Users/cjohn/.npm/_locks/staging-a2a8f526aae9a197.lock for /Users/cjohn/Entwicklung/IMS_Help/nativescrip⠏ ⸨       ░░░░░░░░░░░⸩ ⠹ extract:tns-ios: verb lock using /Users/cjohn/.npm/_locks/staging-a2a8f526aae9a197.lock for /Users/cjohn/Entwicklung/IMS_Help/nativescrip⠋ ⸨       ░░░░░░░░░░░⸩ ⠴ extract:tns-ios: verb lock using /Users/cjohn/.npm/_locks/staging-a2a8f526aae9a197.lock for /Users/cjohn/Entwicklung/IMS_Help/nativescrip⠙ ⸨       ░░░░░░░░░░░⸩ ⠴ extract:tns-ios: verb lock using /Users/cjohn/.npm/_locks/staging-a2a8f526aae9a197.lock for /Users/cjohn/Entwicklung/IMS_Help/nativescrip⠹ ⸨       ░░░░░░░░░░░⸩ ⠴ extract:tns-ios: verb lock using /Users/cjohn/.npm/_locks/staging-a2a8f526aae9a197.lock for /Users/cjohn/Entwicklung/IMS_Help/nativescrip⠸ ⸨       ░░░░░░░░░░░⸩ ⠴ extract:tns-ios: verb lock using /Users/cjohn/.npm/_locks/staging-a2a8f526aae9a197.lock for /Users/cjohn/Entwicklung/IMS_Help/nativescrip⠼ ⸨       ░░░░░░░░░░░⸩ ⠴ extract:tns-ios: verb lock using /Users/cjohn/.npm/_locks/staging-a2a8f526aae9a197.lock for /Users/cjohn/Entwicklung/IMS_Help/nativescrip⠴ ⸨       ░░░░░░░░░░░⸩ ⠴ extract:tns-ios: verb lock using /Users/cjohn/.npm/_locks/staging-a2a8f526aae9a197.lock for /Users/cjohn/Entwicklung/IMS_Help/nativescrip+<EMAIL_ADDRESS>added 1 package from 1 contributor and audited 730 packages in 4.962s
⠸
27 packages are looking for funding
  run `npm fund` for details

found 0 vulnerabilities

Platform ios successfully added. v6.5.2
Preparing project...
File change detected. Starting incremental webpack compilation...

webpack is watching the files…

Insufficient number of arguments or no entry found.
Alternatively, run 'webpack(-cli) --help' for usage info.

Hash: adf727c9e53d9f2703a1
Version: webpack 4.44.2
Time: 8557ms
Built at: 09/18/2020 2:54:05 PM
                                              Asset       Size                                            Chunks             Chunk Names
                                       package.json  112 bytes                                                    [emitted]
                                         runtime.js   13.9 KiB                                           runtime  [emitted]  runtime
<EMAIL_ADDRESS>797 bytes  tns_modules/@nativescript/core/inspector_modules  [emitted]  tns_modules/@nativescript/core/inspector_modules
                                          vendor.js   4.46 MiB                                            vendor  [emitted]  vendor
Entrypoint tns_modules/@nativescript/core/inspector_modules = runtime.js vendor.js<EMAIL_ADDRESS>[~/package.json] external "~/package.json" 42 bytes {tns_modules/@nativescript/core/inspector_modules} [optional] [built]
    + 250 hidden modules

ERROR in Entry module not found: Error: Can't resolve '@nativescript/webpack/moduleid-compat-loader' in '/Users/cjohn/Entwicklung/IMS_Help/nativescript-ui-charts/demo-angular/src'
Webpack compilation complete. Watching for file changes.
Webpack build done!
Installing pods...
Analyzing dependencies
Downloading dependencies
Installing Highcharts (8.1.2)
Installing MDFInternationalization (2.0.0)
Installing MaterialComponents (94.5.0)
Generating Pods project
Integrating client project

[!] Please close any current Xcode sessions and use `demoangular.xcworkspace` for this project from now on.
Pod installation complete! There are 2 dependencies from the Podfile and 3 total pods installed.
Project successfully prepared (ios)
Building project...
Xcode build...
./.build_env_vars.sh: line 452: declare: UID: readonly variable
NSLD: Swift bridging header '*-Swift.h' not found under '/Users/cjohn/Library/Developer/Xcode/DerivedData/demoangular-gimgjufmfsxfeadvrahypnosuyix/Build/Intermediates.noindex/demoangular.build/Debug-iphonesimulator/demoangular.build/Objects-normal/i386'
Generating metadata...~/Entwicklung/IMS_Help/nativescript-ui-charts/demo-angular/platforms/ios/internal/metadata-generator/bin ~/Entwicklung/IMS_Help/nativescript-ui-charts/demo-angular/platforms/ios
Python version: 2.7.17 (default, Dec  1 2019, 23:22:04)
[GCC 4.2.1 Compatible Apple LLVM 11.0.0 (clang-1<IP_ADDRESS>)]
Generating metadata for i386
Metadata Generator Arguments:
./objc-metadata-generator -verbose -output-bin /Users/cjohn/Entwicklung/IMS_Help/nativescript-ui-charts/demo-angular/platforms/ios/build/Debug-iphonesimulator/metadata-i386.bin -output-umbrella /Users/cjohn/Entwicklung/IMS_Help/nativescript-ui-charts/demo-angular/platforms/ios/build/Debug-iphonesimulator/umbrella-i386.h -docset-path /Users/cjohn/Library/Developer/Shared/Documentation/DocSets/com.apple.adc.documentation.iOS.docset Xclang -isysroot /Applications/Xcode.app/Contents/Developer/Platforms/iPhoneSimulator.platform/Developer/SDKs/iPhoneSimulator13.7.sdk -arch i386 -mios-simulator-version-min=9.0 -std=gnu99 -I/Users/cjohn/Entwicklung/IMS_Help/nativescript-ui-charts/demo-angular/platforms/ios/build/Debug-iphonesimulator/include -I/Users/cjohn/Entwicklung/IMS_Help/nativescript-ui-charts/demo-angular/platforms/ios/build/Debug-iphonesimulator/MDFInternationalization/MDFInternationalization.framework/Headers -I/Users/cjohn/Entwicklung/IMS_Help/nativescript-ui-charts/demo-angular/platforms/ios/build/Debug-iphonesimulator/MaterialComponents/MaterialComponents.framework/Headers -I/Users/cjohn/Entwicklung/IMS_Help/nativescript-ui-charts/demo-angular/platforms/ios/internal/Swift-Modules -I/Users/cjohn/Entwicklung/IMS_Help/nativescript-ui-charts/demo-angular/platforms/ios/internal -I/Users/cjohn/Entwicklung/IMS_Help/nativescript-ui-charts/demo-angular/platforms/ios/../../App_Resources/iOS/src -I/Users/cjohn/Entwicklung/IMS_Help/nativescript-ui-charts/demo-angular/platforms/ios/../../node_modules/@nativescript/core/platforms/ios/src -I/Users/cjohn/Entwicklung/IMS_Help/nativescript-ui-charts/demo-angular/platforms/ios/../../node_modules/@nativescript/ui-charts/platforms/ios/src -F/Users/cjohn/Entwicklung/IMS_Help/nativescript-ui-charts/demo-angular/platforms/ios/build/Debug-iphonesimulator -F/Users/cjohn/Entwicklung/IMS_Help/nativescript-ui-charts/demo-angular/platforms/ios/internal/ -F/Users/cjohn/Entwicklung/IMS_Help/nativescript-ui-charts/demo-angular/platforms/ios/build/Debug-iphonesimulator -F/Users/cjohn/Entwicklung/IMS_Help/nativescript-ui-charts/demo-angular/platforms/ios/build/Debug-iphonesimulator/MDFInternationalization -F/Users/cjohn/Entwicklung/IMS_Help/nativescript-ui-charts/demo-angular/platforms/ios/build/Debug-iphonesimulator/MaterialComponents -F/Users/cjohn/Entwicklung/IMS_Help/nativescript-ui-charts/demo-angular/platforms/ios/Pods/Highcharts/development -F/Users/cjohn/Entwicklung/IMS_Help/nativescript-ui-charts/demo-angular/platforms/ios/../../node_modules/@nativescript/core/platforms/ios -DCOCOAPODS=1 -DDEBUG=1
Clang Arguments:
"-v", "-x", "objective-c", "-fno-objc-arc", "-fmodule-maps", "-ferror-limit=0", "-Wno-unknown-pragmas", "-Wno-ignored-attributes", "-Wno-nullability-completeness", "-Wno-expansion-to-defined", "-D__NATIVESCRIPT_METADATA_GENERATOR=1", "-isysroot", "/Applications/Xcode.app/Contents/Developer/Platforms/iPhoneSimulator.platform/Developer/SDKs/iPhoneSimulator13.7.sdk", "-arch", "i386", "-mios-simulator-version-min=9.0", "-std=gnu99", "-I/Users/cjohn/Entwicklung/IMS_Help/nativescript-ui-charts/demo-angular/platforms/ios/build/Debug-iphonesimulator/include", "-I/Users/cjohn/Entwicklung/IMS_Help/nativescript-ui-charts/demo-angular/platforms/ios/build/Debug-iphonesimulator/MDFInternationalization/MDFInternationalization.framework/Headers", "-I/Users/cjohn/Entwicklung/IMS_Help/nativescript-ui-charts/demo-angular/platforms/ios/build/Debug-iphonesimulator/MaterialComponents/MaterialComponents.framework/Headers", "-I/Users/cjohn/Entwicklung/IMS_Help/nativescript-ui-charts/demo-angular/platforms/ios/internal/Swift-Modules", "-I/Users/cjohn/Entwicklung/IMS_Help/nativescript-ui-charts/demo-angular/platforms/ios/internal", "-I/Users/cjohn/Entwicklung/IMS_Help/nativescript-ui-charts/demo-angular/platforms/ios/../../App_Resources/iOS/src", "-I/Users/cjohn/Entwicklung/IMS_Help/nativescript-ui-charts/demo-angular/platforms/ios/../../node_modules/@nativescript/core/platforms/ios/src", "-I/Users/cjohn/Entwicklung/IMS_Help/nativescript-ui-charts/demo-angular/platforms/ios/../../node_modules/@nativescript/ui-charts/platforms/ios/src", "-F/Users/cjohn/Entwicklung/IMS_Help/nativescript-ui-charts/demo-angular/platforms/ios/build/Debug-iphonesimulator", "-F/Users/cjohn/Entwicklung/IMS_Help/nativescript-ui-charts/demo-angular/platforms/ios/internal/", "-F/Users/cjohn/Entwicklung/IMS_Help/nativescript-ui-charts/demo-angular/platforms/ios/build/Debug-iphonesimulator", "-F/Users/cjohn/Entwicklung/IMS_Help/nativescript-ui-charts/demo-angular/platforms/ios/build/Debug-iphonesimulator/MDFInternationalization", "-F/Users/cjohn/Entwicklung/IMS_Help/nativescript-ui-charts/demo-angular/platforms/ios/build/Debug-iphonesimulator/MaterialComponents", "-F/Users/cjohn/Entwicklung/IMS_Help/nativescript-ui-charts/demo-angular/platforms/ios/Pods/Highcharts/development", "-F/Users/cjohn/Entwicklung/IMS_Help/nativescript-ui-charts/demo-angular/platforms/ios/../../node_modules/@nativescript/core/platforms/ios", "-DCOCOAPODS=1", "-DDEBUG=1",
Merged 765 categories.
Result: 43404 declarations from 141 top level modules
Done! Running time: 6.54485 sec
Saving metadata generation's stderr stream to: /Users/cjohn/Entwicklung/IMS_Help/nativescript-ui-charts/demo-angular/platforms/ios/build/Debug-iphonesimulator/metadata-generation-stderr-i386.txt
Generating metadata for x86_64
Metadata Generator Arguments:
./objc-metadata-generator -verbose -output-bin /Users/cjohn/Entwicklung/IMS_Help/nativescript-ui-charts/demo-angular/platforms/ios/build/Debug-iphonesimulator/metadata-x86_64.bin -output-umbrella /Users/cjohn/Entwicklung/IMS_Help/nativescript-ui-charts/demo-angular/platforms/ios/build/Debug-iphonesimulator/umbrella-x86_64.h -docset-path /Users/cjohn/Library/Developer/Shared/Documentation/DocSets/com.apple.adc.documentation.iOS.docset Xclang -isysroot /Applications/Xcode.app/Contents/Developer/Platforms/iPhoneSimulator.platform/Developer/SDKs/iPhoneSimulator13.7.sdk -arch x86_64 -mios-simulator-version-min=9.0 -std=gnu99 -I/Users/cjohn/Entwicklung/IMS_Help/nativescript-ui-charts/demo-angular/platforms/ios/build/Debug-iphonesimulator/include -I/Users/cjohn/Entwicklung/IMS_Help/nativescript-ui-charts/demo-angular/platforms/ios/build/Debug-iphonesimulator/MDFInternationalization/MDFInternationalization.framework/Headers -I/Users/cjohn/Entwicklung/IMS_Help/nativescript-ui-charts/demo-angular/platforms/ios/build/Debug-iphonesimulator/MaterialComponents/MaterialComponents.framework/Headers -I/Users/cjohn/Entwicklung/IMS_Help/nativescript-ui-charts/demo-angular/platforms/ios/internal/Swift-Modules -I/Users/cjohn/Entwicklung/IMS_Help/nativescript-ui-charts/demo-angular/platforms/ios/internal -I/Users/cjohn/Entwicklung/IMS_Help/nativescript-ui-charts/demo-angular/platforms/ios/../../App_Resources/iOS/src -I/Users/cjohn/Entwicklung/IMS_Help/nativescript-ui-charts/demo-angular/platforms/ios/../../node_modules/@nativescript/core/platforms/ios/src -I/Users/cjohn/Entwicklung/IMS_Help/nativescript-ui-charts/demo-angular/platforms/ios/../../node_modules/@nativescript/ui-charts/platforms/ios/src -F/Users/cjohn/Entwicklung/IMS_Help/nativescript-ui-charts/demo-angular/platforms/ios/build/Debug-iphonesimulator -F/Users/cjohn/Entwicklung/IMS_Help/nativescript-ui-charts/demo-angular/platforms/ios/internal/ -F/Users/cjohn/Entwicklung/IMS_Help/nativescript-ui-charts/demo-angular/platforms/ios/build/Debug-iphonesimulator -F/Users/cjohn/Entwicklung/IMS_Help/nativescript-ui-charts/demo-angular/platforms/ios/build/Debug-iphonesimulator/MDFInternationalization -F/Users/cjohn/Entwicklung/IMS_Help/nativescript-ui-charts/demo-angular/platforms/ios/build/Debug-iphonesimulator/MaterialComponents -F/Users/cjohn/Entwicklung/IMS_Help/nativescript-ui-charts/demo-angular/platforms/ios/Pods/Highcharts/development -F/Users/cjohn/Entwicklung/IMS_Help/nativescript-ui-charts/demo-angular/platforms/ios/../../node_modules/@nativescript/core/platforms/ios -DCOCOAPODS=1 -DDEBUG=1
Clang Arguments:
"-v", "-x", "objective-c", "-fno-objc-arc", "-fmodule-maps", "-ferror-limit=0", "-Wno-unknown-pragmas", "-Wno-ignored-attributes", "-Wno-nullability-completeness", "-Wno-expansion-to-defined", "-D__NATIVESCRIPT_METADATA_GENERATOR=1", "-isysroot", "/Applications/Xcode.app/Contents/Developer/Platforms/iPhoneSimulator.platform/Developer/SDKs/iPhoneSimulator13.7.sdk", "-arch", "x86_64", "-mios-simulator-version-min=9.0", "-std=gnu99", "-I/Users/cjohn/Entwicklung/IMS_Help/nativescript-ui-charts/demo-angular/platforms/ios/build/Debug-iphonesimulator/include", "-I/Users/cjohn/Entwicklung/IMS_Help/nativescript-ui-charts/demo-angular/platforms/ios/build/Debug-iphonesimulator/MDFInternationalization/MDFInternationalization.framework/Headers", "-I/Users/cjohn/Entwicklung/IMS_Help/nativescript-ui-charts/demo-angular/platforms/ios/build/Debug-iphonesimulator/MaterialComponents/MaterialComponents.framework/Headers", "-I/Users/cjohn/Entwicklung/IMS_Help/nativescript-ui-charts/demo-angular/platforms/ios/internal/Swift-Modules", "-I/Users/cjohn/Entwicklung/IMS_Help/nativescript-ui-charts/demo-angular/platforms/ios/internal", "-I/Users/cjohn/Entwicklung/IMS_Help/nativescript-ui-charts/demo-angular/platforms/ios/../../App_Resources/iOS/src", "-I/Users/cjohn/Entwicklung/IMS_Help/nativescript-ui-charts/demo-angular/platforms/ios/../../node_modules/@nativescript/core/platforms/ios/src", "-I/Users/cjohn/Entwicklung/IMS_Help/nativescript-ui-charts/demo-angular/platforms/ios/../../node_modules/@nativescript/ui-charts/platforms/ios/src", "-F/Users/cjohn/Entwicklung/IMS_Help/nativescript-ui-charts/demo-angular/platforms/ios/build/Debug-iphonesimulator", "-F/Users/cjohn/Entwicklung/IMS_Help/nativescript-ui-charts/demo-angular/platforms/ios/internal/", "-F/Users/cjohn/Entwicklung/IMS_Help/nativescript-ui-charts/demo-angular/platforms/ios/build/Debug-iphonesimulator", "-F/Users/cjohn/Entwicklung/IMS_Help/nativescript-ui-charts/demo-angular/platforms/ios/build/Debug-iphonesimulator/MDFInternationalization", "-F/Users/cjohn/Entwicklung/IMS_Help/nativescript-ui-charts/demo-angular/platforms/ios/build/Debug-iphonesimulator/MaterialComponents", "-F/Users/cjohn/Entwicklung/IMS_Help/nativescript-ui-charts/demo-angular/platforms/ios/Pods/Highcharts/development", "-F/Users/cjohn/Entwicklung/IMS_Help/nativescript-ui-charts/demo-angular/platforms/ios/../../node_modules/@nativescript/core/platforms/ios", "-DCOCOAPODS=1", "-DDEBUG=1",
Merged 765 categories.
Result: 43403 declarations from 141 top level modules
Done! Running time: 5.81211 sec
Saving metadata generation's stderr stream to: /Users/cjohn/Entwicklung/IMS_Help/nativescript-ui-charts/demo-angular/platforms/ios/build/Debug-iphonesimulator/metadata-generation-stderr-x86_64.txt
~/Entwicklung/IMS_Help/nativescript-ui-charts/demo-angular/platforms/ios
ld: warning: ignoring file /Users/cjohn/Entwicklung/IMS_Help/nativescript-ui-charts/demo-angular/platforms/ios/Pods/Highcharts/development/Highcharts.framework/Highcharts, missing required architecture i386 in file /Users/cjohn/Entwicklung/IMS_Help/nativescript-ui-charts/demo-angular/platforms/ios/Pods/Highcharts/development/Highcharts.framework/Highcharts (4 slices)
note: Using new build system
note: Building targets in parallel
note: Planning build
note: Constructing build description
Project successfully built.
The build result is located at: /Users/cjohn/Entwicklung/IMS_Help/nativescript-ui-charts/demo-angular/platforms/ios/build/Debug-iphonesimulator/demoangular.app
Installing on device 95A0BF20-03E3-4CB5-9A60-0A9F6FF8944E...
Successfully installed on device with identifier '95A0BF20-03E3-4CB5-9A60-0A9F6FF8944E'.
Successfully transferred package.json on device 95A0BF20-03E3-4CB5-9A60-0A9F6FF8944E.
Successfully transferred runtime.js on device 95A0BF20-03E3-4CB5-9A60-0A9F6FF8944E.
Successfully transferred tns_modules on device 95A0BF20-03E3-4CB5-9A60-0A9F6FF8944E.
Successfully transferred @nativescript on device 95A0BF20-03E3-4CB5-9A60-0A9F6FF8944E.
Successfully transferred core on device 95A0BF20-03E3-4CB5-9A60-0A9F6FF8944E.
Successfully transferred inspector_modules.js on device 95A0BF20-03E3-4CB5-9A60-0A9F6FF8944E.
Successfully transferred vendor.js on device 95A0BF20-03E3-4CB5-9A60-0A9F6FF8944E.
Restarting application on device 95A0BF20-03E3-4CB5-9A60-0A9F6FF8944E...
Successfully synced application org.nativescript.chartsdemoangular on device 95A0BF20-03E3-4CB5-9A60-0A9F6FF8944E.
***** Fatal JavaScript exception - application has been terminated. *****
Native stack trace:
1   0x10333162e NativeScript::reportFatalErrorBeforeShutdown(JSC::ExecState*, JSC::Exception*, bool)
2   0x103383524 -[TNSRuntime executeModule:referredBy:]
3   0x102bee093 main
4   0x10929fd81 start
JavaScript stack trace:
resolve([native code])
at [native code]
at asyncFunctionResume([native code])
at [native code]
at asyncFunctionResume([native code])
JavaScript error:
[native code]: JS ERROR Error: Could not find module './'. Computed path '/Users/cjohn/Library/Developer/CoreSimulator/Devices/95A0BF20-03E3-4CB5-9A60-0A9F6FF8944E/data/Containers/Bundle/Application/2BE02F71-9A05-4FE2-BFEB-7291521B8B00/demoangular.app/app'.
(CoreFoundation) *** Terminating app due to uncaught exception 'NativeScript encountered a fatal error: Error: Could not find module './'. Computed path '/Users/cjohn/Library/Developer/CoreSimulator/Devices/95A0BF20-03E3-4CB5-9A60-0A9F6FF8944E/data/Containers/Bundle/Application/2BE02F71-9A05-4FE2-BFEB-7291521B8B00/demoangular.app/app'.
at
resolve([native code])
at [native code]
at asyncFunctionResume([native code])
at [native code]
at asyncFunctionResume([native code])
', reason: '(null)'
*** First throw call stack:
(
0   CoreFoundation                      0x0000000108cc212b __exceptionPreprocess + 171
1   libobjc.A.dylib                     0x0000000107c14f41 objc_exception_throw + 48
2   NativeScript                        0x0000000103331b6f _ZN12NativeScript30reportFatalErrorBeforeShutdownEPN3JSC9ExecStateEPNS0_9ExceptionEb + 1631
3   NativeScript                        0x0000000103383524 -[TNSRuntime executeModule:referredBy:] + 660
4   demoangular                         0x0000000102bee093 main + 179
5 <…>
NativeScript caught signal 6.
Native Stack:
1   0x103382171 sig_handler(int)
2   0x1096ea5fd _sigtramp
3   0x0
4   0x1093710eb abort
5   0x10911791f __cxa_bad_cast
6   0x109117abb default_unexpected_handler()
7   0x107c151be _objc_terminate()
8   0x109133159 std::__terminate(void (*)())
9   0x109132bff __cxxabiv1::exception_cleanup_func(_Unwind_Reason_Code, _Unwind_Exception*)
10  0x107c15068 _objc_exception_destructor(void*)
11  0x103331b6f NativeScript::reportFatalErrorBeforeShutdown(JSC::ExecState*, JSC::Exception*, bool)
12  0x103383524 -[TNSRuntime executeModule:referredBy:]
13  0x102bee093 main
14  0x10929fd81 start
JS Stack:

Hi @cjohn001
Thanks for reporting this, after merging the {N} 7 upgrade PR I haven't run the demo on this project. The readme def needs an upgrade, I'll do that this weekend and let you know on this thread :)


Update De-Identification Handbook

Proposal Editor: Soyean Kim, CIDGOH, Kyoohyung Han, Hyojin Yoon, Samsung SDS,

https://github.com/IHE/IT-Infrastructure/blob/master/Proposals/IHE_Profile_Proposal_DeId-Update-Brief.docx

Excellent. thanks

thanks for the update :)


Fix Diagram for dependency

removed dependency

Codecov Report

Merging #259 (04f1e51) into master (e3fb5f4) will not change coverage.
The diff coverage is n/a.

@@            Coverage Diff            @@
##             master     #259   +/-   ##
=========================================
  Coverage     70.73%   70.73%
  Complexity      596      596
=========================================
  Files            85       85
  Lines          1924     1924
  Branches        259      259
=========================================
  Hits           1361     1361
  Misses          445      445
  Partials        118      118

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update e3fb5f4...04f1e51. Read the comment docs.


use of Docker not detected in some cases

I'm checking OEX packages for the existence of  Docker support..
Some cases were not detected if there is no Dockerfile but only
docker-compose.yaml or docker-compose.yml
examples:
iris-vector
BeI-MultiModel

and 2 more
https://openexchange.intersystems.com/package/iris-healthtoolkit-service
https://openexchange.intersystems.com/package/ETL-Interoperability-Adapter

Done. Wait for release. Can't detect for iris-vector because it's not cached by github

iris-vector on GitHub
sorry, I don't understand: "not indexed by github"  ??
who / what / where is this indexing done ?
I see docker-compose.yml in the repo

I mean I can't use github search in this repo

Done


Translated "Replace with Box Collider" button string on MeshCollider

Translated:

Inspector.MeshCollider.ReplaceBox

(this comment will be updated if more changes will be made before this pull request's merge/closing)

Thank you for the translation!


schema

hello,
can you please tell me where is the config to mount the model/ schema folder? Do i need to create the ConfigMap or do you have a better solution?
thank you

hi Kodeine,
Thanks for trying out the helm chart. Your question is surely going to benefit a lot of folks out there.
Here is my rationale:
I had to intentionally leave out the section around ways to mount your schema files as I have see a few implementation out in the wild:

Writing a script inside an init container that runs a "git pull" of your schema files inside the container's /cube/conf folder. This folder is already the mount point ( see the volumeMount section of the API deployment.
Take your schema files as config files and mount them as files under the /cube/conf folder.
Completely give up volume mounts and build you cube container with the schema files part of your image itself ( cube:latest being your docker container's base image

Benefits of each method
I do see 1) being a bit more flexible in terms of dynamically adjusting your apps to schema per environment ( you could pass the env var during deployment and your init container can use your env vars as variables as git branch name to pull for example)

is a simpler setup but starts creating issues if your schema files are too large to get inside your k8s cluster as a config map https://kubernetes.io/docs/concepts/configuration/configmap/#:~:text=A ConfigMap is not designed,separate database or file service. Works for smaller schemas but when running for enterprises, they can quickly get out of hand ( especially if you use cube dbt and tools like dagster to build you schema files)

creates a container that is immutable and is self contained and immutability allows some resilience to supply chain attacks since you can verify the full SHA has of your container and schema files as "one unit" before deployment. Although now it means that you need to keep building images for each environment

My humble preference has always been 1) However given these ideas, I would love to know if you see benefit of either of the 3 points.
I will be happy to share concrete yamls for the steps you feel works for you. I will also ensure i can add these as suggestions in the readme for other to benefit from.
Cheers.

will close the issue once you have a satisfactory answer/approach. thanks.

@narioinc thank you for your detailed answer.
In my opinion schema can change occasionally and its better if we can mount it via git pull. configmap is not viable for larger projects like you mentioned.
Following is the error i'm getting i think its because values.yaml does not have service object, did you mean to use {{- $svcPort := .Values.cubeApi.service.port -}}?
helm template . --name-template cubejs --namespace cubejs --values values.yaml
Error: template: cubejs/templates/ingress.yaml:3:23: executing "cubejs/templates/ingress.yaml" at <.Values.service.port>: nil pointer evaluating interface {}.port

@narioinc
i deployed the chart but i am getting 503 Service Temporarily Unavailable, any idea's?

HI @kodeine
My apologies for the delay in responding back. Got held up in office stuff.
while the chart template hosts an ingress, my original intention was to create a chart where cube is deployed completely internal to a cluster and never exposed out to the public network via ingress/LB
Because of that, i never really intent to allow the ingress object to get created. I could go ahead and make changes to allow ingress to operate, but then I am pretty sure that in your use case, you may still need to edit the ingress definition based on the host, domain, path params, etc
For now, can you quickly check a few things

DO no enable ingress: enabled: true. Keep it false.
See if your cube servcies come up and you are able to quickly port forward the cubeAPI services to your local machine and you can see the cubejs UI come up.

A quick side not, and a humble suggestion. If you are using this helm chart for an enterprise setup, I would suggest keeping the cube API layer internal and expose a layer on top of it ( a microservice that you can write) to abstract away some of the cubejs specific data models from your end clients. Even though cube is a "read-only" medium, providing any kind of direct access to cube APIs has always been a heated debate.
However, if you are using it personally, you can have enough safegaurds to ensure your DB protected against any access. In the meantime, ill try to get an Ingress resource for you mapping cubeapi to the root (/) of your host domain.
Also, a side note, Nginx itself is nowadays asking users to drop the older " Ingress resource" and use the more modern CRD ( Virtualserver and VirtualServerRoute) so I may drop the support for Ingress altogether in favor of  VS/VSR or a Kubernetes Gateway resource
Your thoughts on this ?

Hello,
So i was able to update the chart to fix the ingress and initContainer.
ingress is exposed as cluster ip to a load balaancer and i am using oauth2 for exposing it to the load balancer. Other than that i do use a microservice which uses the internal host of svc to utilize the api.
i will submit the PR to the repo shortly, that fixes the bug in ingress and service along with new feature of init container.

Thanks
Will review your changes and pull it in. 👍👍
On Fri, 27 Sep, 2024, 14:20 Kodeine, @.***> wrote:

Hello,
So i was able to update the chart to fix the ingress and initContainer.
ingress is exposed as cluster ip to a load balaancer and i am using oauth2
for exposing it to the load balancer. Other than that i do use a
microservice which uses the internal host of svc to utilize the api.
i will submit the PR to the repo shortly, that fixes the bug in ingress
and service along with new feature of init container.
—
Reply to this email directly, view it on GitHub
https://github.com/narioinc/cube-helm/issues/1#issuecomment-2378778169,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AB7U2KPWWJMBUPMEFOX45Q3ZYUL4VAVCNFSM6AAAAABOZED53WVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDGNZYG43TQMJWHE
.
You are receiving this because you were mentioned.Message ID:
@.***>


Update logback-classic to 1.4.0

Updates ch.qos.logback:logback-classic from 1.2.11 to 1.4.0.
I'll automatically update this PR to resolve conflicts as long as you don't change it yourself.
If you'd like to skip this version, you can just close this PR. If you have any feedback, just mention me in the comments below.
Configure Scala Steward for your repository with a .scala-steward.conf file.
Have a fantastic day writing Scala!

Adjust future updates
Add this to your .scala-steward.conf file to ignore future updates of this dependency:
updates.ignore = [ { groupId = "ch.qos.logback", artifactId = "logback-classic" } ]

Or, add this to slow down future updates of this dependency:
dependencyOverrides = [{
  pullRequests = { frequency = "@monthly" },
  dependency = { groupId = "ch.qos.logback", artifactId = "logback-classic" }
}]

labels: library-update, early-semver-minor, semver-spec-minor, commit-count:1

Superseded by #586.


A way to increase input length limitation?

Hi,
Is there a way to increase input length limitation of 512 tokens?
Maybe something to change in the code?

No way as far as I can tell, this is a fundamental limitation for absolute position pre-trained models (i.e. BERT, GPT, GPT-2)

Okay thank you!


Fixed #33256 -- Fixed schema test failures when using --keepdb.

Some tests leave models and for the second run of test,
model already exist error was created.
So models are deleted at the test it self

FWIW I think that's what self.local_models and self.isolated_local_models are for
https://github.com/django/django/blob/cfc7c3f17ce724d682753501652310159fab2eca/tests/schema/tests.py#L128-L133

Thank you @charettes for your advice, it works nice with self.isolated_local_models except test_unique_name_quoting test, because of altering table_name tearDown try to drop schema_table.
I search too much to make a copy of TagUniqueRename class, but I can't solve it, do you have any idea?

@felixxm Thanks for your precise review.
Why you think setting local_model and isolated_local_model most be must be outside of the context processor?

@felixxm Why does tests run correctly when I use isolated_local_models instead of local_models?

Why you think setting local_model and isolated_local_model most be must be outside of the context processor?

Adding models to local_models/isolated_local_models doesn't need to be in the context processor, so there is no reason to keep them there.

What's the next step?
Must I close the pull request?

What's the next step? Must I close the pull request?

Please don't do anything. I squashed commits and fixed one more case on Oracle.

buildbot, test on oracle.

What's the next step? Must I close the pull request?

Please don't do anything. I squashed commits and fixed one more case on Oracle.

Thanks for your nice support

Welcome aboard :boat:


Github error message when pushing

It seems pushing to the repo causes a Github error message. From what I get this is related to some checking job that fail but no idea exactly what...
It seems harmless as things are properly pushed to the repository and published but maybe worth checking...

So the problem was npm tests which were failing: I added a script npm_test_fix.sh that can be run when the tests are failing, it will try to fix automatically the detected errors and give a detailed report. It should be ok now.


GWS.GMAIL.23 Feedback

TLDR: I recommend cutting GWS.GMAIL.23. See below for my reasoning.
GWS.GMAIL.23.1v0.1
The policy currently reads as "Attachment compliance SHOULD be enabled to filter specific attachments within Gmail messages." However, attachment compliance is not a simple on/off setting, so saying it should be enabled doesn't really mean anything. Even after reading the implementation, it's unclear what we actually are telling the users to do. Attachment compliance allows you to construct custom rules (similar to EXO's mail flow rules). For example, you could craft a rule such as ""if you have an incoming email from an external sender, prepend 'External: ' to the subject line." Saying to enable attachment compliance without specific details about what rules to craft is meaningless. Recommend cutting this control.
GWS.GMAIL.23.2v0.1
It might be worth noting the limitations Gmail itself has with true file type detection. It can only perform this detection on a select few file types (see https://apps.google.com/supportwidget/articlehome?hl=en&article_url=https%3A%2F%2Fsupport.google.com%2Fa%2Fanswer%2F2364580%3Fhl%3Den&assistant_id=generic-unu&product_context=2364580&product_name=UnuFlow&trigger_context=a&fragment=file-types for more info). For all others it just matches by file extension. Given these limitations, I'm not sure if this a completely fair requirement.
GWS.GMAIL.23.3v0.1
Which file types should be blocked? "Executable" files are blocked by default, and can't be unblocked (https://support.google.com/mail/answer/6590?fl=1&sjid=1223071020538845302-NC#zippy=%2Cmessages-that-have-attachments). This is not the case for M365, so I don't think this control makes as much sense here.

NOTE: This control is note removed by #138. After that PR is merged into main, this issue now refers to GWS.GMAIL.19.1v0.1.

@adhilto We will discuss with the team and make a decision.

@adhilto We will remove the whole section from the baseline and defer to the hardening guide.

Changes were made and the PR was created.


Add linked list questions

Can you provide the question links?

https://practice.geeksforgeeks.org/problems/insert-in-a-sorted-list/1
https://leetcode.com/problems/linked-list-cycle-ii/submissions/
https://practice.geeksforgeeks.org/problems/identical-linked-lists/1


Redefine Variables

Good Day!
I just want to ask about changing variable names in the shopping cart. I noticed that only id, price, and name are present and i wanted to replace them and add another variables in it. How am I suppose to access it?
Thanks!

Add these items within the options. you can add unlimited amount of data to that last variable


Feature request: postinstall

Hey!
Would it be possible to add a postinstall to entries?
In my case, I'd like to install keybindings for fzf after installation (much like do in plug (https://github.com/junegunn/vim-plug#plug-options))
So it'd be something like brew 'fzf', postinstall: ['/usr/local/opt/fzf/install'].

I'm not sure I understand what this API is doing, is it just calling a command? If so, why is this not in the Homebrew formula post_install?

You might not want to have it mess with the built in recursive search in the terminal. I.e. it's opt-in, extra features

I still don't really understand what you're requesting here? Can you elaborate a lot more?

I would like to be able to specify a command to be automatically run after installation from Brewfile, similar to restart_service: :changed, e.g. post_install: [:changed, '/usr/local/opt/fzf/install'] (I haven't written ruby outside of a single class 3 years ago, so the syntax is probably wrong), to do some post processing work. This work is optional and opt-in
Does that clarify it? I don't know how brew works, might be better to add it directly to the formula, and pass a flag during brew install?

Ok, I understand, thanks. In this case you're better to have a script call brew bundle and then run your command of choice. https://github.com/github/scripts-to-rule-them-all is the pattern I recommend. Thanks!


Automated cherry pick of #9525: fix(scheduler): remove unused k8s extender

Cherry pick of #9525 on release/3.5.
#9525: fix(scheduler): remove unused k8s extender

Codecov Report

Merging #9526 (e88861f) into release/3.5 (6a15e02) will increase coverage by 11.92%.
The diff coverage is 1.85%.

@@               Coverage Diff                @@
##           release/3.5    #9526       +/-   ##
================================================
+ Coverage         5.98%   17.91%   +11.92%
================================================
  Files              796       85      -711
  Lines           125693     8921   -116772
================================================
- Hits              7522     1598     -5924
+ Misses          117504     7151   -110353
+ Partials           667      172      -495

Flag
Coverage Δ

aFlag
17.91% <1.85%> (+11.92%)
:arrow_up:

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files
Coverage Δ

pkg/apigateway/handler/auth.go
0.00% <0.00%> (ø)

.../monitor/alerting/conditions/suggestrulereducer.go
0.00% <0.00%> (ø)

pkg/monitor/alerting/conditions/suggestquery.go
2.00% <2.00%> (ø)

pkg/util/seclib2/seclib.go
80.39% <0.00%> (-5.66%)
:arrow_down:

pkg/keystone/models/regions.go

pkg/monitor/tsdb/driver/influxdb/query_parser.go

pkg/mcclient/options/k8s/certs.go

pkg/monitor/models/metric.go

pkg/cloudcommon/cronman/cronman.go

pkg/monitor/models/alertresourcedrivers.go

... and 596 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 0d67fcb...e88861f. Read the comment docs.


Unused lookahead1 call at ExprIf else parsing

This is where lookahead is created, but you uses input.peek:
https://github.com/dtolnay/syn/blob/e8a5c68ad45194e575a923f6b1e08f1817196331/src/expr.rs#L2144-L2155

Thanks! Good catch.


Add your GitHub profile to README

Please add your GitHub profile to README according to the example below.
This is a task for everyone to practice forking and pull request. So please don't fill up everything for your teammate (your PR will not be approved anyway). Of course, you are highly to help and teach each other.
Feel free to change the project name after discussing within your team members.
If this is your first time using GitHub, read this: https://github.com/MSU-AI/F22-projects/wiki/GitHub
0. Example

GitHub username

Owen-Cochell

AlexanderGrunewald

Sanya1001

@MSU-AI/jishateam
@MSU-AI/rachelteam
@MSU-AI/concept-map-extension-team
@MSU-AI/tanayteam
@MSU-AI/neelteam
@MSU-AI/zaneteam
@MSU-AI/nikateam
@MSU-AI/ai-firewall-team
@MSU-AI/kennethteam
@MSU-AI/matejateam


Keep exif data in proxied images

Hello,
Is it possible to keep exif data in the proxied images?
Not sure if this clashes with the pro /info/ endpoint which I could also use but it is unclear to me how a person can use the pro version for a personal website.
Thanks

Hi, I believe there are two ways to do it.
One is the global config, controlling exif stripping for jpeg & webp
IMGPROXY_STRIP_METADATA
https://docs.imgproxy.net/#/configuration?id=miscellaneous
The other one is a processing option on a case by case override
https://docs.imgproxy.net/#/generating_the_url_advanced?id=strip-metadata


clean + speed up

Description
Tried to clean up the code by:

Adding docs and type hinting
Making variable names more understandable
Removing redundancies
Absorbing / generalizing some functions

Todos
Notable points that this PR has either accomplished or will accomplish.

[x] Added documentation
[x] Added type-hinting
[x] Separated units into new file
[ ] Make new dictionary class with custom keyerror for when improper units are called
[x] Improved matrix calculation loops
[x] Made schrodinger_box + HO into one function, now just provide keyword (and freq.+mass for HO)
[x] Updated ipynbs accordingly
[ ] Possibly refactor into a "problem-type" class, with solve method and thermodynamic methods?

Questions

[ ] Can you explain the pes function in utilities.py?
[ ] Can you correct the thermo.ipynb errors (overflows at given frequency)
[ ] We should add some tests!!

Status

[x] Ready to go

Hi Jacob. Firstly, I apologize for the delay getting back to you. This summer has been very crazy with travel. Secondly, Thank you so much for contributing to this project. This was more or less my first project in python and I've always had intentions of going back to fix some things but you've really helped out! Your work on this is most appreciated.
I am merging your pull requests now. As for your questions: (1) the pes function in utilities.py was written to create a potential energy surface for a particle in a box, particle in a parabola, or arbitrary potentials, over the desired number of grid points (see here for more detail). (2) Thank you for addressing the overflow errors, I will take a look at them when I get a chance. (3) I will start adding tests as well.
As for my future vision for this project, I would like to find ways to incorporate it into the class room to give new physical chemistry students some hands on experience on how these type of things can be used to infere physical quantities such as Free Energy, entropy, heat capacities, etc. If you have any other ideas of what you would like to see incorporated into these modules please feel free to suggest any!
Regards,
Craig Waitt

Hi Craig, Thanks for the message. I have been quite busy myself but I'm glad to have helped. Time permitting I will try to come back to help grow the project. More visualizations would probably be helpful to future users and students! Be sure to let me know if you have any other stat mech related projects in the pipeline.
That's all for now,
Jacob


[VS] Debugging PowerShell projects after sharing can hang VS for host

Product and Version: Visual Studio 2017 Preview (15.6 Preview 3)
OS Version: Windows 10 Enterprise 64-bit
Live Share Extension Version: 0.2.59
Target Platform or Language: PowerShell
Steps to Reproduce / Scenario:
[Host/Guest]: Install PowerShell tools for VS
[Host] Create a new PowerShell script project
[Host] Open Script.ps1
[Host] Add a few Write-Host statements and place a breakpoint by one
[Host] Share
[Host] Start debugging
Expected: PowerShell execution begins, stops at breakpoint
Actual: VS hangs on host side even w/o guest connected.  If a guest is connected they get an operation timeout error.

This appears to have been fixed with the set of debugger updates and tweaks that went in with extension 0.2.258


[bug] fix dpnp/dpctl slowdown in fit method of neighbors algorithms

Description
There is a 400x performance difference in running fit using dpnp arrays/dpctl tensors vs config_context with a device offload. This is not due to the movement off of GPU, but due to numpy calls on dpnp/dpctl in _fit_validation.  By moving that call within the onedal_cpu_supported and onedal_gpu_supported, the input data is guaranteed to by numpy arrays, and therefore gets the equivalent performance of config_context.
There issues were discovered in #1737 and #1776 and should speed up CI in those cases substantially for both CPU and GPU offloading via dpnp/dpctl.
Changes proposed in this pull request:

move _fit_validation for LocalOutlierFactor
move _fit_validation for NearestNeighbors
move _fit_validation for KNeighborsClassifier
move _fit_validation for KNeighborsRegressor

/intelci: run

lof has a slow method score_samples which also will need to be added

LGTM but 2 questions - are there any other algos where this inefficiency is present? and 400x speedup on fit? because for knn fit should be minimal in terms of runtime

yeah it was weird, it took 160s to run when normally it was .4s. its mainly because some math was being done outside the dispatch call, which is rather unusual


Changes to handle schedule state

Hi Marcus,
added functions to extract the schedule state as "true" => "smart plug is scheduled on" and "false" => "smart plug is not scheduled or scheduled off". Pull request for pimatic-edimax follows.
Feel free to optimize my code ;-)

Excellent. Thank you very much for your contribution.
Sorry, the project file are in DOS mode by accident.
I have cherry-picked your last commit, manually.  Thus, I am closing the PR now.


blob.download_to_filename fails with google-cloud-storage==1.3.0

Due to the notable implementation changes in google-cloud-storage 1.3.0, the blob.download_to_filename fails whatever google-cloud from 0.24.0 to 0.27.0 (latest)
Our prod server which using google-cloud==0.24.0 has been broken since last Saturday. I analyzed a bit the error. The problem is come from the upgraded package google-cloud-storage==1.3.0. We are using the google-cloud-storage==1.2.0.
I did several tests which figured out the following problems:
Problem 1: blob.download_to_filename failed when using google-cloud==0.27.0 (included google-cloud-storage==1.3.0 as default, defined in setup.py). Here is a part of stacktrace:
blob.download_to_filename(blob_local_path)
  File "/root/.local/lib/python2.7/site-packages/google/cloud/storage/blob.py", line 482, in download_to_filename
    self.download_to_file(file_obj, client=client)
  File "/root/.local/lib/python2.7/site-packages/google/cloud/storage/blob.py", line 464, in download_to_file
    self._do_download(transport, file_obj, download_url, headers)
  File "/root/.local/lib/python2.7/site-packages/google/cloud/storage/blob.py", line 418, in _do_download
    download.consume(transport)
  File "/root/.local/lib/python2.7/site-packages/google/resumable_media/requests/download.py", line 101, in consume
    self._write_to_stream(result)
  File "/root/.local/lib/python2.7/site-packages/google/resumable_media/requests/download.py", line 62, in _write_to_stream
    with response:
AttributeError: __exit__

Problem 2: blob.download_to_filename failed when using google-cloud==0.24.0 (included google-cloud-storage==1.3.0 as default, defined in setup.py). Here is a part of stacktrace:
File "dev_env/python_venv/local/lib/python2.7/site-packages/google/cloud/storage/blob.py", line 482, in download_to_filename
    self.download_to_file(file_obj, client=client)
  File "dev_env/python_venv/local/lib/python2.7/site-packages/google/cloud/storage/blob.py", line 464, in download_to_file
    self._do_download(transport, file_obj, download_url, headers)
  File "dev_env/python_venv/local/lib/python2.7/site-packages/google/cloud/storage/blob.py", line 418, in _do_download
    download.consume(transport)
  File "dev_env/python_venv/local/lib/python2.7/site-packages/google/resumable_media/requests/download.py", line 96, in consume
    transport, method, url, **request_kwargs)
  File "dev_env/python_venv/local/lib/python2.7/site-packages/google/resumable_media/requests/_helpers.py", line 101, in http_request
    func, RequestsMixin._get_status_code, retry_strategy)
  File "dev_env/python_venv/local/lib/python2.7/site-packages/google/resumable_media/_helpers.py", line 146, in wait_and_retry
    response = func()
  File "dev_env/python_venv/local/lib/python2.7/site-packages/google_auth_httplib2.py", line 198, in request
    uri, method, body=body, headers=request_headers, **kwargs)
TypeError: request() got an unexpected keyword argument 'data'

So, why it happened? I realized that in the REQUIREMENTS of the package google-cloud which is defined in the file setup.py. An example for google-cloud==0.27.0 https://github.com/GoogleCloudPlatform/google-cloud-python/blob/master/setup.py#L67

google-cloud==0.24.0 requires google-cloud-storage >= 1.0.0 and < 2.0dev
google-cloud==0.25.0 requires google-cloud-storage >= 1.1.0 and < 2.0dev  => https://github.com/GoogleCloudPlatform/google-cloud-python/commit/bd9fdfba07fac63a91847628613928a569250c0f#diff-2eeaed663bd0d25b7e608891384b7298R66
google-cloud==0.25.1 requires google-cloud-storage >= 1.1.0 and < 1.2dev  => https://github.com/GoogleCloudPlatform/google-cloud-python/commit/ad4b02c88088666e298aa53cd61687b461c09191#diff-2eeaed663bd0d25b7e608891384b7298R66
google-cloud==0.26.0 requires google-cloud-storage >= 1.2.0 and < 2.0dev => https://github.com/GoogleCloudPlatform/google-cloud-python/commit/214aba604fbcaa9e4936fa1798efde050389992a#diff-2eeaed663bd0d25b7e608891384b7298R67
google-cloud==0.26.1 requires google-cloud-storage >= 1.2.0 and < 1.3dev => https://github.com/GoogleCloudPlatform/google-cloud-python/commit/ea5245ad27e777c654448a259a9fa5f6bf5d758e#diff-2eeaed663bd0d25b7e608891384b7298R67
google-cloud==0.27.0 requires google-cloud-storage >= 1.3.0 and < 1.4dev => https://github.com/GoogleCloudPlatform/google-cloud-python/blob/master/setup.py#L67

We can see that if we only define google-cloud==[0.24.0 to 0.27.0], "pip install" always try to install google-cloud-storage 1.3.0 which requires the dependencies google-cloud-core ~= 0.26. That's why the bug happens.
Solution:

Downgrade to google-cloud < 0.27.0 and force the requirements google-cloud-storage < 1.3.0
The problem seems still there with google-cloud==0.27.0 and google-cloud-storage==1.3.0 (to check but at least it has been broken for my case, see Problem 2 above)

Suggestion: better manage the deps for google-cloud in setup.py.
Thanks.

@sonlac It looks like you're using a custom transport. When constructing Client, are you passing a custom _http argument? (Note that the leading underscore in _http is a "user-beware" signal.)
For reference, see the release notes:

https://github.com/GoogleCloudPlatform/google-cloud-python/releases/tag/storage-1.3.0
https://github.com/GoogleCloudPlatform/google-cloud-python/releases/tag/core-0.26.0

@dhermes Thank you for your quick reply. No, I didn't pass anything as custom argument. I am using the latest code to test, all arguments are default ones.
It seems that this change https://github.com/GoogleCloudPlatform/google-cloud-python/pull/3705/files makes the google-cloud-storage 1.3.0 broken?
For my part, I am trying to get the logs for more details...

Before making a request, can you print client._http?

RE: #3705, notice the code in _make_transport and compare it to the _http property. You'll see they are the same. Also, using the default _http, our system tests are passing.

@sonlac Can you give us the output of pip freeze? In particular, I would like to see what version of requests you have installed.
If it is a semi-old one, can you also try updating requests to the newest version and tell us if that fixes your issue?

Thank you @dhermes @lukesneeringer for the comments. So, the problem 1 is about "user-beware". It's was not a bug. For the problem 2, I could not reproduce it in a context "out-of-box". I've just tested a simple code using download_to_filename, it worked with latest ones: google-cloud 0.27.0 and goole-cloud-storage 1.3.0. In fact, I've run the code inside a ML engine, so it'd take time to get more logs... I'll back to you for more information.
pip freeze
cachetools==2.0.0 certifi==2<IP_ADDRESS> chardet==3.0.4 dill==<IP_ADDRESS> enum34==1.1.6 future==0.16.0 futures==3.1.1 gapic-google-cloud-datastore-v1==0.15.3 gapic-google-cloud-error-reporting-v1beta1==0.15.3 gapic-google-cloud-logging-v2==0.91.3 gapic-google-cloud-pubsub-v1==0.15.4 gapic-google-cloud-spanner-admin-database-v1==0.15.3 gapic-google-cloud-spanner-admin-instance-v1==0.15.3 gapic-google-cloud-spanner-v1==0.15.3 google-auth==1.0.2 google-cloud==0.27.0 google-cloud-bigquery==0.26.0 google-cloud-bigtable==0.26.0 google-cloud-core==0.26.0 google-cloud-datastore==1.2.0 google-cloud-dns==0.26.0 google-cloud-error-reporting==0.26.0 google-cloud-language==0.27.0 google-cloud-logging==1.2.0 google-cloud-monitoring==0.26.0 google-cloud-pubsub==0.27.0 google-cloud-resource-manager==0.26.0 google-cloud-runtimeconfig==0.26.0 google-cloud-spanner==0.26.0 google-cloud-speech==0.28.0 google-cloud-storage==1.3.0 google-cloud-translate==1.1.0 google-cloud-videointelligence==0.25.0 google-cloud-vision==0.26.0 google-gax==0.15.13 google-resumable-media==0.2.2 googleapis-common-protos==1.5.2 grpc-google-iam-v1==0.11.1 grpcio==1.4.0 httplib2==0.10.3 idna==2.5 monotonic==1.3 oauth2client==3.0.0 ply==3.8 proto-google-cloud-datastore-v1==0.90.4 proto-google-cloud-error-reporting-v1beta1==0.15.3 proto-google-cloud-logging-v2==0.91.3 proto-google-cloud-pubsub-v1==0.15.4 proto-google-cloud-spanner-admin-database-v1==0.15.3 proto-google-cloud-spanner-admin-instance-v1==0.15.3 proto-google-cloud-spanner-v1==0.15.3 protobuf==3.3.0 pyasn1==0.3.2 pyasn1-modules==0.0.11 requests==2.18.3 rsa==3.4.2 six==1.10.0 tenacity==4.4.0 urllib3==1.22

@sonlac I am going to preemptively close this based on

I could not reproduce it in a context "out-of-box"

We're happy to keep discussing and re-open if there does turn out to be some issue.

Hey guys, faced same issue here.  Code ran fine on my local mac machine and ubuntu VM in Compute Engine, but failed on Debian VM in Compute engine that was deployed through Salt.
pip freeze showed requests==2.7.0 on Debian VM whereas it is requests==2.18.3 on my machine. So I ran pip install --upgrade requests and AttributeError: exit exception that broke the flow is gone

@lukesneeringer @jonparrott We should probably do a release of storage that enforces that lower bound (code is already in master)?

Seems reasonable

Hello, I'm having the same problem here.  It's really easy for me to reproduce, and I'm using a Google  Cloud Compute VM running ubuntu 16.0.4.  I don't think it's just a cloud-storage/requests versioning issue as I have the latest version of both installed, as well as the latest of google-cloud
I can reproduce the bug really simply.
from google.cloud import storage client = storage.Client() bucket = client.get_bucket(<STORAGE_BUCKET>) blob = bucket.get_blob(<PATH_TO_VIDEO>) blob.download_to_filename(<LOCAL_PATH_TO_VIDEO>)
will raise
Traceback (most recent call last):   File "<stdin>", line 1, in <module>   File "/usr/local/lib/python3.5/dist-packages/google/cloud/storage/blob.py", line 482, in download_to_filename     self.download_to_file(file_obj, client=client)   File "/usr/local/lib/python3.5/dist-packages/google/cloud/storage/blob.py", line 464, in download_to_file     self._do_download(transport, file_obj, download_url, headers)   File "/usr/local/lib/python3.5/dist-packages/google/cloud/storage/blob.py", line 418, in _do_download     download.consume(transport)   File "/usr/local/lib/python3.5/dist-packages/google/resumable_media/requests/download.py", line 101, in consume     self._write_to_stream(result)   File "/usr/local/lib/python3.5/dist-packages/google/resumable_media/requests/download.py", line 62, in _write_to_ stream     with response: AttributeError: __exit__
Finally, here is my pip freeze (pip3 freeze):
bleach==1.5.0
blinker==1.3
boto==2.38.0
cachetools==2.0.1
certifi==2<IP_ADDRESS>
chardet==2.3.0
cloud-init==0.7.9
command-not-found==0.3
configobj==5.0.6
cryptography==1.2.3
dill==<IP_ADDRESS>
future==0.16.0
gapic-google-cloud-datastore-v1==0.15.3
gapic-google-cloud-error-reporting-v1beta1==0.15.3
gapic-google-cloud-logging-v2==0.91.3
gapic-google-cloud-pubsub-v1==0.15.4
gapic-google-cloud-spanner-admin-database-v1==0.15.3
gapic-google-cloud-spanner-admin-instance-v1==0.15.3
gapic-google-cloud-spanner-v1==0.15.3
google-auth==1.0.2
google-cloud==0.27.0
google-cloud-bigquery==0.26.0
google-cloud-bigtable==0.26.0
google-cloud-core==0.26.0
google-cloud-datastore==1.2.0
google-cloud-dns==0.26.0
google-cloud-error-reporting==0.26.0
google-cloud-language==0.27.0
google-cloud-logging==1.2.0
google-cloud-monitoring==0.26.0
google-cloud-pubsub==0.27.0
google-cloud-resource-manager==0.26.0
google-cloud-runtimeconfig==0.26.0
google-cloud-spanner==0.26.0
google-cloud-speech==0.28.0
google-cloud-storage==1.3.2
google-cloud-translate==1.1.0
google-cloud-videointelligence==0.25.0
google-cloud-vision==0.26.0
google-compute-engine==2.4.1
google-gax==0.15.14
google-resumable-media==0.2.3
googleapis-common-protos==1.5.2
grpc-google-iam-v1==0.11.1
grpcio==1.4.0
html5lib==0.9999999
httplib2==0.10.3
idna==2.0
imutils==0.4.3
Jinja2==2.8
jsonpatch==1.10
jsonpointer==1.9
language-selector==0.1
Markdown==2.6.9
MarkupSafe==0.23
monotonic==1.3
numpy==1.13.1
oauth2client==3.0.0
oauthlib==1.0.3
ply==3.8
prettytable==0.7.2
proto-google-cloud-datastore-v1==0.90.4
proto-google-cloud-error-reporting-v1beta1==0.15.3
proto-google-cloud-logging-v2==0.91.3
proto-google-cloud-pubsub-v1==0.15.4
proto-google-cloud-spanner-admin-database-v1==0.15.3
proto-google-cloud-spanner-admin-instance-v1==0.15.3
proto-google-cloud-spanner-v1==0.15.3
protobuf==3.4.0
pyasn1==0.3.2
pyasn1-modules==0.0.11
pycurl==7.43.0
pygobject==3.20.0
PyJWT==1.3.0
pyserial==3.0.1
python-apt==1.1.0b1
python-debian==0.1.27
python-systemd==231
PyYAML==3.11
requests==2.9.1
rsa==3.4.2
six==1.10.0
ssh-import-id==5.5
tenacity==4.4.0
tensorflow==1.3.0
tensorflow-gpu==1.3.0
tensorflow-tensorboard==0.1.4
ufw==0.35
unattended-upgrades==0.1
urllib3==1.13.1
Werkzeug==0.12.2

@ashwathnrajan You have requests==2.9.1, we need >= 2.18.0.

meh.  one day i'll learn to compare numbers.  thanks, i'm sure this will fix it

I'm getting this error with the follow versions
requests==2.18.4
google-cloud-storage==1.3.2

this is my entire pip freeze output
+ pip freeze
alembic==0.9.5
arrow==0.8.0
beautifulsoup4==4.6.0
boto==2.48.0
bz2file==0.98
cachetools==2.0.1
certifi==2<IP_ADDRESS>
chardet==3.0.4
colander==1.3.3
configparser==3.5.0
cornice==2.4.0
cymem==1.31.2
cytoolz==0.8.2
datastuffpy==0.4.5
dill==<IP_ADDRESS>
docopt==0.6.2
elasticsearch==5.4.0
elasticsearch-dsl==5.3.0
email-reply-parser==0.5.9
fire==0.1.2
future==0.16.0
gapic-google-cloud-datastore-v1==0.15.3
gapic-google-cloud-error-reporting-v1beta1==0.15.3
gapic-google-cloud-logging-v2==0.91.3
gapic-google-cloud-pubsub-v1==0.15.4
gapic-google-cloud-spanner-admin-database-v1==0.15.3
gapic-google-cloud-spanner-admin-instance-v1==0.15.3
gapic-google-cloud-spanner-v1==0.15.3
gensim==3.0.0
google-api-python-client==1.6.4
google-auth==1.1.1
google-cloud==0.27.0
google-cloud-bigquery==0.26.0
google-cloud-bigtable==0.26.0
google-cloud-core==0.26.0
google-cloud-datastore==1.2.0
google-cloud-dns==0.26.0
google-cloud-error-reporting==0.26.0
google-cloud-language==0.27.0
google-cloud-logging==1.2.0
google-cloud-monitoring==0.26.0
google-cloud-pubsub==0.27.0
google-cloud-resource-manager==0.26.0
google-cloud-runtimeconfig==0.26.0
google-cloud-spanner==0.26.0
google-cloud-speech==0.28.0
google-cloud-storage==1.3.2
google-cloud-translate==1.1.0
google-cloud-videointelligence==0.25.0
google-cloud-vision==0.26.0
google-gax==0.15.15
google-resumable-media==0.2.3
googleapis-common-protos==1.5.3
grpc-google-iam-v1==0.11.4
grpcio==1.6.3
httplib2==0.10.3
hupper==1.0
idna==2.6
iso8601==0.1.11
lightgbm==2.0.7
Mako==1.0.7
MarkupSafe==1.0
marshmallow==2.13.6
monotonic==1.3
murmurhash==0.26.4
nextiva.nlp==0.2.91
nltk==3.2.5
numpy==1.13.3
oauth2client==3.0.0
pandas==0.20.3
PasteDeploy==1.5.2
pathlib==1.0.1
pkg-resources==0.0.0
plac==0.9.6
ply==3.8
preshed==1.0.0
proto-google-cloud-datastore-v1==0.90.4
proto-google-cloud-error-reporting-v1beta1==0.15.3
proto-google-cloud-logging-v2==0.91.3
proto-google-cloud-pubsub-v1==0.15.4
proto-google-cloud-spanner-admin-database-v1==0.15.3
proto-google-cloud-spanner-admin-instance-v1==0.15.3
proto-google-cloud-spanner-v1==0.15.3
protobuf==3.4.0
psycopg2==<IP_ADDRESS>
pyasn1==0.3.7
pyasn1-modules==0.1.4
pyramid==1.8.3
python-dateutil==2.6.1
python-editor==1.0.3
pytz==2017.2
raven==6.2.1
regex==2017.4.5
repoze.lru==0.7
requests==2.18.4
rsa==3.4.2
scikit-learn==0.18
scipy==0.19.1
simplejson==3.11.1
six==1.11.0
sklearn==0.0
smart-open==1.5.3
sox==1.3.0
spacy==1.7.5
SQLAlchemy==1.1.14
tenacity==4.4.0
termcolor==1.1.0
thinc==6.5.2
tinydb==3.6.0
toolz==0.8.2
tqdm==4.19.2
translationstring==1.3
ujson==1.35
uritemplate==3.0.0
urllib3==1.22
venusian==1.1.0
waitress==1.0.2
WebOb==1.7.3
wrapt==1.10.11
zope.deprecation==4.3.0
zope.interface==4.4.3

Almost identical virtualenv on my mac won't raise this error.
The error I'm getting is on debian
.env/lib/python3.5/site-packages/datastuffpy/storages/google/bucket.py:88: in download
    blob.download_to_file(file_obj)
.env/lib/python3.5/site-packages/google/cloud/storage/blob.py:464: in download_to_file
    self._do_download(transport, file_obj, download_url, headers)
.env/lib/python3.5/site-packages/google/cloud/storage/blob.py:418: in _do_download
    download.consume(transport)
.env/lib/python3.5/site-packages/google/resumable_media/requests/download.py:101: in consume
    self._write_to_stream(result)
.env/lib/python3.5/site-packages/google/resumable_media/requests/download.py:62: in _write_to_stream
    with response:
E   AttributeError: __exit__

Any advice would be appreciated.

@naoko Run pip show requests to make sure that is the version of pip you think it is.

@dhermes , thank you for your quick response. It seems that version matches to what shows on pip freeze... :(
+ pip show requests
Name: requests
Version: 2.18.4
Summary: Python HTTP for Humans.
Home-page: http://python-requests.org
Author: Kenneth Reitz
Author-email<EMAIL_ADDRESS>License: Apache 2.0
Location: /opt/jenkins/workspace/ML-API-Test/.env/lib/python3.5/site-packages
Requires: urllib3, idna, chardet, certifi

Is the Location (/opt/jenkins/workspace/ML-API-Test/.env/lib/python3.5/site-packages) the same as env/lib/python3.5/site-packages in your stacktrace? (The one in the stacktrace was a relative path, that's why I ask.)

For some reason, running that in Jenkins was so hard (looks like it strips single quote...)
$ command=( python3.5 -c $'import requests\nprint(requests.__file__)\nprint(requests.__version__)' )
$ "${command[@]}"

But the goal is to show that version of requests is really >= 2.18.0 or not on actual running environment. So right above where I run tests, I ran pip install -U requests which goes .env/lib/python3.5/site-packages and the exception is raised from .env/lib/python3.5/site-packages/google/resumable_media/requests/download.py so I have to think it does have latest version there... but I understand that I can only replicate this on one environment and I should not waste any more of your time. Thank you @dhermes for your time. I will think of other way to run jenkins job.
+ pip install -U requests
Requirement already up-to-date: requests in ./.env/lib/python3.5/site-packages
Requirement already up-to-date: idna<2.7,>=2.5 in ./.env/lib/python3.5/site-packages (from requests)
Requirement already up-to-date: certifi>=2017.4.17 in ./.env/lib/python3.5/site-packages (from requests)
Requirement already up-to-date: urllib3<1.23,>=1.21.1 in ./.env/lib/python3.5/site-packages (from requests)
Requirement already up-to-date: chardet<3.1.0,>=3.0.2 in ./.env/lib/python3.5/site-packages (from requests)

.env/lib/python3.5/site-packages/google/resumable_media/requests/download.py:62: in _write_to_stream
    with response:
E   AttributeError: __exit__

I don't know if it will help but I was able to solve the second issue (TypeError: request() got an unexpected keyword argument 'data' )
by initializing the client with my project_name like this
client = storage.Client(PROJECT_NAME) #without PROJECT_NAME it breaks
bucket = client.get_bucket(bucket_name)
blob = bucket.get_blob(filename)
return blob.download_as_string()

Hey there, I'm experiencing this issue too.
google-cloud-storage == 1.6
requests == 2.18.4
Error
google\resumable_media\requests\download.py", line 117, in _write_to_stream
    with response:
AttributeError: __exit__

@swirlingsand are you sure you have requests 2.18.4? Can you verify with import requests; print(requests.__version__)?

My apologies I think this was something with my conda setup.
pip show requests  yielded 2.18,
however running that print statement showed 2.14
Thanks for help @jonparrott

No worries!
On Thu, Feb 22, 2018, 5:37 PM Anthony Sarkis<EMAIL_ADDRESS>wrote:

My apologies I think this was something with my conda setup.
pip show requests yielded 2.18,
however running that print statement showed 2.14
Thanks for help @jonparrott https://github.com/jonparrott
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/GoogleCloudPlatform/google-cloud-python/issues/3736#issuecomment-367882112,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AAPUc6G-tqGhrSySz7e2USQPsEdhjltfks5tXhZugaJpZM4OvlIi
.

I had to uninstall requests 2.18.4 (pip uninstall requests) and install 2.18.0 (pip install requests==2.18.0) to make it work

I downgraded google-cloud-storage to 1.6.0 too. So
google-cloud-storage==1.6.0
requests==2.18.0

Hi all, any idea  on how to make this work on Cloud Composer? I am migrating DAGs from our current environment to Cloud Composer however I get this error even when I install  google-cloud-storage==1.6.0 and requests==2.18.0 as PyPI package.
[2018-08-20 09:32:09,128] {base_task_runner.py:98} INFO - Subtask: [2018-08-20 09:32:09,127] {bash_operator.py:101} INFO - from google.cloud import bigquery
[2018-08-20 09:32:09,129] {base_task_runner.py:98} INFO - Subtask: [2018-08-20 09:32:09,129] {bash_operator.py:101} INFO - File "/usr/local/lib/python2.7/site-packages/google/cloud/bigquery/init.py", line 32, in
[2018-08-20 09:32:09,130] {base_task_runner.py:98} INFO - Subtask: [2018-08-20 09:32:09,130] {bash_operator.py:101} INFO - from google.cloud.bigquery.client import Client
[2018-08-20 09:32:09,131] {base_task_runner.py:98} INFO - Subtask: [2018-08-20 09:32:09,131] {bash_operator.py:101} INFO - File "/usr/local/lib/python2.7/site-packages/google/cloud/bigquery/client.py", line 20, in
[2018-08-20 09:32:09,132] {base_task_runner.py:98} INFO - Subtask: [2018-08-20 09:32:09,132] {bash_operator.py:101} INFO - from google.cloud.bigquery.dataset import Dataset
[2018-08-20 09:32:09,133] {base_task_runner.py:98} INFO - Subtask: [2018-08-20 09:32:09,133] {bash_operator.py:101} INFO - File "/usr/local/lib/python2.7/site-packages/google/cloud/bigquery/dataset.py", line 20, in
[2018-08-20 09:32:09,134] {base_task_runner.py:98} INFO - Subtask: [2018-08-20 09:32:09,134] {bash_operator.py:101} INFO - from google.cloud.bigquery.table import Table
[2018-08-20 09:32:09,140] {base_task_runner.py:98} INFO - Subtask: [2018-08-20 09:32:09,137] {bash_operator.py:101} INFO - File "/usr/local/lib/python2.7/site-packages/google/cloud/bigquery/table.py", line 27, in
[2018-08-20 09:32:09,141] {base_task_runner.py:98} INFO - Subtask: [2018-08-20 09:32:09,138] {bash_operator.py:101} INFO - from google.cloud.exceptions import make_exception
[2018-08-20 09:32:09,142] {base_task_runner.py:98} INFO - Subtask: [2018-08-20 09:32:09,138] {bash_operator.py:101} INFO - ImportError: cannot import name make_exception
[2018-08-20 09:32:09,733] {base_task_runner.py:98} INFO - Subtask: [2018-08-20 09:32:09,730] {bash_operator.py:105} INFO - Command exited with return code 1

Hi @jocieA, with your logs I am assuming that your problem is not in the module google-cloud-storage==1.6.0 but rather in the module google-cloud-bigquery. You can do a pip freeze to see your installed bigquery module. I am not working with Cloud Composer service but I am very familiar with Airflow DAGs, your task (using Airflow BashOperator) should work correctly "out-of-box". It should be working by using the command-line out of context of AIRFLOW/Cloud Composer. You just need to debug your own Airflow task/program.
Concretely, I saw in your logs, the error ImportError: cannot import name make_exception is in line 27 of the file google/cloud/bigquery/table.py. Your installed bigquery module could be incompatible?
Hope this helps. Thanks.

For anyone else running into this issue with Google Cloud Composer, I ran into it after adding apache-beam[gcp]==2.6.0 to my Composer dependencies.
The issue here was that apache-beam is installing google-cloud-bigquery==0.25.0, which causes a bunch of other packages to be downgraded.
The fix for me was to explicitly state/install google-cloud-core>=0.28.0 google-cloud-bigquery>=1.5.0 AFTER apache-beam[gcp]==2.6.0 in requirements.txt file used to specify Composer dependencies:
https://cloud.google.com/sdk/gcloud/reference/composer/environments/update
gcloud composer environments update ENVIRONMENT --location=LOCATION \
    --update-pypi-packages-from-file requirements.txt

Hi @sjungwirth and @sonlac ,
Thanks for getting back on my post, these have been very useful.
I recently tried running my pipeline on the latest version of cloud composer (1.1.0) and it worked without specifying versions of google cloud core, big query, cloud storage, requests etc. I think some improvements have been made to address this issue. Currently i'm looking forward to upgrade my existing environment to the new version.

Is this issue resolved ? what is the solution


api/services: manage community deletion

After a community deletion:

[ ] It shouldn't be possible to create a community with the same ID

Handled in #202


Frontend fails to request some JS files

       GET https://www.railsbump.org/qwerty/js/script.js 404 (Not Found)
       GET https://kit.fontawesome.com/0d43dadb44.js net::ERR_ABORTED 403 (Forbidden)

How to reproduce:

just open the home page with dev tools open

@manuelmeurer I don't see anything broken even with this JS load error. Do you remember why these resources were needed?
@arielj Do you see any of the icons broken due to the fontawesome load error?

yeah, the icons are missing for me, from the HTML I should see a github icon at the top right next to the other nav links, but nothing

I tried with Chrome, Firefox and Opera and it's the same in the three browsers


⚠ Bofrost.be has degraded performance

In 5f6e845, Bofrost.be (https://www.bofrost.be) experienced degraded performance:

HTTP code: 200
Response time: 2209 ms

Resolved: Bofrost.be performance has improved in ac785cf after 13 minutes.


Add support for Gitlab group access tokens API.

This PR adds support for the Gitlab group access tokens API (list get create revoke).
See https://docs.gitlab.com/ee/api/group_access_tokens.html

@jperville  could you reopen this pr?
@NARKOZ could you reopen and review this pr please?

Merged via b5a5ff7
Thank you ❤


Dev14.2 + Dev15 SxS debugger doesn't start

Click Attach debugger
Unable to start debugging.
The system cannot find the file specified.
Repairing Dev14 doesn't help.
 	mscorlib.dll!System.Runtime.InteropServices.Marshal.ThrowExceptionForHR(int errorCode)	Unknown
>	Microsoft.VisualStudio.R.Package.dll!Microsoft.VisualStudio.R.Package.Repl.Debugger.AttachDebuggerCommand.Handle() Line 64	C#
 	Microsoft.VisualStudio.R.Package.dll!Microsoft.VisualStudio.R.Package.Commands.PackageCommand.OnCommand(object sender, System.EventArgs args) Line 26	C#

Was the original repro with F5, or did you use installers for both?

F5

Basically Dev15 installed, not running. Dev14 with RTVS, F5.

Okay; I cannot repro this with VS2015 U2 and Dev15 25123.0. If you still have a machine with both, can you try again and see if it still repros for you?

Sure we can try my laptop. will let you know.

Did you get a repro?

For whatever reason it started working now.


Support for multiple primary keys for reference types

Is there any plans to implement this in the near future?
We have a project that has hundreds of tables containing multiple primary keys.
Is there any solution for this?

I don't see why composite primary keys would not be allowed.  Entity Framework supports that scenario.  @Kanogi, can you please provide an example of what you are tying to do and the error you're receiving?

Tony,
I ran across an issue with this when I first started working with Trackable Entities.  The composite key had been added to my table just to accomplish something with an earlier version of EF, so I just removed it and moved on.  Thanks for a great tool!
Anyway, I think the issue was here in DbContextExtensions, where the count of members in the primary key has to be 1.
private static string GetPrimaryKeyName(this DbContext dbContext, System.Type entityType)
{
  EntityType edmSpaceType = DbContextExtensions.GetEdmSpaceType(dbContext, entityType);
  if (edmSpaceType == null)
    return (string) null;
  if (((ReadOnlyCollection<EdmMember>) ((EntityTypeBase) edmSpaceType).get_KeyMembers()).Count > 1)
    return (string) null;
  return Enumerable.FirstOrDefault<string>(Enumerable.Select<EdmMember, string>((IEnumerable<EdmMember>) ((EntityTypeBase) edmSpaceType).get_KeyMembers(), (Func<EdmMember, string>) (k => k.get_Name())));
}

@azabluda, Would you happen to have any time to look at this? Thanks!

@tonysneed Being on a business trip until the end on the next week, I could only have a very brief look at the GetPrimaryKeyName function. If I'm not mistaken it is only used by LoadRelatedEntities extension method, which always looked to me a bit alien to TE and limited in many ways. I would rather opt for excluding it from the standard distribution.
If LoadRelatedEntities is the only method which requires single PKs, then my advice to @HDB2000 would be to just try go without it.
Apart from that I join Tony's comment and would appreciate an example (ideally a failing unit test) to speed up the development of the missing feature.


Sequence logo plots

Is there a way to plot a sequence logo? See http://weblogo.threeplusone.com/, for example.
If there isn't, maybe a plots recipe can be defined that takes letter weights and does this?

In case anyone else needs sequence logos from Julia, I made a very basic package: https://github.com/cossio/SequenceLogos.jl


Office365Groups List Group Members failed

Description
When the Request a Teams app first loads in Teams it displays the following banner error

Steps to reproduce

Start the Request a Teams app via Teams

Expected results
No error message
Actual Results
When the Request a Teams app first loads in Teams it displays the following banner error

Solution component
Power App
Operating system (environment)
Windows
Additional Info
No response

Issue was resolved by updating the Group ID in SharePoint "Team Request Settings" and then publishing the app via the PowerApps console.


Get rid of cluster.inventory["nodes"][i]["connection"]

We currently store fabric connection object directly in inventory. See defaults.apply_defaults():
cluster.inventory["nodes"][i]["connection"] = cluster.make_group([address])

This already caused some problems:

necessity to remove this object in finalize inventory procedure (defauls.prepare_for_dump())
after inventory is finalized, methods which require this key, become not working.
if defauls.prepare_for_dump() is invoked with copy=True, this fabric connection is deep copied, which is undefined behaviour (at least, untill we prove that fabric allows such copying and this will not be broken during future upgrades of fabric).

Instead, I suggest to either entirely get rid of such caches of connections, or use other storage, for example cluster.context.

@ilia1243 Actual problem?


Authorization refactor

Authorization Refactor of following flows:

OgcFeatureAuthZ
ProcessAuthZ
StacAssetAuthZ
MeteringAuthZ

getAccess method is added in database service to get the access status of the resources.

Build finished.

For all the new handlers, the DX prefix is not needed - it was needed for the token authentication handler since we are using a DX/IUDX token

Also it might be good to call it ..AuthZHandler or AuthorizationHandler to make it clear what the handler is doing

Include javadoc for all handlers

Build finished.

Build finished.

Build finished.

retest this please

Build finished.


Can this component be handled that a user can't close the alert?

so only code close is possible.
i have read that you can do closeInterval={0} but can you also set the cancelBtnImageSrc to null without errors? and also disable tap to close?
I haven't tested this component yet.

Hi @jjdp
The closeInterval={0} will keep it open until action is taken either by pan gesture up or cancel button or tap the alert. But this also raises a question in which can the the alert be without a user action? No, because onPress will default to an action and pan gesture responders have no case to be disabled. I think maybe a prop like userInteractionEnabled={false} might address. I am going to add this.
Sorry for the delay. Hope this helps.

Hi @jjdp again
I added 2 new props tapToCloseEnabled and panResponderEnabled to satisfy the ability to disable user interaction for close. Also, showCancel should be false.
Hope this helps.


begin work on NaViT (wip)

a couple open source folks i talk to privately were excited about this paper
so i'll just get it built today and tomorrow

Hello @lucidrains !
Thank you a lot for your work on NaViT model. It's very impressive and useful.
Could you please provide some dummy example as you gave for ViT model?
I have tried to reproduce on the same example as for ViT, but caught an error:
---------------------------------------------------------------------------
AssertionError                            Traceback (most recent call last)
Cell In[55], line 9
      6 data = data.to(device)
      7 label = label.to(device)
----> 9 output = model(data)
     10 loss = criterion(output, label)
     12 optimizer.zero_grad()

File [~/anaconda3/envs/uni/lib/python3.10/site-packages/torch/nn/modules/module.py:1518](http://localhost:8888/lab/tree/Aalto/vit-pytorch/examples/anaconda3/envs/uni/lib/python3.10/site-packages/torch/nn/modules/module.py#line=1517), in Module._wrapped_call_impl(self, *args, **kwargs)
   1516     return self._compiled_call_impl(*args, **kwargs)  # type: ignore[misc]
   1517 else:
-> 1518     return self._call_impl(*args, **kwargs)

File [~/anaconda3/envs/uni/lib/python3.10/site-packages/torch/nn/modules/module.py:1527](http://localhost:8888/lab/tree/Aalto/vit-pytorch/examples/anaconda3/envs/uni/lib/python3.10/site-packages/torch/nn/modules/module.py#line=1526), in Module._call_impl(self, *args, **kwargs)
   1522 # If we don't have any hooks, we want to skip the rest of the logic in
   1523 # this function, and just call forward.
   1524 if not (self._backward_hooks or self._backward_pre_hooks or self._forward_hooks or self._forward_pre_hooks
   1525         or _global_backward_pre_hooks or _global_backward_hooks
   1526         or _global_forward_hooks or _global_forward_pre_hooks):
-> 1527     return forward_call(*args, **kwargs)
   1529 try:
   1530     result = None

File [~/anaconda3/envs/uni/lib/python3.10/site-packages/vit_pytorch/na_vit.py:284](http://localhost:8888/lab/tree/Aalto/vit-pytorch/examples/anaconda3/envs/uni/lib/python3.10/site-packages/vit_pytorch/na_vit.py#line=283), in NaViT.forward(self, batched_images, group_images, group_max_seq_len)
    279 image_ids = torch.empty((0,), device = device, dtype = torch.long)
    281 for image_id, image in enumerate(images):
    282     # print("Image.ndim: ", image.ndim)
    283     # print("Image.shape[0]: ", image.shape[0])
--> 284     assert image.ndim ==3 and image.shape[0] == c
    285     image_dims = image.shape[-2:]
    286     assert all([divisible_by(dim, p) for dim in image_dims]), f'height and width {image_dims} of images must be divisible by patch size {p}'

AssertionError:

The model I was trying to use is defined like this:
model = NaViT(
    image_size=224,
    patch_size=32,
    num_classes=2,
    channels=3,
    dim = 1024,
    depth = 6,
    heads = 16,
    mlp_dim = 2048,
    dropout = 0.1,
    emb_dropout = 0.1,
    token_dropout_prob = 0.1  # token dropout of 10% (keep 90% of tokens)
)

@b5y Assuming your input is a list of tensor images, each image in your input list must be of shape (c, x, y), where c is number of channels (in your case, 3). The assert statement is failing because either a) the image has more than 3 dimensions (e.g. (c, x, y, z)), or the channel dimension is wrong, e.g. (c+1, x, y) or (x, y, c).
Make sure the channel is the first dimension - Matplotlib usually has the channel in a different place from Pytorch, so you might need to transpose()!
See the readme for an example

The output of
train_loader.dataset[0][0].shape

is
torch.Size([3, 224, 224])

which is pretty much the same what is in example. But If I print data.shape during training epoch, the shape is
torch.Size([64, 3, 224, 224])

Is there something I am missing here?

The first shape is the shape of a single sample. The second shape is a batch of images. In order to leverage the parallelism of neural networks, we input multiple samples at once in a single tensor, called a batch. The novelty of NaViT is that it can automatically pack varying sizes of images into a single batch without user intervention (it does so by operating on sequences of image patches, which are then packed to form a single sequence).
I highly suggest you read up on basic neural networks and torch to understand the fundamentals (e.g. batch size, adam optimization, dataset vs. dataloader, etc.) before posting questions on more advanced architectures like ViTs which are built on the fundamentals. DeepLearning.AI is a great fundamental course that is very popular for example

Hello @lucidrains !
Another question came with NaViT usage. How do you use NaViT for multi-GPU training?
In some of my previous (where trainer is not defined via transformers) computer vision models I followed this approach:
if torch.cuda.device_count() > 1:
    print("Let's use", torch.cuda.device_count(), "GPUs!")
    model = nn.DataParallel(model)

model.to(device)

which is Data Parallel (DP). I know there are some other approaches, but since this worked well, I followed it. And then I run the script on terminal like this:
MAX_JOBS=12 OMP_NUM_THREADS=24 torchrun --nproc_per_node 2 train_navit.py

Any suggestions or ideas?

UPDATE: Passing num_samples in RandomSampler inside DataLoader with the same amount as train_batch_size did the trick. No need to use Data Parallel or anything else.


Unable to open firefox when passing in desiredCapabilities and browserOptions arguments

First of all, it seems that to pass in browser options, you must also pass in desiredCapabilities.
That should be OK, except when I pass in both desiredCapabilities and browserOptions arguments, the browser will not open
I have tried 2 different firefox versions, and a few variations of the arguments, but my current attempt looks like (blank version is valid according to docs):
Selenium2Library.Open Browser	${url}	desiredCapabilities={"platform":"WINDOWS","browserName":"firefox","version":""}	browserOptions={}
I always get the error:
java.net.MalformedURLException: no protocol: NONE
I cannot see anywhere to pass in a protocol...
There isnt much documentation around this, and I have also tried the examples here (same result): https://repo1.maven.org/maven2/com/github/markusbernhardt/robotframework-selenium2library-java/<IP_ADDRESS>/robotframework-selenium2library-java-<IP_ADDRESS>-libdoc.html#Open Browser

DesiredCapabilities desiredCapabilities = createDesiredCapabilities(browserName, desiredCapabilitiesString,browserOptions);
Please check the Browser .exe you pointing to and path set in your system. Sometime if firefox.exe or chrome.exe is not accessible if set path has error.
To make chrome work or IE work you have to download the driver exe and point in the Open Browser Keyword code.
Example:
		System.setProperty("webdriver.chrome.driver", "c:/chromedriver.exe");
		return new ChromeDriver(desiredCapabilities);

Its in File BrowserManagement.java and section:
protected WebDriver createLocalWebDriver(String browserName, DesiredCapabilities desiredCapabilities) {

}
Please suggest if anything specific you want to set in desiredCapabilities.
Regards
Asit

I don's see how answer should help with first one.
First issue is some example, that it can be tried that functionality works.
Second thing is the error that are coming when trying to use desiredCapabilities/browserOptions locally (not through Selenium-server).
if there's browserOptions and desiredCapabilities added, test prints:

15:18:35.634	WARN	Opening browser 'firefox' to base url 'about:blank' through remote server at 'NONE' failed
15:18:35.705	FAIL	java.net.MalformedURLException: no protocol: NONE

If "null", "none" or "empty" is tried to put to remoteUrl explicitely, test thows just

java.lang.NullPointerException

Yes, that is the same behaviour I get also!  When i call:
Open Browser	${url}	firefox	${NONE}	${NONE}	{"platform":"","browserName":"firefox","version":"", "firefox_binary":"C:\\workspace\\iE2-Robot\\Firefox\\FirefoxPortable.exe"}	{"preferences" : {"browser.download.dir" : "C:\\Robot_Download_TEMP", "browser.download.folderList" : 2 } }
The test fails with a:
FAIL	java.lang.NullPointerException
And I get the following exception in the std out:

[ERROR] Failed to execute goal org.robotframework:robotframework-maven-plugin:1.4.4:run (default) on project automated-testing: 1 critical test case failed. Check the logs for details. -> [Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.robotframework:robotframework-maven-plugin:1.4.4:run (default) on project automated-testing: 1 critical test case failed. Check the logs for details.
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:212)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:108)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:76)
at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:116)
at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:361)
at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:155)
at org.apache.maven.cli.MavenCli.execute(MavenCli.java:584)
at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:213)
at org.apache.maven.cli.MavenCli.main(MavenCli.java:157)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
Caused by: org.apache.maven.plugin.MojoFailureException: 1 critical test case failed. Check the logs for details.
at org.robotframework.mavenplugin.RobotFrameworkMojo.evaluateReturnCode(RobotFrameworkMojo.java:55)
at org.robotframework.mavenplugin.AcceptanceTestMojo.subclassExecute(AcceptanceTestMojo.java:68)
at org.robotframework.mavenplugin.AbstractMojoWithLoadedClasspath.execute(AbstractMojoWithLoadedClasspath.java:52)
at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:133)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
... 19 more

Could this be caused by running on Java 8?  Something to do with the AspectJ version being used?

I made it work. There's an bug (I think) in code, but it's not bothering with example.
Following keyword works OK:
Run keyword if    "${BROWSER}"=="firefox"    Open Browser    about:blank   browserName=${BROWSER}    remoteUrl=False	  desiredCapabilities={}    browserOptions=${browserOptions}
So correct value for remoteUrl (if it's not set) is False; not false, not ${EMPTY}, not ${NONE}, not NONE, not None.
Logging still tells that it's connecting to remote server, but actually it's not.

Whoohoo!  Yup, that works for me too - thanks Hi-Fi.
It doesnt work unless you specifically set remoteUrl=False.  Omitting that parameter fails - which I think is a bug.

Fix in #75.

Hi Hi-Fi,
I ported that from the Python version, but I believe in Python null and false are handled the same in an if-statement:
def open_browser(self, url, browser='firefox', alias=None,remote_url=False,
desired_capabilities=None,ff_profile_dir=None):
I belive the easiest fix is to set the defaults as in python:

browser='firefox'
remote_url=False

That should do the trick and be compatible with the AnnotationLibrary default handling.
What do you think?

That sounds right. I think code is already working in PR with all of those possibilities?

The problem is I had a general misunderstanding of how the AnnotationLibrary handles default values. When you specify a default "NONE" you get the string "NONE" and not null, when the field is not filled. This error runs through the whole library.
This needs a major overhaul.

Will release <IP_ADDRESS> first

Changed the default from "NONE" to "False". As in python. Now it works.
Fixed with <IP_ADDRESS>

@MarkusBernhardt @Hi-Fi @asitishere & @ali-feint  :  its not working for me, i am gettting argument mismatch exception
i tried below url but not working
Open Browser	${portal_url}	browserName=ff	remoteUrl=False	desiredCapabilities=network.http.phishy-userpass-length:255,network.automatic-ntlm-auth.trusted-uris:com.dcoder
Please have a look and do the needful


Read data

How should the data be read, Any examples?
The "ReadCmd" func?

How should the data be read, Any examples?
The "ReadCmd" func?

Hi,
Were you able to send in addition to the Initiate, confirmed request? (reading the parameter).Is there an example?