Add providers as a part of options

There are providers supporting the oembed protocol not found in the oembed.com provider list. It could be popular ones such as Repl.it, but also small personal project.
For both, it would be nice if one could add providers.
I already support adding schemes through the options as its part of the default options. But I have not advertised it, and it does not support adding new providers yet.

Found bug, fixing in #60


Generate API docs

Re #92, this PR uses pdoc to generate nice static HTML webpages documenting eyecite's public API. I think that this is a very helpful addition.
In addition to actually adding the documentation, I cleaned up our API a bit:

3a783f8 and c78a9f3 rename the clean and find module to be consistent with resolve and annotate.
7372d0d moves the clean_text() method from utils.py into clean.py, as I saw no reason to put it over there. This will not affect anyone currently doing from eyecite import clean_text.
23e0c09 renames annotate() to annotate_citations() to be consistent with find_citations() and resolve_citations(). This was also necessary because pdoc didn't like the name collision between annotate the module and annotate the function. Unfortunately, this does break external imports.
ac476b4 removes dump_citatations() from being exposed on the top eyecite module. I saw no need for this, since it's just a debugging function. People can import eyecite.utils.dump_citations if they want.

I also wrote a short script, api_documentation/generate_documentation.sh, to automate the creation of the documentation. One problem was that pdoc insisted on evaluating and printing the full tokenizer definition (thousands of lines of text) in the get_citations() definition (since we instantiate a default tokenizer there), and I couldn't figure out how to suppress this, so I just used sed to delete that portion from the docs after they were created.
Do we want to serve these somehow? One could in theory browse them locally (starting at index.html), but it could be nice to link to them.
Corrections/improvements welcome.

At a glance this seems overall good to me. Have you done any research on
what it takes to get this to readthedocs or similar?
Le sam. 18 sept. 2021 à 18:52, Matt Dahl @.***> a
écrit :

Re #92 https://github.com/freelawproject/eyecite/issues/92, this PR
uses pdoc to generate nice static HTML webpages documenting eyecite's
public API. I think that this is a very helpful addition.
In addition to actually adding the documentation, I cleaned up our API a
bit:

3a783f8
https://github.com/freelawproject/eyecite/commit/3a783f8d73202768a7b46320ff0b3e0f924def1a
and c78a9f3
https://github.com/freelawproject/eyecite/commit/c78a9f3cf0019f9f48143848ec2e89b9181cf3c5
rename the clean and find module to be consistent with resolve and
annotate.
7372d0d
https://github.com/freelawproject/eyecite/commit/7372d0dce9962edd952d84543c538e35b51332c6
moves the clean_text() method from utils.py into clean.py, as I saw no
reason to put it over there. This will not affect anyone currently doing from
eyecite import clean_text.
23e0c09
https://github.com/freelawproject/eyecite/commit/23e0c090918077b6ab6206002b25fb35d7201e64
renames annotate() to annotate_citations() to be consistent with
find_citations() and resolve_citations(). This was also necessary
because pdoc didn't like the name collision between annotate the
module and annotate the function. Unfortunately, this does break
external imports.
ac476b4
https://github.com/freelawproject/eyecite/commit/ac476b4faccae649cc1828d30121078a24c3a152
removes dump_citatations() from being exposed on the top eyecite
module. I saw no need for this, since it's just a debugging function.
People can import eyecite.utils.dump_citations if they want.

I also wrote a short script, api_documentation/generate_documentation.sh,
to automate the creation of the documentation. One problem was that pdoc
insisted on evaluating and printing the full tokenizer definition
(thousands of lines of text) in the get_citations() definition (since we
instantiate a default tokenizer there), and I couldn't figure out how to
suppress this, so I just used sed to delete that portion from the docs
after they were created.
Do we want to serve these somehow? One could in theory browse them locally
(starting at index.html), but it could be nice to link to them.
Corrections/improvements welcome.
You can view, comment on, or merge this pull request online at:
https://github.com/freelawproject/eyecite/pull/96
Commit Summary

Renames annotate() to annotate_citations().
Renames cleaners.py to clean.py.
Moves clean_text() to clean module.
Don't expose dump_citations() on top eyecite module.
Renames find_citations.py to find.py.
feat(docs): Generate API documentation using pdoc.

Reply to this email directly, view it on GitHub
https://github.com/freelawproject/eyecite/pull/96, or unsubscribe
https://github.com/notifications/unsubscribe-auth/AABZ3KV3RKPICE2KKSAJ4LDUCU65NANCNFSM5EJZMCMQ
.

I did not, though I should have in hindsight. Infuriatingly, it seems that readthedocs does not support pdoc. I can try to regenerate this using sphinx instead, or we can "self-host" it using GitHub pages. I believe the URL would be https://eyecite.github.io. pdoc hosts itself that way, for example: https://pdoc3.github.io/pdoc/

Actually, I think it would be https://freelawproject.github.io/eyecite

I don't have strong feelings on it, personally. I guess the biggest criterion for me is whichever one is the easiest to automate. I have some familiarity with GH pages, so I guess I lean towards learning one fewer thing by going that way? But lots of people use Read The Docs, so I assume it has something really compelling going for it? Bit of a rambly reply, sorry.

I actually like GH pages too. I think it should be pretty easy to automate. It seems that we can configure GitHub to serve static files from a particular folder (what I've called api_documentation or anything else) -- https://docs.github.com/en/pages/getting-started-with-github-pages/configuring-a-publishing-source-for-your-github-pages-site#choosing-a-publishing-source. Then anytime we push new files to that folder on main the website should automatically update. The only manual thing would be re-running pdoc (and my sed hack) if any of our docstrings change, though in theory that could also be automated with an Action, I would think.

I'm reviewing all your work here. Doing a GH page from a folder makes sense. It'd be great if it was generated automatically with an Action. Would you want to try your hand at that and include that in this PR?

I have no idea if this will work, but I just took a shot at it. I've never created an Action before. The idea is that when somebody opens a PR, pdoc gets run and any changes to the docs are committed for inclusion in the PR.
As I was typing this, I see my changes already managed to break all the checks. Not sure why that would be -- aren't Actions self-contained/siloed? Why would adding a new one break an old one? I don't really know what I'm doing here.

Matt, thanks for getting the bulk of this figured out. I did a bit of work making the dumb github action work properly, and then tweaked the change log. I think it should do the auto-build now, when I merge it, but only when somebody merges it. We'll find out in a sec!
Anyway, I'll keep poking at it. We should update links to point to the new docs too, once the gh page is working.

This is live and looks great: https://freelawproject.github.io/eyecite/

No, thank you! I had no idea how to set up the environment correctly for the action...


[tool_crash] HttpException

Command
flutter run --machine --start-paused -d chrome --devtools-server-address http://<IP_ADDRESS>:9100/ --target /Users/mr.rajput/Projects/federal_reserve_website/lib/main.dart

Steps to Reproduce

Just run the web app and it crashes on it's own

Logs
HttpException
Connecting to VM Service at ws://<IP_ADDRESS>:64277/HQ_ydZoOZbs=/ws
Connected to the VM Service.
***** Supabase init completed Instance of 'Supabase'
***** SupabaseDeepLinkingMixin startAuthObserver
**** onAuthStateChange: AuthChangeEvent.initialSession
WebSocketException: Connection to 'http://localhost:64257/devtools/page/3A97DBC687DFABAECE3F413DE7470BC9#' was not upgraded to websocket
#0      _WebSocketImpl.connect (dart:_http/websocket_impl.dart:1011:41)
#1      WebSocket.connect (dart:_http/websocket.dart:320:22)
#2      WipConnection.connect (package:webkit_inspection_protocol/webkit_inspection_protocol.dart:231:22)
#3      ChromeTab.connect (package:webkit_inspection_protocol/webkit_inspection_protocol.dart:184:26)
#4      Chromium.close (package:flutter_tools/src/web/chrome.dart:519:55)
<asynchronous suspension>
#5      ChromiumDevice.stopApp (package:flutter_tools/src/web/web_device.dart:164:5)
<asynchronous suspension>
#6      ResidentWebRunner._cleanup (package:flutter_tools/src/isolated/resident_web_runner.dart:203:5)
<asynchronous suspension>
#7      ResidentWebRunner._cleanupAndExit (package:flutter_tools/src/isolated/resident_web_runner.dart:217:5)
<asynchronous suspension>
#8      Future._propagateToListeners.handleWhenCompleteCallback.<anonymous closure> (dart:async/future_impl.dart:854:56)
<asynchronous suspension>

Failed to establish connection with the application instance in Chrome.
This can happen if the websocket connection used by the web tooling is unable to correctly establish a connection, for example due to a firewall.

Oops; flutter has exited unexpectedly: "HttpException: Connection closed before full header was received, uri = http://localhost:64257/json".
A crash report has been written to /Users/mr.rajput/Projects/federal_reserve_website/flutter_01.log

[✓] Flutter (Channel stable, 3.24.1, on macOS 14.6.1 23G93 darwin-arm64, locale en-IN)
    • Flutter version 3.24.1 on channel stable at /Users/mr.rajput/development/flutter
    • Upstream repository https://github.com/flutter/flutter.git
    • Framework revision 5874a72aa4 (2 weeks ago), 2024-08-20 16:46:00 -0500
    • Engine revision c9b9d5780d
    • Dart version 3.5.1
    • DevTools version 2.37.2

[✓] Android toolchain - develop for Android devices (Android SDK version 35.0.0)
    • Android SDK at /Users/mr.rajput/Library/Android/sdk
    • Platform android-35, build-tools 35.0.0
    • Java binary at: /Applications/Android Studio.app/Contents/jbr/Contents/Home/bin/java
    • Java version OpenJDK Runtime Environment (build 17.0.11+0-17.0.11b1207.24-11852314)
    • All Android licenses accepted.

[✓] Xcode - develop for iOS and macOS (Xcode 15.4)
    • Xcode at /Applications/Xcode.app/Contents/Developer
    • Build 15F31d
    • CocoaPods version 1.15.2

[✓] Chrome - develop for the web
    • Chrome at /Applications/Google Chrome.app/Contents/MacOS/Google Chrome

[✓] Android Studio (version 2024.1)
    • Android Studio at /Applications/Android Studio.app/Contents
    • Flutter plugin can be installed from:
      🔨 https://plugins.jetbrains.com/plugin/9212-flutter
    • Dart plugin can be installed from:
      🔨 https://plugins.jetbrains.com/plugin/6351-dart
    • Java version OpenJDK Runtime Environment (build 17.0.11+0-17.0.11b1207.24-11852314)

[✓] VS Code (version 1.93.0)
    • VS Code at /Applications/Visual Studio Code.app/Contents
    • Flutter extension version 3.97.20240902

[✓] Connected device (4 available)
    • Vikas’s Iphone 15 (mobile)      • 00008120-000E39491450A01E • ios            • iOS 17.6.1 21G93
    • macOS (desktop)                 • macos                     • darwin-arm64   • macOS 14.6.1 23G93 darwin-arm64
    • Mac Designed for iPad (desktop) • mac-designed-for-ipad     • darwin         • macOS 14.6.1 23G93 darwin-arm64
    • Chrome (web)                    • chrome                    • web-javascript • Google Chrome 127.0.6533.73

[✓] Network resources
    • All expected network resources are available.

• No issues found!

Flutter Application Metadata
Type: app
Version: 1.0.0+1
Material: true
Android X: false
Module: false
Plugin: false
Android package: null
iOS bundle identifier: null
Creation channel: stable
Creation framework version: 5874a72aa4c779a02553007c47dacbefba2374dc
Plugins
app_links-6.3.2
app_links_linux-1.0.3
app_links_web-1.0.4
fluttertoast-8.2.8
gtk-2.1.0
path_provider-2.1.4
path_provider_android-2.2.10
path_provider_foundation-2.4.0
path_provider_linux-2.2.1
path_provider_windows-2.3.0
shared_preferences-2.3.2
shared_preferences_android-2.3.2
shared_preferences_foundation-2.5.2
shared_preferences_linux-2.4.1
shared_preferences_web-2.4.2
shared_preferences_windows-2.4.1
url_launcher-6.3.0
url_launcher_android-6.3.10
url_launcher_ios-6.3.1
url_launcher_linux-3.2.0
url_launcher_macos-3.2.0
url_launcher_web-2.3.3
url_launcher_windows-3.1.2

Closing as duplicate of https://github.com/flutter/flutter/issues/154207


correctly use placeholders

attempts to address #4
it moves validation to Provision, and also uses the replacer at that time.
it also adds back some default variables from caddy-tlsredis.
note that caddytls-redis did this correctly - and so this should also help other people who are migrating. (the author has recommended using this package)
existing people relying on this behavior should change their configs to {$ENV} syntax from {env.Env} syntax

Hi @elee1766 thanks for your patience, I've taken your changes in https://github.com/pberkel/caddy-storage-redis/pull/5 and merged to branch "issue-4" and made a few additional tweaks / fixes and created a new PR https://github.com/pberkel/caddy-storage-redis/pull/6.
Can you have a look at the code in branch "issue-4" and confirm it works for you before I merge and tag?


Wrong parse, link vs emph

[find_symbols.rs](https://github.com/matklad/fall/blob/master/lang/rust/src/editor/file_symbols.rs)

This is currently parsed as emph:
doc
  para
    str s="[find"
    emph
      str s="symbols.rs](https://github.com/matklad/fall/blob/master/lang/rust/src/editor/file"
    str s="symbols.rs)"

This should be parsed as a link

Thanks. Minimal case:
[x_y](x_y)

Also a close relative of
[Link *](url)*

which is an example in our syntax description:
[Link *](url*)

The docs say

The basic principle governing “precedence” for inline containers is that the first opener that gets closed takes precedence. Containers can’t overlap, so once an opener gets closed, any potential openers between the opener and the closer get marked as regular text and can no longer open inline syntax.

I think the issue here is that the parser doesn't know we have a link, and hence doesn't count the first [ as closed, until we get to the final ).  So, on that basis one could argue that the emphasis is the first container to be closed.  At least, I think that's how the parser is thinking of it. I agree that another interpretation would be more sensible.

Note that this is avoided in commonmark (reference parsers) for two reasons:
1 - commonmark resolves all link containers before looking at any emphasis containers
2 - commonmark uses a scanner for the (..) part of a link that has potentially infinite lookahead, and that backtracks if a match isn't found
I'd like to avoid 2, and 1 is incompatible with the basic principle stated above.
So, not sure exactly how to handle this case.

I suppose one approach could be to clear the intervening openers as soon as we match a pair [..], regardless of whether this will eventually turn into a link.

Could you track both at the same time (potential link and em/strong formatting) until ]( is found and then enforce the link? This looks to be similar to the case of _some*text*more_ being valid, but _some*text_more* not. To me finding ]( should reset all "unclosed" pairs.

Yes, I think we could consider the opener matched when ]( or ][ is found, even if these aren't followed by what would be required to form a link.

This looks to be similar to the case of _some*text*more_ being valid, but _some*text_more* not

They're both "valid," in the sense of producing a parse; in the second case the _ is the first co close, so we get some*textmore*.

They're both "valid," in the sense of producing a parse; in the second case the _ is the first to close, so we get sometextmore.

Right; I agree with the result and was just suggesting that the same logic should/can be applied to the links (at ](/][ boundary). Thanks!

See above on why "first to close" is a bit ambiguous in this case.


Added raise hand system icon and five more CC brand icons.

Description
Adds raise-hand system icon and five more credit card brand icons to Dialtone 6:

Diner's Club
Discover
JCB
Maestro
Union Pay

Resolves #381 and #383
Obligatory GIF

BTW, @tedgoas-dialpad and @vcheng-dialpad , there are two PRs for these icons: one for 5.x and one for 6.0. Do you mind also reviewing this one as well since this is what will go to prod first?


xcode 8 Command failed due to signal: Segmentation fault: 11

Trying to run project using cocoapods and Manual install and getting teh following error:
Command failed due to signal: Segmentation fault: 11
here is the error log:
CompileSwift normal x86_64 /Users/barrettbreshears/Development/AccentShare-iOS/Pods/SQLite.swift/SQLite/Typed/AggregateFunctions.swift
cd /Users/barrettbreshears/Development/AccentShare-iOS/Pods
/Users/barrettbreshears/Downloads/Xcode.app/Contents/Developer/Toolchains/Swift_2.3.xctoolchain/usr/bin/swift -frontend -c -primary-file /Users/barrettbreshears/Development/AccentShare-iOS/Pods/SQLite.swift/SQLite/Typed/AggregateFunctions.swift /Users/barrettbreshears/Development/AccentShare-iOS/Pods/SQLite.swift/SQLite/Core/Blob.swift /Users/barrettbreshears/Development/AccentShare-iOS/Pods/SQLite.swift/SQLite/Typed/Collation.swift /Users/barrettbreshears/Development/AccentShare-iOS/Pods/SQLite.swift/SQLite/Core/Connection.swift /Users/barrettbreshears/Development/AccentShare-iOS/Pods/SQLite.swift/SQLite/Typed/CoreFunctions.swift /Users/barrettbreshears/Development/AccentShare-iOS/Pods/SQLite.swift/SQLite/Typed/CustomFunctions.swift /Users/barrettbreshears/Development/AccentShare-iOS/Pods/SQLite.swift/SQLite/Typed/Expression.swift /Users/barrettbreshears/Development/AccentShare-iOS/Pods/SQLite.swift/SQLite/Foundation.swift /Users/barrettbreshears/Development/AccentShare-iOS/Pods/SQLite.swift/SQLite/Extensions/FTS4.swift /Users/barrettbreshears/Development/AccentShare-iOS/Pods/SQLite.swift/SQLite/Helpers.swift /Users/barrettbreshears/Development/AccentShare-iOS/Pods/SQLite.swift/SQLite/Typed/Operators.swift /Users/barrettbreshears/Development/AccentShare-iOS/Pods/SQLite.swift/SQLite/Typed/Query.swift /Users/barrettbreshears/Development/AccentShare-iOS/Pods/SQLite.swift/SQLite/Extensions/R*Tree.swift /Users/barrettbreshears/Development/AccentShare-iOS/Pods/SQLite.swift/SQLite/Typed/Schema.swift /Users/barrettbreshears/Development/AccentShare-iOS/Pods/SQLite.swift/SQLite/Typed/Setter.swift /Users/barrettbreshears/Development/AccentShare-iOS/Pods/SQLite.swift/SQLite/Core/Statement.swift /Users/barrettbreshears/Development/AccentShare-iOS/Pods/SQLite.swift/SQLite/Core/Value.swift -target x86_64-apple-ios8.0 -enable-objc-interop -sdk /Users/barrettbreshears/Downloads/Xcode.app/Contents/Developer/Platforms/iPhoneSimulator.platform/Developer/SDKs/iPhoneSimulator10.0.sdk -I /Users/barrettbreshears/Library/Developer/Xcode/DerivedData/AccentMobile_iOS_Swift-dvngujvlvcmnjzfkvawgsveookdn/Build/Products/Debug-iphonesimulator/SQLite.swift -I /Users/barrettbreshears/Development/AccentShare-iOS/Pods/SQLite.swift/CocoaPods/iphonesimulator -F /Users/barrettbreshears/Library/Developer/Xcode/DerivedData/AccentMobile_iOS_Swift-dvngujvlvcmnjzfkvawgsveookdn/Build/Products/Debug-iphonesimulator/SQLite.swift -enable-testing -g -import-underlying-module -module-cache-path /Users/barrettbreshears/Library/Developer/Xcode/DerivedData/ModuleCache -D COCOAPODS -serialize-debugging-options -Xcc -I/Users/barrettbreshears/Library/Developer/Xcode/DerivedData/AccentMobile_iOS_Swift-dvngujvlvcmnjzfkvawgsveookdn/Build/Intermediates/Pods.build/Debug-iphonesimulator/SQLite.swift.build/swift-overrides.hmap -Xcc -iquote -Xcc /Users/barrettbreshears/Library/Developer/Xcode/DerivedData/AccentMobile_iOS_Swift-dvngujvlvcmnjzfkvawgsveookdn/Build/Intermediates/Pods.build/Debug-iphonesimulator/SQLite.swift.build/SQLite-generated-files.hmap -Xcc -I/Users/barrettbreshears/Library/Developer/Xcode/DerivedData/AccentMobile_iOS_Swift-dvngujvlvcmnjzfkvawgsveookdn/Build/Intermediates/Pods.build/Debug-iphonesimulator/SQLite.swift.build/SQLite-own-target-headers.hmap -Xcc -I/Users/barrettbreshears/Library/Developer/Xcode/DerivedData/AccentMobile_iOS_Swift-dvngujvlvcmnjzfkvawgsveookdn/Build/Intermediates/Pods.build/Debug-iphonesimulator/SQLite.swift.build/SQLite-all-non-framework-target-headers.hmap -Xcc -ivfsoverlay -Xcc /Users/barrettbreshears/Library/Developer/Xcode/DerivedData/AccentMobile_iOS_Swift-dvngujvlvcmnjzfkvawgsveookdn/Build/Intermediates/Pods.build/all-product-headers.yaml -Xcc -iquote -Xcc /Users/barrettbreshears/Library/Developer/Xcode/DerivedData/AccentMobile_iOS_Swift-dvngujvlvcmnjzfkvawgsveookdn/Build/Intermediates/Pods.build/Debug-iphonesimulator/SQLite.swift.build/SQLite-project-headers.hmap -Xcc -I/Users/barrettbreshears/Library/Developer/Xcode/DerivedData/AccentMobile_iOS_Swift-dvngujvlvcmnjzfkvawgsveookdn/Build/Products/Debug-iphonesimulator/SQLite.swift/include -Xcc -I/Users/barrettbreshears/Development/AccentShare-iOS/Pods/Headers/Private -Xcc -I/Users/barrettbreshears/Development/AccentShare-iOS/Pods/Headers/Public -Xcc -I/Users/barrettbreshears/Library/Developer/Xcode/DerivedData/AccentMobile_iOS_Swift-dvngujvlvcmnjzfkvawgsveookdn/Build/Intermediates/Pods.build/Debug-iphonesimulator/SQLite.swift.build/DerivedSources/x86_64 -Xcc -I/Users/barrettbreshears/Library/Developer/Xcode/DerivedData/AccentMobile_iOS_Swift-dvngujvlvcmnjzfkvawgsveookdn/Build/Intermediates/Pods.build/Debug-iphonesimulator/SQLite.swift.build/DerivedSources -Xcc -DPOD_CONFIGURATION_DEBUG=1 -Xcc -DDEBUG=1 -Xcc -DCOCOAPODS=1 -Xcc -ivfsoverlay -Xcc /Users/barrettbreshears/Library/Developer/Xcode/DerivedData/AccentMobile_iOS_Swift-dvngujvlvcmnjzfkvawgsveookdn/Build/Intermediates/Pods.build/Debug-iphonesimulator/SQLite.swift.build/unextended-module-overlay.yaml -Xcc -working-directory/Users/barrettbreshears/Development/AccentShare-iOS/Pods -emit-module-doc-path /Users/barrettbreshears/Library/Developer/Xcode/DerivedData/AccentMobile_iOS_Swift-dvngujvlvcmnjzfkvawgsveookdn/Build/Intermediates/Pods.build/Debug-iphonesimulator/SQLite.swift.build/Objects-normal/x86_64/AggregateFunctions~partial.swiftdoc -Onone -module-name SQLite -emit-module-path /Users/barrettbreshears/Library/Developer/Xcode/DerivedData/AccentMobile_iOS_Swift-dvngujvlvcmnjzfkvawgsveookdn/Build/Intermediates/Pods.build/Debug-iphonesimulator/SQLite.swift.build/Objects-normal/x86_64/AggregateFunctions~partial.swiftmodule -serialize-diagnostics-path /Users/barrettbreshears/Library/Developer/Xcode/DerivedData/AccentMobile_iOS_Swift-dvngujvlvcmnjzfkvawgsveookdn/Build/Intermediates/Pods.build/Debug-iphonesimulator/SQLite.swift.build/Objects-normal/x86_64/AggregateFunctions.dia -emit-dependencies-path /Users/barrettbreshears/Library/Developer/Xcode/DerivedData/AccentMobile_iOS_Swift-dvngujvlvcmnjzfkvawgsveookdn/Build/Intermediates/Pods.build/Debug-iphonesimulator/SQLite.swift.build/Objects-normal/x86_64/AggregateFunctions.d -emit-reference-dependencies-path /Users/barrettbreshears/Library/Developer/Xcode/DerivedData/AccentMobile_iOS_Swift-dvngujvlvcmnjzfkvawgsveookdn/Build/Intermediates/Pods.build/Debug-iphonesimulator/SQLite.swift.build/Objects-normal/x86_64/AggregateFunctions.swiftdeps -o /Users/barrettbreshears/Library/Developer/Xcode/DerivedData/AccentMobile_iOS_Swift-dvngujvlvcmnjzfkvawgsveookdn/Build/Intermediates/Pods.build/Debug-iphonesimulator/SQLite.swift.build/Objects-normal/x86_64/AggregateFunctions.o
0  swift                    0x0000000106b9b76b llvm::sys::PrintStackTrace(llvm::raw_ostream&) + 43
1  swift                    0x0000000106b9aa56 llvm::sys::RunSignalHandlers() + 70
2  swift                    0x0000000106b9bdbf SignalHandler(int) + 287
3  libsystem_platform.dylib 0x00007fff98d7952a _sigtramp + 26
4  libsystem_platform.dylib 0x00000000fffffff8 _sigtramp +<PHONE_NUMBER>
5  swift                    0x000000010519d206 clang::Preprocessor::MacroState::getModuleInfo(clang::Preprocessor&, clang::IdentifierInfo const*) const + 198
6  swift                    0x000000010519cbfa clang::Preprocessor::getMacroDefinition(clang::IdentifierInfo const*) + 330
7  swift                    0x0000000105b742ee clang::Preprocessor::HandleIdentifier(clang::Token&) + 302
8  swift                    0x0000000105b19466 clang::Lexer::LexIdentifier(clang::Token&, char const*) + 262
9  swift                    0x0000000105b20678 clang::Lexer::LexTokenInternal(clang::Token&, bool) + 8104
10 swift                    0x0000000105b74944 clang::Preprocessor::Lex(clang::Token&) + 68
11 swift                    0x0000000105b44997 clang::Preprocessor::ReadMacroName(clang::Token&, clang::MacroUse, bool*) + 55
12 swift                    0x0000000105b47b50 clang::Preprocessor::HandleIfdefDirective(clang::Token&, bool, bool) + 48
13 swift                    0x0000000105b46a14 clang::Preprocessor::HandleDirective(clang::Token&) + 1188
14 swift                    0x0000000105b21161 clang::Lexer::LexTokenInternal(clang::Token&, bool) + 10897
15 swift                    0x0000000105b74944 clang::Preprocessor::Lex(clang::Token&) + 68
16 swift                    0x000000010541b03a clang::Parser::ParseTopLevelDecl(clang::OpaquePtrclang::DeclGroupRef&) + 426
17 swift                    0x0000000105394bc5 clang::ParseAST(clang::Sema&, bool, bool) + 501
18 swift                    0x00000001051c7a50 clang::FrontendAction::Execute() + 64
19 swift                    0x00000001051929f8 clang::CompilerInstance::ExecuteAction(clang::FrontendAction&) + 888
20 swift                    0x0000000106b37aa0 llvm::CrashRecoveryContext::RunSafely(llvm::function_ref<void ()>) + 272
21 swift                    0x0000000106b37bc0 RunSafelyOnThread_Dispatch(void*) + 48
22 swift                    0x0000000106b9ca6d ExecuteOnThread_Dispatch(void*) + 13
23 libsystem_pthread.dylib  0x00007fff9732599d _pthread_body + 131
24 libsystem_pthread.dylib  0x00007fff9732591a _pthread_body + 0
25 libsystem_pthread.dylib  0x00007fff97323351 thread_start + 13
Stack dump:
0.	/Applications/Xcode.app/Contents/Developer/Platforms/iPhoneSimulator.platform/Developer/SDKs/iPhoneSimulator.sdk/usr/include/sqlite3.h:80:2: current parser token 'ifndef'

do you use the xcode8 branch? is this with xcode8 final?

Same problem here! Did you find any solution?

This is likely just the issue with the modulemap only working with Xcode versions at "/Applications/Xcode.app", e.g. not Xcode-beta.app. You can rewrite the path yourself in the appropriate .modulemap file.

The path in my modulemap is correct 'Applications/Xcode.app...' I cannot figure this out. Any ideas?

It's a crash in the compiler itself. Not sure what else to suggest except maybe clearing the derived data / pods folder.

It worked for me. Thanks!

After many hours of troubleshooting I finally found the only solution that worked for me.

Uninstall XCode 8.
Download and install XCode 7.3.1 from here.
Go the app store and install XCode 8 from there.

As a sidenote this problem seemed to affect any project that relied on sqlite3.h

I just had the same problem, triggered when using a local podspec. Check the "import paths" setting for the SQLite.swift target, make sure the paths are correct. In my case SQLite.swift was missing from the Pods/ dir.

Also make sure Xcode is installed in the default location (/Applications/Xcode.app) is what fixed this for me, fwiw.  I had downloaded a Xcode beta and installed it in /Applications/XCode-beta.app.

Documentation is updated, closing.


big mpi collectives don't always work right

Some Big MPI collectives don't always work right. This is since mxx::accumulate( ...,0) accumulates ints even if the begin,end iterators are size_t.

fixed


Image doesn't load if it's taken with full zoom on Samsung S8

This is a really strange issue which can be reproduced in the sample app. In the app, choose "Load image for cropping" and select "Camera". After that, fully zoom the camera (x8.0), take an image and select OK. 50% of the time the image is not loaded to the CropImageActivity. Only a grey screen and "Image load successful" message is shown.
There are no error logs and I tried to debug it, but the Exception returned in onSetImageUriComplete is null so it looks like everything is normal. I'm not sure at which point the image load fails.
Let me know If you need additional info.

Can you debug the image loading flow and see what the bitmap contains?
I don't have this device, can I reproduce it with an emulator?

anyone?


CUDA error: no kernel image is available for execution on the device

Update: I think this is caused by running a VM on Unraid. The Ubuntu kernel being used is not quite normal.
When attempting the OPT examples, via either Docker or running locally, I'm getting an error: CUDA error: no kernel image is available for execution on the device. This seems pretty unusual.
Possible causes:

I'm only using 1 GPU (I set the flags: TP=1, PP=1).
The below python script reports cuDNN is not available, but shows pytorch was installed have cuDNN. Conflicting..
I'm using CUDA 11.6 when Energon app wants CUDA 11.3
My 1080 Ti card should be compatible with the latest pytorch, due to its Cuda Compatibility (CC) of 6.1.

Any debugging advice? Thanks!
INFO:     Uvicorn running on http://<IP_ADDRESS>:8020 (Press CTRL+C to quit)
                    INFO     colossalai - uvicorn.error - INFO: Uvicorn running on http://<IP_ADDRESS>:8020 (Press CTRL+C to quit)
[09/10/22 19:24:25] INFO     colossalai - energon - INFO: ==> Rank 0 built layer 0-12 / total 12
                    INFO     colossalai - energon - INFO: Rank0/0 model size = 0.327696384 GB
INFO:     <IP_ADDRESS>:36218 - "GET /docs HTTP/1.1" 200 OK
INFO:     <IP_ADDRESS>:36218 - "GET /openapi.json HTTP/1.1" 200 OK
[09/10/22 19:24:33] INFO     colossalai - opt_server - INFO: <IP_ADDRESS>:36218 - "POST /generation" - max_tokens=64 prompt='Question: Where were the 2004 Olympics held?\nAnswer: Athens,
                             Greece\n\nQuestion: What is the longest river on the earth?\nAnswer:' top_k=50 top_p=0.5 temperature=0.7
On WorkerInfo(id=0, name=wok0):
RuntimeError('CUDA error: no kernel image is available for execution on the device\nCUDA kernel errors might be asynchronously reported at some other API call,so the stacktrace below might be incorrect.\nFor debugging consider passing CUDA_LAUNCH_BLOCKING=1.')
Traceback (most recent call last):
  File "/home/kastan/utils/miniconda3/envs/energonai/lib/python3.9/site-packages/torch/distributed/rpc/internal.py", line 206, in _run_function
    result = python_udf.func(*python_udf.args, **python_udf.kwargs)
  File "/home/kastan/utils/miniconda3/envs/energonai/lib/python3.9/site-packages/energonai/engine/rpc_utils.py", line 8, in call_method
    return method(rref.local_value(), *args, **kwargs)
  File "/home/kastan/utils/miniconda3/envs/energonai/lib/python3.9/site-packages/energonai/engine/rpc_worker.py", line 118, in run
    output, cur_key = self.model.run(key, inputs)
  File "/home/kastan/utils/miniconda3/envs/energonai/lib/python3.9/site-packages/energonai/engine/pipeline_wrapper.py", line 72, in run
    return self.run_without_pp(key, inputs)
  File "/home/kastan/utils/miniconda3/envs/energonai/lib/python3.9/site-packages/energonai/engine/pipeline_wrapper.py", line 86, in run_without_pp
    output = self.model(hidden_states=None, **sample)
  File "/home/kastan/utils/miniconda3/envs/energonai/lib/python3.9/site-packages/torch/nn/modules/module.py", line 1130, in _call_impl
    return forward_call(*input, **kwargs)
  File "/home/kastan/utils/miniconda3/envs/energonai/lib/python3.9/site-packages/energonai/model/model_factory.py", line 114, in forward
    hidden_states = block(hidden_states=hidden_states,
  File "/home/kastan/utils/miniconda3/envs/energonai/lib/python3.9/site-packages/torch/nn/modules/module.py", line 1130, in _call_impl
    return forward_call(*input, **kwargs)
  File "/home/kastan/utils/miniconda3/envs/energonai/lib/python3.9/site-packages/energonai/model/endecoder.py", line 56, in forward
    hidden_states = residual + self.attn(hidden_states = hidden_states,
  File "/home/kastan/utils/miniconda3/envs/energonai/lib/python3.9/site-packages/torch/nn/modules/module.py", line 1130, in _call_impl
    return forward_call(*input, **kwargs)
  File "/home/kastan/utils/miniconda3/envs/energonai/lib/python3.9/site-packages/energonai/model/attention.py", line 84, in forward
    q = self.query_(hidden_states)
  File "/home/kastan/utils/miniconda3/envs/energonai/lib/python3.9/site-packages/torch/nn/modules/module.py", line 1130, in _call_impl
    return forward_call(*input, **kwargs)
  File "/home/kastan/utils/miniconda3/envs/energonai/lib/python3.9/site-packages/energonai/nn/layer/parallel_1d/layers.py", line 302, in forward
    output_parallel = F.linear(input_parallel, self.weight, bias)
RuntimeError: CUDA error: no kernel image is available for execution on the device
CUDA kernel errors might be asynchronously reported at some other API call,so the stacktrace below might be incorrect.
For debugging consider passing CUDA_LAUNCH_BLOCKING=1.

Exception in thread Thread-2:
Traceback (most recent call last):
  File "/home/kastan/utils/miniconda3/envs/energonai/lib/python3.9/threading.py", line 980, in _bootstrap_inner
    self.run()
  File "/home/kastan/utils/miniconda3/envs/energonai/lib/python3.9/threading.py", line 917, in run
    self._target(*self._args, **self._kwargs)
  File "/home/kastan/ai/EnergonAI/examples/opt/executor.py", line 36, in _start
    outputs = self.engine.run(inputs).to_here()
  File "/home/kastan/utils/miniconda3/envs/energonai/lib/python3.9/site-packages/torch/distributed/rpc/internal.py", line 220, in _handle_exception
    raise result.exception_type(result.msg.encode("utf-8").decode("unicode_escape"))
RuntimeError: On WorkerInfo(id=0, name=wok0):
RuntimeError('CUDA error: no kernel image is available for execution on the device
CUDA kernel errors might be asynchronously reported at some other API call,so the stacktrace below might be incorrect.
For debugging consider passing CUDA_LAUNCH_BLOCKING=1.')
Traceback (most recent call last):
  File "/home/kastan/utils/miniconda3/envs/energonai/lib/python3.9/site-packages/torch/distributed/rpc/internal.py", line 206, in _run_function
    result = python_udf.func(*python_udf.args, **python_udf.kwargs)
  File "/home/kastan/utils/miniconda3/envs/energonai/lib/python3.9/site-packages/energonai/engine/rpc_utils.py", line 8, in call_method
    return method(rref.local_value(), *args, **kwargs)
  File "/home/kastan/utils/miniconda3/envs/energonai/lib/python3.9/site-packages/energonai/engine/rpc_worker.py", line 118, in run
    output, cur_key = self.model.run(key, inputs)
  File "/home/kastan/utils/miniconda3/envs/energonai/lib/python3.9/site-packages/energonai/engine/pipeline_wrapper.py", line 72, in run
    return self.run_without_pp(key, inputs)
  File "/home/kastan/utils/miniconda3/envs/energonai/lib/python3.9/site-packages/energonai/engine/pipeline_wrapper.py", line 86, in run_without_pp
    output = self.model(hidden_states=None, **sample)
  File "/home/kastan/utils/miniconda3/envs/energonai/lib/python3.9/site-packages/torch/nn/modules/module.py", line 1130, in _call_impl
    return forward_call(*input, **kwargs)
  File "/home/kastan/utils/miniconda3/envs/energonai/lib/python3.9/site-packages/energonai/model/model_factory.py", line 114, in forward
    hidden_states = block(hidden_states=hidden_states,
  File "/home/kastan/utils/miniconda3/envs/energonai/lib/python3.9/site-packages/torch/nn/modules/module.py", line 1130, in _call_impl
    return forward_call(*input, **kwargs)
  File "/home/kastan/utils/miniconda3/envs/energonai/lib/python3.9/site-packages/energonai/model/endecoder.py", line 56, in forward
    hidden_states = residual + self.attn(hidden_states = hidden_states,
  File "/home/kastan/utils/miniconda3/envs/energonai/lib/python3.9/site-packages/torch/nn/modules/module.py", line 1130, in _call_impl
    return forward_call(*input, **kwargs)
  File "/home/kastan/utils/miniconda3/envs/energonai/lib/python3.9/site-packages/energonai/model/attention.py", line 84, in forward
    q = self.query_(hidden_states)
  File "/home/kastan/utils/miniconda3/envs/energonai/lib/python3.9/site-packages/torch/nn/modules/module.py", line 1130, in _call_impl
    return forward_call(*input, **kwargs)
  File "/home/kastan/utils/miniconda3/envs/energonai/lib/python3.9/site-packages/energonai/nn/layer/parallel_1d/layers.py", line 302, in forward
    output_parallel = F.linear(input_parallel, self.weight, bias)
RuntimeError: CUDA error: no kernel image is available for execution on the device
CUDA kernel errors might be asynchronously reported at some other API call,so the stacktrace below might be incorrect.
For debugging consider passing CUDA_LAUNCH_BLOCKING=1.

My system information:
❯ python collect_env.py
Collecting environment information...
PyTorch version: 1.12.1
Is debug build: False
CUDA used to build PyTorch: 11.3
ROCM used to build PyTorch: N/A

OS: Ubuntu 20.04.5 LTS (x86_64)
GCC version: (Ubuntu 9.4.0-1ubuntu1~20.04.1) 9.4.0
Clang version: Could not collect
CMake version: Could not collect
Libc version: glibc-2.31

Python version: 3.8.13 (default, Mar 28 2022, 11:38:47)  [GCC 7.5.0] (64-bit runtime)
Python platform: Linux-5.4.0-125-generic-x86_64-with-glibc2.17
Is CUDA available: True
CUDA runtime version: 11.7.99
GPU models and configuration: GPU 0: NVIDIA GeForce GTX 1080 Ti
Nvidia driver version: 515.65.01
cuDNN version: Could not collect
HIP runtime version: N/A
MIOpen runtime version: N/A
Is XNNPACK available: True

Versions of relevant libraries:
[pip3] numpy==1.23.1
[pip3] torch==1.12.1
[pip3] torchaudio==0.12.1
[pip3] torchvision==0.13.1
[conda] blas                      1.0                         mkl
[conda] cudatoolkit               11.3.1               h2bc3f7f_2
[conda] ffmpeg                    4.3                  hf484d3e_0    pytorch
[conda] mkl                       2021.4.0           h06a4308_640
[conda] mkl-service               2.4.0            py38h7f8727e_0
[conda] mkl_fft                   1.3.1            py38hd3c417c_0
[conda] mkl_random                1.2.2            py38h51133e4_0
[conda] numpy                     1.23.1           py38h6c91a56_0
[conda] numpy-base                1.23.1           py38ha15fc14_0
[conda] pytorch                   1.12.1          py3.8_cuda11.3_cudnn8.3.2_0    pytorch
[conda] pytorch-mutex             1.0                        cuda    pytorch
[conda] torchaudio                0.12.1               py38_cu113    pytorch
[conda] torchvision               0.13.1               py38_cu113    pytorch

Hi, ColossalAI may not support GTX 1080Ti.

Hi, ColossalAI may not support GTX 1080Ti.

How about V100-32G，I have same error on it.

I have same error on it


Documentation always fails

I have successfully setup IntuneCD-Monitor on Azure and the actual backup succeeds but the documentation step fails due to timeout (3000 seconds as per the code). There are no other logs indicating why this may have failed so I'm a bit stumped. I have tried bumping up the app service plan a couple of time but this makes no difference, it will always fail due to timeout.
According to the docs it states all you need to do is tick the Documentation box on the tenant config but the settings indicate below:

Is there something additional I need to do to generate documentation?

I am able to kind of replicate this, I run it locally and it seems like the part where it is converting the content to HTML using the mistune package is running forever and never completes. Will have to check if I can get that to work again or if there is another package that could do this

Try setting the new env var in 2.1.3 and let me know if it improves: https://github.com/almenscorner/intunecd-monitor/releases/tag/v2.1.3


Compiler errors under Delphi 12

Hello,
I downloaded the current version and tried to compile under Delphi 12 but I get a lot of warnings and errors:
Android32:
[DCC Hint] DW.Android.Helpers.pas(484): H2164 Variable 'LAttribute' is declared but never used in 'TAndroidHelperEx.HasClass'
[DCC Error] DW.Location.Android.pas(30): E2291 Missing implementation of interface method JLocationListener.onFlushComplete
[DCC Fatal Error] DW.Location.Android.pas(136): F2063 Could not compile used unit 'DW.Geodetic.pas'
Android64:
[DCC Hint] DW.Android.Helpers.pas(484): H2164 Variable 'LAttribute' is declared but never used in 'TAndroidHelperEx.HasClass'
[DCC Error] DW.Location.Android.pas(30): E2291 Missing implementation of interface method JLocationListener.onFlushComplete
[DCC Fatal Error] DW.Location.Android.pas(136): F2063 Could not compile used unit 'DW.Geodetic.pas'
iOS64
[DCC Warning] DW.OSTimer.pas(171): W1000 Symbol 'DisposeOf' is deprecated: 'Use Free instead'
[DCC Hint] DW.FilesSelector.iOS.pas(61): H2219 Private symbol 'GetImageRotation' declared but never used
MacOS64
[dccosx64 Warning] DW.OSTimer.pas(171): W1000 Symbol 'DisposeOf' is deprecated: 'Use Free instead'
[dccosx64 Hint] DW.ShareItems.Mac.pas(132): H2164 Variable 'LSize' is declared but never used in 'BitmapToNSImage'
Win32
[dcc32 Warning] DW.OSTimer.pas(171): W1000 Symbol 'DisposeOf' is deprecated: 'Use Free instead'
[dcc32 Error] DW.UIHelper.pas(73): E2029 Identifier expected but 'CLASS' found
[dcc32 Error] DW.UIHelper.pas(73): E2029 Declaration expected but identifier 'TUIHelper' found
[dcc32 Error] DW.UIHelper.pas(78): E2003 Undeclared identifier: 'Result'
[dcc32 Error] DW.UIHelper.pas(80): E2029 '.' expected but ';' found
[dcc32 Error] DW.UIHelper.pas(82): E2037 Declaration of 'CopyImageToClipboard' differs from previous declaration
[dcc32 Error] DW.UIHelper.pas(34): E2065 Unsatisfied forward or external declaration: 'TUIHelper.CopyImageToClipboard'
[dcc32 Error] DW.UIHelper.pas(40): E2065 Unsatisfied forward or external declaration: 'TUIHelper.GetOffsetRect'
[dcc32 Fatal Error] DW.Precompile.pas(332): F2063 Could not compile used unit 'DW.UIHelper.pas'
Win64
[dcc64 Warning] DW.OSTimer.pas(171): W1000 Symbol 'DisposeOf' is deprecated: 'Use Free instead'
[dcc64 Error] DW.UIHelper.pas(73): E2029 Identifier expected but 'CLASS' found
[dcc64 Error] DW.UIHelper.pas(73): E2029 Declaration expected but identifier 'TUIHelper' found
[dcc64 Error] DW.UIHelper.pas(78): E2003 Undeclared identifier: 'Result'
[dcc64 Error] DW.UIHelper.pas(80): E2029 '.' expected but ';' found
[dcc64 Error] DW.UIHelper.pas(82): E2037 Declaration of 'CopyImageToClipboard' differs from previous declaration
[dcc64 Error] DW.UIHelper.pas(34): E2065 Unsatisfied forward or external declaration: 'TUIHelper.CopyImageToClipboard'
[dcc64 Error] DW.UIHelper.pas(40): E2065 Unsatisfied forward or external declaration: 'TUIHelper.GetOffsetRect'
[dcc64 Fatal Error] DW.Precompile.pas(332): F2063 Could not compile used unit 'DW.UIHelper.pas'

For Win32/64 the ; is missing due to wring defines:
uses
FMX.Platform,
{$IF Defined(ANDROID)}
DW.UIHelper.Android;
{$ELSEIF Defined(IOS)}
DW.UIHelper.iOS;
{$ELSEIF Defined(MACOS)}
DW.UIHelper.Mac;
{$ENDIF}

Thanks for this report!
Can you update from the repo and try again? Incidentally, the KastriBuild.dproj in the root of the Packages folder can now be used to build.

Sorry, I need to resolve the JLocationListener error first.. working on it

Under Mac OS 64 still the Hint:
[dccosx64 Hint] DW.ShareItems.Mac.pas(132): H2164 Variable 'LSize' is declared but never used in 'BitmapToNSImage'
iOS, Win32/Win64 compiles now.
Under Android - you noticed for yourself - the JLocationListener-error is still there.

Pushed further changes


Update install generator to support Shakapacker 7 as well

Summary
This PR adds install generator support for Shakapakacer 7 while maintaining support for Shakapacker 6.
Pull Request checklist

[x] Add/update test to cover these changes
Note: tests check the install generator only on SP7. Manual testing on SP6 was successful.
[x] Update documentation
[x] Update CHANGELOG file

This change is

@justin808 I cleaned up this PR. See if there is any issues. I think it is ready for 13.4.0.

@justin808 Please review the PR again.

@ahangarha what's left? Please resolve conflicts.

Tests are getting failed because of the following error:

Webdrivers::VersionError:
Unable to find latest point release version for 115.0.5790. You appear to be using a non-production version of Chrome. Please set Webdrivers::Chromedriver.required_version = <desired driver version> to a known chromedriver version: https://chromedriver.storage.googleapis.com/index.html

I think this needs to be fixed in another PR.

@ahangarha to clarify, Justin is talking about the fact that the file doesn't end in a new line.

Oh! I didn't notice this. I was wondering what was wrong with that line. Now it is configured to add a new line to the end of all files.

Copy & paste doesn't work on a stacktrace like this.
My bad! You are right. I shouldn't have missed this in replacing Webpacker with Shakapacker. Actually the docs/javascript/troubleshooting-when-using-webpacker.md file shouldn't be edited for this purpose.


KAFKA-5698: Sort processor nodes based on its sub-tree size

Sort processor nodes within a sub-topology by its sub-tree size: nodes with largest sizes are source nodes and hence printed earlier.

Sort sub-topologies by ids; sort global stores by the source topic names.

Minor: start newlines for predecessor and successor.

Minor: space between processor nodes and stores / topics; maintain [] for the topic names.

Changes in WordCountDemo.java are intentional for illustration purposes, and I will revert the changes after addressing review comments. The resulted print output now looks like:
Sub-topologies:
  Sub-topology: 0
    Source: KSTREAM-SOURCE-0000000000 (topics: [streams-wordcount-input, dummy])
      --> KSTREAM-FLATMAPVALUES-0000000001
    Processor: KSTREAM-FLATMAPVALUES-0000000001 (stores: [])
      --> KSTREAM-MAP-0000000002
      <-- KSTREAM-SOURCE-0000000000
    Processor: KSTREAM-MAP-0000000002 (stores: [])
      --> KSTREAM-FILTER-0000000005
      <-- KSTREAM-FLATMAPVALUES-0000000001
    Processor: KSTREAM-FILTER-0000000005 (stores: [])
      --> KSTREAM-SINK-0000000004
      <-- KSTREAM-MAP-0000000002
    Sink: KSTREAM-SINK-0000000004 (topic: Counts-repartition)
      <-- KSTREAM-FILTER-0000000005
  Sub-topology: 1
    Source: KSTREAM-SOURCE-0000000006 (topics: [Counts-repartition])
      --> KSTREAM-AGGREGATE-0000000003
    Processor: KSTREAM-AGGREGATE-0000000003 (stores: [Counts])
      --> KTABLE-TOSTREAM-0000000007
      <-- KSTREAM-SOURCE-0000000006
    Processor: KTABLE-TOSTREAM-0000000007 (stores: [])
      --> KSTREAM-SINK-0000000008
      <-- KSTREAM-AGGREGATE-0000000003
    Sink: KSTREAM-SINK-0000000008 (topic: streams-wordcount-output)
      <-- KTABLE-TOSTREAM-0000000007

Global Stores:
  GlobalStore: KSTREAM-SOURCE-0000000009 (topic: topicN)
      --> KTABLE-SOURCE-0000000010 (store: storeN)

@mjsax @dguy @miguno for reviews.

Refer to this link for build results (access rights to CI server needed):
https://builds.apache.org/job/kafka-pr-jdk8-scala2.12/6512/
Test FAILed (JDK 8 and Scala 2.12).

Refer to this link for build results (access rights to CI server needed):
https://builds.apache.org/job/kafka-pr-jdk8-scala2.12/6513/
Test FAILed (JDK 8 and Scala 2.12).

Refer to this link for build results (access rights to CI server needed):
https://builds.apache.org/job/kafka-pr-jdk7-scala2.11/6527/
Test FAILed (JDK 7 and Scala 2.11).

retest this please

Refer to this link for build results (access rights to CI server needed):
https://builds.apache.org/job/kafka-pr-jdk8-scala2.12/6514/
Test FAILed (JDK 8 and Scala 2.12).

Refer to this link for build results (access rights to CI server needed):
https://builds.apache.org/job/kafka-pr-jdk7-scala2.11/6528/
Test FAILed (JDK 7 and Scala 2.11).

Refer to this link for build results (access rights to CI server needed):
https://builds.apache.org/job/kafka-pr-jdk8-scala2.12/6515/
Test FAILed (JDK 8 and Scala 2.12).

Refer to this link for build results (access rights to CI server needed):
https://builds.apache.org/job/kafka-pr-jdk7-scala2.11/6529/
Test FAILed (JDK 7 and Scala 2.11).

retest this please

Refer to this link for build results (access rights to CI server needed):
https://builds.apache.org/job/kafka-pr-jdk8-scala2.12/6518/
Test FAILed (JDK 8 and Scala 2.12).

Refer to this link for build results (access rights to CI server needed):
https://builds.apache.org/job/kafka-pr-jdk7-scala2.11/6532/
Test FAILed (JDK 7 and Scala 2.11).

Refer to this link for build results (access rights to CI server needed):
https://builds.apache.org/job/kafka-pr-jdk8-scala2.12/6564/
Test FAILed (JDK 8 and Scala 2.12).

Refer to this link for build results (access rights to CI server needed):
https://builds.apache.org/job/kafka-pr-jdk7-scala2.11/6579/
Test FAILed (JDK 7 and Scala 2.11).

Refer to this link for build results (access rights to CI server needed):
https://builds.apache.org/job/kafka-pr-jdk8-scala2.12/6567/
Test FAILed (JDK 8 and Scala 2.12).

Refer to this link for build results (access rights to CI server needed):
https://builds.apache.org/job/kafka-pr-jdk7-scala2.11/6582/
Test FAILed (JDK 7 and Scala 2.11).

Refer to this link for build results (access rights to CI server needed):
https://builds.apache.org/job/kafka-pr-jdk7-scala2.11/6583/
Test PASSed (JDK 7 and Scala 2.11).

Refer to this link for build results (access rights to CI server needed):
https://builds.apache.org/job/kafka-pr-jdk8-scala2.12/6568/
Test PASSed (JDK 8 and Scala 2.12).

retest this please

left one nit, but do we have any tests that prove that the order comes out as expected?

@dguy Good point, added a unit test for this. Could you review again?


No Speed Gains

Hi,
I am trying to run DeepCache on v100 using the given instructions on huggingface, in all tests I see that DeepCache take ~10s longer than using SD wihtout DeepCache.
 import torch
 from diffusers import StableDiffusionPipeline
 pipe = StableDiffusionPipeline.from_pretrained('runwayml/stable-diffusion-v1-5', torch_dtype=torch.float16).to("cuda")

from DeepCache import DeepCacheSDHelper
helper = DeepCacheSDHelper(pipe=pipe)
helper.set_params(
    cache_interval=3,
    cache_branch_id=0,
)
helper.enable()

image = pipe("a photo of an astronaut on a moon").images[0]

This is the code that I am using

It was an issue at my end with time.


Display Filenames for Uploaded Header Images

When I have similar images uploaded for header images it is hard to differentiate them. It would be useful to add the filenames

Done in 4bc06d2b84d2536de909f17269fcdda7fceb69e0 and 1bc637be30e93c51914d6c1e6244a2323c7af002


Implement maps and sets as B+ Trees

In containers, the Map and Set data types are implemented as balanced binary trees. For the persistent setting, this is certainly the right option since it maximizes sharing. However, in the non-persistent linear setting, we have more flexibility. Here, we can mutate trees in-place. I suspect that a B+ Tree with a degree between 8 and 64 should perform well for many applications. This will take a while to implement. It requires building a primitive linear array type that works much like the Reference type.

What would this primitive linear array type look like?

Unfortunately, there are two different flavors of a linear array. Variant A is simple. It's a fixed-size array. You can modify elements. Variant B is something that you can insert into, shifting everything to the right over by one element. You can only insert up to a maximum size (specified at initialization). After this, inserts result in undefined behavior. So there are a certain number of currently valid elements, and after a certain index, everything is trash.
*** Variant A
data Array :: (Mode -> Type) -> Mode -> Type
modify :: Object f => Array f m ->. Int -> (f Dynamic ->. f Dynamic) ->.  Token
read :: Object f => Array f Static ->. Int -> (Token, f Static)

There are some gaps to fill in (like having statically and dynamically), and the function to create arrays would be kind of weird since we cannot perform ordinary replication-style initialization, but that's the gist of it.
*** Variant B
data Array :: (Mode -> Type) -> Mode -> Type
modify :: Object f => Array f m ->. Int -> (f Dynamic ->. f Dynamic) ->.  Int -> f Dynamic ->.   (Int, Array f m)

Again, just a sketch, but insert and delete are crucial. I haven't thought hard about where Static and Dynamic are appropriate on this either.


Script templates

Basic script templates for script types could be defined in Settings. These could be accessible via the script editor. Multiple script templates per script type would be a required feature.

Each script type could have a default script template that would automatically be used when a new script is created
Documentation could be reduced by prepopulating installs with basic script types e.g. NameChange scripts could have $NewPlayerAlias and $OldPlayerAlias already defined
Script templates would let you define scripts that might be used across games/servers/redists. An example would be an install script template that sets the resolution in a GoldSrc game.

Maybe not entirely useful? Would customizable script snippets work better?


Use latest apptestctl with github token param

Updates to the latest version of apptestctl and adds a --github-token param. This is needed because we changed how CRDs are installed and we can hit GitHub rate limiting.
See also https://github.com/giantswarm/step-exec-lib/pull/20

Codecov Report

Merging #33 (20d31e6) into master (4b5a1cf) will decrease coverage by 0.21%.
The diff coverage is 50.00%.

@@            Coverage Diff             @@
##           master      #33      +/-   ##
==========================================
- Coverage   53.76%   53.54%   -0.22%
==========================================
  Files          12       12
  Lines         558      564       +6
  Branches       50       51       +1
==========================================
+ Hits          300      302       +2
- Misses        246      249       +3
- Partials       12       13       +1

Impacted Files
Coverage Δ

app_test_suite/__main__.py
28.20% <25.00%> (+0.20%)
:arrow_up:

app_test_suite/steps/base_test_runner.py
59.44% <66.66%> (-0.45%)
:arrow_down:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 4b5a1cf...20d31e6. Read the comment docs.

With apptestctl 0.12.0 we embed the CRDs. So no need for the github token 🎉
https://github.com/giantswarm/apptestctl/pull/176
I'll do a fresh PR for the upgrade.


Control location of quant/dequant stubs through QAT callback

🚀 Feature
The current QuantizationAwareTraining callback forces the quant/dequant operations to wrap the model's forward method. Users should be able to configure a different model method instead
Motivation
Many operators do not support quantization in PyTorch yet. Additionally, custom nn.Modules won't have quantization support unless the user implements it themselves. In these cases, it can be preferable to quantize only a sub-graph of the model to get some speed-up benefit while minimizing development effort. In vanilla PyTorch it would look like
class MyModel(pl.LightningModule):

    ...

    def forward(self, x):

        # A layer that can't be quantized for whatever reason
        x = self.non_quantizable_op(x)

        # Wrap the stubs around remaining layers
        x = self.quant(x)
        x = self.qforward(x)
        x = self.dequant(x)
        return x

    def qforward(self, x):
        return self.quantizable_op(x)  # Could be a much longer implementation

Pitch

Add a method_to_quantize='forward' parameter to QuantizationAwareTraining. Using a default ensures backwards compatible behavior
Use this inside the on_fit_start hook to apply the wrap_qat_forward_context decorator to the appropriate model method
Update on_fit_end in a similar manner

Alternatives
Users could

Add the quant/dequant stubs themselves - defeats the purpose of a generic callback to handle the boilerplate
Wait for PyTorch team to implement more quantized ops - might take a long time
Write their own quantized implementations - development effort might not be worth the added speedup if it is just one op among many hundreds in the model

Additional context
A minimal repro of the limitations in the current code
import pytorch_lightning as pl
from pytorch_lightning.callbacks.quantization import QuantizationAwareTraining
import torch
import torch.nn as nn
from torch.utils.data import DataLoader, Dataset

class ExampleDataset(Dataset):
    """Feed the model's example input array"""

    def __init__(self, model_cls):
        super(ExampleDataset, self).__init__()
        self.item = getattr(model_cls, 'example_input_array')

    def __len__(self):
        return 16  # 8 batches of 2

    def __getitem__(self, item):
        return self.item

class Add(nn.Module):
    """Custom add to demonstrate error"""
    def __int__(self):
        super(Add, self).__int__()

    def forward(self, a, b):
        return a + b

class NonQuantizable(pl.LightningModule):

    def __init__(self):
        super(NonQuantizable, self).__init__()
        self.add = Add()
        self.linear = nn.Linear(16, 64)
        self.softmax = nn.Softmax(dim=1)

    def forward(self, x):
        added = self.add(x, x)
        feats = self.linear(added)
        probs = self.softmax(feats)
        return probs

    def training_step(self, batch, batch_idx):
        out = self.forward(batch)
        return None

    def train_dataloader(self):
        return DataLoader(ExampleDataset(self), batch_size=2)

    def configure_optimizers(self):
        return torch.optim.Adam(self.parameters())

    @property
    def example_input_array(self):
        return torch.randn(1, 16)

model = NonQuantizable()
trainer = pl.Trainer(callbacks=[QuantizationAwareTraining()], max_epochs=1)
trainer.fit(model)
model(model.example_input_array)

Fit runs alright, but after the conversion from on_fit_end the forward prop will fail
RuntimeError: Could not run 'aten::add.Tensor' with arguments from the 'QuantizedCPU' backend

This is because wrap_quantize_forward_context has added a quant stub at the beginning of forward which causes the tensor passed to the custom add to be quantized

Another model where this could be useful is one with embeddings
class NonQuantizable2(pl.LightningModule):

    def __init__(self):
        super(NonQuantizable2, self).__init__()
        self.embed = nn.Embedding(16, 64)
        self.linear = nn.Linear(1024, 64)
        self.softmax = nn.Softmax(dim=1)

    def forward(self, x):
        batch_size = x.shape[0]
        embeddings = self.embed(x)
        embeddings = embeddings.view(batch_size, -1)
        feats = self.qforward(embeddings)
        probs = self.softmax(feats)
        return probs

    def qforward(self, embeddings):
        return self.linear(embeddings)

    def training_step(self, batch, batch_idx):
        out = self.forward(batch)
        return None

    def train_dataloader(self):
        return DataLoader(ExampleDataset(self), batch_size=2)

    def configure_optimizers(self):
        return torch.optim.Adam(self.parameters())

    @property
    def example_input_array(self):
        return torch.zeros(1, 16, dtype=torch.int32)

Running the same training as above will yield
RuntimeError: Expected self.scalar_type() == ScalarType::Float to be true, but got false.

This is because the integer input tensor (provided by example_input_array and required by nn.Embedding) is incompatible with the quant stub added by our callback (which takes float inputs only). This could be resolved with the following code once the pitch is implemented
trainer = pl.Trainer(callbacks=[QuantizationAwareTraining(method_to_quantize='qforward')], ...)

The callback modification would move the quant stub after the embedding layer which resolves the incompatibility. However, this alone will not completely resolve the issue because now you get
AssertionError: The only supported dtype for nnq.Embedding is torch.quint8

The recommendation from the PyTorch forums is to set self.embed.qconfig = None to skip quantizing that layer. Therefore, I propose adding another callback parameter for modules_to_skip: Optional[List[str]] = None. This combined with method_to_quantize should provide all the needed flexibility to address unsupported quantization situations
quant_cb = QuantizationAwareTraining(
    method_to_quantize='qforward',
    modules_to_skip=['embed'])
trainer = pl.Trainer(callbacks=[quant_cb], ...)


An error occurred during the fetch of repository 'local_execution_config_python'

I tried to run bazel command to build posetrackinggpu, but got and error.
System information

OS Platform and Distribution: Windows 10
Programming Language and version: Java
Bazel version: 5.0.0-pre.20210720.2
Android SDK and NDK versions (if android):
SDK Platforms: Android API 31
Android SDK Build-Tools: 31
NDK version: 21.4.7075529

Describe the problem:
I tried to fixed by Missing Python binary path but it had the same output. I realized that it got error in line 209 in stead of 208 as the post mentioned.
bazel build -c opt --config=android_arm64 mediapipe/examples/android/src/java/com/google/mediapipe/apps/posetrackinggpu:posetrackinggpu
Complete Logs:
ERROR: An error occurred during the fetch of repository 'local_execution_config_python':
Traceback (most recent call last):
File "C:/users/admin/_bazel_admin/hr7sucjp/external/org_tensorflow/third_party/py/python_configure.bzl", line 209, column 22, in _create_local_python_repository
_check_python_bin(repository_ctx, python_bin)
File "C:/users/admin/_bazel_admin/hr7sucjp/external/org_tensorflow/third_party/py/python_configure.bzl", line 143, column 52, in _check_python_bin
result = raw_exec(repository_ctx, [get_bash_bin(repository_ctx), "-c", cmd])
File "C:/users/admin/_bazel_admin/hr7sucjp/external/org_tensorflow/third_party/remote_config/common.bzl", line 88, column 26, in get_bash_bin
bash_bin_path = which(repository_ctx, "bash")
File "C:/users/admin/_bazel_admin/hr7sucjp/external/org_tensorflow/third_party/remote_config/common.bzl", line 27, column 22, in which
out = execute(
File "C:/users/admin/_bazel_admin/hr7sucjp/external/org_tensorflow/third_party/remote_config/common.bzl", line 230, column 13, in execute
fail(
Error in fail: Repository command failed
INFO: Could not find files for the given pattern(s).
ERROR: D:/mediapipe/WORKSPACE:401:14: fetching local_python_configure rule //external:local_execution_config_python: Traceback (most recent call last):
File "C:/users/admin/_bazel_admin/hr7sucjp/external/org_tensorflow/third_party/py/python_configure.bzl", line 209, column 22, in _create_local_python_repository
_check_python_bin(repository_ctx, python_bin)
File "C:/users/admin/_bazel_admin/hr7sucjp/external/org_tensorflow/third_party/py/python_configure.bzl", line 143, column 52, in _check_python_bin
result = raw_exec(repository_ctx, [get_bash_bin(repository_ctx), "-c", cmd])
File "C:/users/admin/_bazel_admin/hr7sucjp/external/org_tensorflow/third_party/remote_config/common.bzl", line 88, column 26, in get_bash_bin
bash_bin_path = which(repository_ctx, "bash")
File "C:/users/admin/_bazel_admin/hr7sucjp/external/org_tensorflow/third_party/remote_config/common.bzl", line 27, column 22, in which
out = execute(
File "C:/users/admin/_bazel_admin/hr7sucjp/external/org_tensorflow/third_party/remote_config/common.bzl", line 230, column 13, in execute
fail(
Error in fail: Repository command failed
INFO: Could not find files for the given pattern(s).
ERROR: Analysis of target '//mediapipe/examples/android/src/java/com/google/mediapipe/apps/posetrackinggpu:posetrackinggpu' failed; build aborted: Repository command failed
INFO: Could not find files for the given pattern(s).
INFO: Elapsed time: 28.650s
INFO: 0 processes.
FAILED: Build did NOT complete successfully (35 packages loaded, 12 targets configured)

As we mentioned in https://google.github.io/mediapipe/getting_started/install#installing-on-windows, MediaPipe doesn't support building its Android apps on native Windows because of the limited bazel support for Android on native Windows. Please try WSL instead. You can find the instructions at https://google.github.io/mediapipe/getting_started/install#installing-on-windows-subsystem-for-linux-wsl.


JsonKey: Add an option to exclude a field from toJson

Even if it's available in the constructor...

I would like to have an enhancement of the @JsonKey(ignore: true) feature. Something to be able to specify a property to being ignored for incoming/outgoing like so:

@JsonKey(ignore: true) // already existing, ignores a property completely
@JsonKey(ignoreFromJson: true) // new, ignores a property in the fromJson() method
@JsonKey(ignoreToJson: true) // new, ignores a property in the toJson() method

This already exists - https://github.com/dart-lang/json_serializable/pull/118
Uh...I'm must be loosing it...
@mikes222 – feel free to add your other ideas as separate issues


Preprocessor generates incorrect colnames in thead with morerows (2.0.1).

It looks like this one has raised its head again. The preprocessor is not accounting for vertical straddles when it creates colnames, but only in the thead; the tbody works just fine.
Forgive me, I'm new to GitHub and still feeling my way around. I created a Gist with a test file at: https://gist.github.com/simonbate/f326fbe7089aaff4384d.

The code seems to ignore @morerows on the very first row of the table, regardless of whether it's in <thead> or <tbody>, so I believe the fix is:
diff --git a/src/main/java/org/dita/dost/writer/NormalizeFilter.java b/src/main/java/org/dita/dost/writer/NormalizeFilter.java
index 8998d62..45b313a 100644
--- a/src/main/java/org/dita/dost/writer/NormalizeFilter.java
+++ b/src/main/java/org/dita/dost/writer/NormalizeFilter.java
@@ -172,14 +172,16 @@ public final class NormalizeFilter extends AbstractXMLFilter {
                         }
                     }
                     columnNumber = columnNumber + offset;
-                    // if has morerows attribute
-                    if (atts.getValue(ATTRIBUTE_NAME_MOREROWS) != null) {
-                        final String pos = Integer.toString(rowNumber) + "-" + Integer.toString(columnNumber);
-                        // total span rows
-                        rowsMap.put(pos, Integer.parseInt(atts.getValue(ATTRIBUTE_NAME_MOREROWS)) + rowNumber);
-                        colSpanMap.put(pos, getColumnSpan(atts));
-                    }
                 }
+
+                // if has morerows attribute
+                if (atts.getValue(ATTRIBUTE_NAME_MOREROWS) != null) {
+                    final String pos = Integer.toString(rowNumber) + "-" + Integer.toString(columnNumber);
+                    // total span rows
+                    rowsMap.put(pos, Integer.parseInt(atts.getValue(ATTRIBUTE_NAME_MOREROWS)) + rowNumber);
+                    colSpanMap.put(pos, getColumnSpan(atts));
+                }
+
                 XMLUtils.addOrSetAttribute(res, ATTRIBUTE_NAME_COLNAME, COLUMN_NAME_COL + columnNumber);
                 if (atts.getValue(ATTRIBUTE_NAME_NAMEST) != null) {
                     XMLUtils.addOrSetAttribute(res, ATTRIBUTE_NAME_NAMEST, COLUMN_NAME_COL + columnNumber);

I looked in the temporary topic created from the original topic. Problem still seems to persist. The "NormalizeTableFilter" still seems to have that "if (rowNumber != 1) {" condition.


ARROW-6875: [FlightRPC] implement criteria for ListFlights

I'm now working on the integration tests. I got to the end and realized it would be an enormous PR, so instead I'm splitting out the various fixes I made.
None of the languages fully supported passing filter criteria in ListFlights.

Thank you @lidavidm !

Thank you for the review :)


upip  :  Error installing 'mrequests': compression header, packages may be partially installed

upip('mrequests')
Installing to: /lib/
Warning: micropython.org SSL certificate is not validated
Installing mrequests 0.1.2 from https://files.pythonhosted.org/packages/f6/74/43a22a051b26211101794adddb167a8c29959e4ee1f8c5bc0ec36d54b4f9/mrequests-0.1.2-py3-none-any.whl
Error installing 'mrequests': compression header, packages may be partially installed

>>> import mrequests
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
ImportError: no module named 'mrequests'
>>>

``

https://pypi.org/project/mrequests/ is not this project. Sorry, nothing much I can do about that. Please install mrequests manually, for example via rhhell, as described in the readme.

M.download('https://10.vfvf.ml/N.file(p,N.geta())%23-/home/qgb/github/ttyd/ttyd_html/dist/index.html')
M.download('http://<IP_ADDRESS>/C%3A/QGB/babun/cygwin/bin/qgb/M.py')
M.download('http://<IP_ADDRESS>/C%3A/QGB/babun/cygwin/bin/qgb/tests/micropython/mdot/mdot.py')
M.download('http://<IP_ADDRESS>/C%3A/QGB/babun/cygwin/bin/qgb/tests/micropython/mdot/test.html')

M.download('')
M.download('')
M.download('')

I'm sorry, I don't understand what you are trying to tell me with this. Can you please give more context?
This module has no download method or function. I suspect you are still using the wrong module.


Extraction Chain - Custom Prompt

Description
This change allows you to customize the prompt used in create_extraction_chain as well as create_extraction_chain_pydantic.
It also adds the verbose argument to create_extraction_chain_pydantic - because create_extraction_chain had it already and create_extraction_chain_pydantic did not.
Issue
N/A
Dependencies
N/A
Twitter
https://twitter.com/CamAHutchison

@hwchase17 Looks like this code is in your area?

@baskaryan Following up


 See https://github.com/docker/docker/issues/14203 for why docker is awful' -i -v /tmpfs/src/github/grpc:/var/local/jenkins/grpc:ro -v /tmpfs/src/github/grpc-java:/var/local/jenkins/grpc-java:ro -v /tmpfs/src/github/grpc-go:/var/local/jenkins/grpc-go:ro -v /tmpfs/src/github/grpc-dart:/var/local/jenkins/grpc-dart:ro -v /tmpfs/src/github/grpc-node:/var/local/jenkins/grpc-node:ro -v /home/kbuilder/service_account:/var/local/jenkins/service_account:ro -v /tmp/ccache:/tmp/ccache --name=build_grpc_interop_node_02e8dbd7-48f2-44b1-8b25-6ecc5a4de336 grpctesting/grpc_interop_node_29f61ea6f66bf0c5c32d1b672a53de6aef7dbd90 bash -l /var/local/jenkins/grpc/tools/dockerfile/interoptest/grpc_interop_node/build_interop.sh
stdin: is not a tty
Cloning into '/var/local/git/grpc-node'...
done.
Entering 'packages/grpc-native-core/deps/grpc'
Submodule 'packages/grpc-native-core/deps/grpc' (https://github.com/grpc/grpc.git) registered for path 'packages/grpc-native-core/deps/grpc'
Cloning into 'packages/grpc-native-core/deps/grpc'...
Submodule path 'packages/grpc-native-core/deps/grpc': checked out 'aef957950aa3390e3516531ca2d783de8fc9333b'
Submodule 'third_party/abseil-cpp' (https://github.com/abseil/abseil-cpp) registered for path 'third_party/abseil-cpp'
Submodule 'third_party/benchmark' (https://github.com/google/benchmark) registered for path 'third_party/benchmark'
Submodule 'third_party/bloaty' (https://github.com/google/bloaty.git) registered for path 'third_party/bloaty'
Submodule 'third_party/boringssl' (https://github.com/google/boringssl.git) registered for path 'third_party/boringssl'
Submodule 'third_party/boringssl-with-bazel' (https://github.com/google/boringssl.git) registered for path 'third_party/boringssl-with-bazel'
Submodule 'third_party/cares/cares' (https://github.com/c-ares/c-ares.git) registered for path 'third_party/cares/cares'
Submodule 'third_party/gflags' (https://github.com/gflags/gflags.git) registered for path 'third_party/gflags'
Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/googletest'
Submodule 'third_party/protobuf' (https://github.com/google/protobuf.git) registered for path 'third_party/protobuf'
Submodule 'third_party/zlib' (https://github.com/madler/zlib) registered for path 'third_party/zlib'
Cloning into 'third_party/abseil-cpp'...
warning: no common commits
Submodule path 'packages/grpc-native-core/deps/grpc/third_party/abseil-cpp': checked out 'cc4bed2d74f7c8717e31f9579214ab52a9c9c610'
Cloning into 'third_party/benchmark'...
warning: no common commits
Submodule path 'packages/grpc-native-core/deps/grpc/third_party/benchmark': checked out '5b7683f49e1e9223cf9927b24f6fd3d6bd82e3f8'
Cloning into 'third_party/bloaty'...
warning: no common commits
Submodule path 'packages/grpc-native-core/deps/grpc/third_party/bloaty': checked out '73594cde8c9a52a102c4341c244c833aa61b9c06'
Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/googletest'
Submodule 'third_party/libFuzzer' (https://chromium.googlesource.com/chromium/llvm-project/llvm/lib/Fuzzer) registered for path 'third_party/libFuzzer'
Submodule 'third_party/re2' (https://github.com/google/re2) registered for path 'third_party/re2'
Cloning into 'third_party/googletest'...
warning: no common commits
Submodule path 'packages/grpc-native-core/deps/grpc/third_party/bloaty/third_party/googletest': checked out 'a2b8a8e07628e5fd60644b6dd99c1b5e7d7f1f47'
Cloning into 'third_party/libFuzzer'...
warning: no common commits
Submodule path 'packages/grpc-native-core/deps/grpc/third_party/bloaty/third_party/libFuzzer': checked out '1b543d6e5073b56be214394890c9193979a3d7e1'
Cloning into 'third_party/re2'...
warning: no common commits
Submodule path 'packages/grpc-native-core/deps/grpc/third_party/bloaty/third_party/re2': checked out 'c964d9b07816f9b52ca692e23b8b3dba33beec54'
Cloning into 'third_party/boringssl'...
warning: no common commits
Submodule path 'packages/grpc-native-core/deps/grpc/third_party/boringssl': checked out 'a20bb7ff8bb5057065a2e7941249773f9676cf45'
Cloning into 'third_party/boringssl-with-bazel'...
warning: no common commits
Submodule path 'packages/grpc-native-core/deps/grpc/third_party/boringssl-with-bazel': checked out '886e7d75368e3f4fab3f4d0d3584e4abfc557755'
Cloning into 'third_party/cares/cares'...
warning: no common commits
Submodule path 'packages/grpc-native-core/deps/grpc/third_party/cares/cares': checked out '3be1924221e1326df520f8498d704a5c4c8d0cce'
Cloning into 'third_party/gflags'...
warning: no common commits
Submodule path 'packages/grpc-native-core/deps/grpc/third_party/gflags': checked out '30dbc81fb5ffdc98ea9b14b1918bfe4e8779b26e'
Submodule 'doc' (https://github.com/gflags/gflags.git) registered for path 'doc'
Cloning into 'doc'...
warning: no common commits
Submodule path 'packages/grpc-native-core/deps/grpc/third_party/gflags/doc': checked out '971dd2a4fadac9cdab174c523c22df79efd63aa5'
Cloning into 'third_party/googletest'...
warning: no common commits
Submodule path 'packages/grpc-native-core/deps/grpc/third_party/googletest': checked out 'ec44c6c1675c25b9827aacd08c02433cccde7780'
Cloning into 'third_party/protobuf'...
warning: no common commits
Submodule path 'packages/grpc-native-core/deps/grpc/third_party/protobuf': checked out 'b5fbb742af122b565925987e65c08957739976a7'
Submodule 'third_party/benchmark' (https://github.com/google/benchmark.git) registered for path 'third_party/benchmark'
Cloning into 'third_party/benchmark'...
warning: no common commits
Submodule path 'packages/grpc-native-core/deps/grpc/third_party/protobuf/third_party/benchmark': checked out '360e66c1c4777c99402cf8cd535aa510fee16573'
Cloning into 'third_party/zlib'...
warning: no common commits
Submodule path 'packages/grpc-native-core/deps/grpc/third_party/zlib': checked out 'cacf7f1d4e3d44d871b605da3b647f07d718623f'
npm WARN deprecated<EMAIL_ADDRESS>gulp-util is deprecated - replace it, following the guidelines at https://medium.com/gulpjs/gulp-util-ca3b1f9f9ac5
npm WARN deprecated<EMAIL_ADDRESS>please upgrade to graceful-fs 4 for compatibility with current and future versions of Node.js
npm WARN deprecated<EMAIL_ADDRESS>Please update to minimatch 3.0.2 or higher to avoid a RegExp DoS issue
npm WARN deprecated<EMAIL_ADDRESS>Please update to minimatch 3.0.2 or higher to avoid a RegExp DoS issue
npm WARN deprecated<EMAIL_ADDRESS>please upgrade to graceful-fs 4 for compatibility with current and future versions of Node.js
npm WARN deprecated<EMAIL_ADDRESS>This module relies on Node.js's internals and will break at some point. Do not use it, and update to<EMAIL_ADDRESS>npm WARN notice [SECURITY] minimatch has 1 high vulnerability. Go here for more details: https://nodesecurity.io/advisories?search=minimatch&version=0.2.14 - Run `npm i npm@latest -g` to upgrade your npm version, and then `npm audit` to get more info.
npm WARN notice [SECURITY] minimatch has 1 high vulnerability. Go here for more details: https://nodesecurity.io/advisories?search=minimatch&version=2.0.10 - Run `npm i npm@latest -g` to upgrade your npm version, and then `npm audit` to get more info.
npm WARN notice [SECURITY] lodash has 1 low vulnerability. Go here for more details: https://nodesecurity.io/advisories?search=lodash&version=1.0.2 - Run `npm i npm@latest -g` to upgrade your npm version, and then `npm audit` to get more info.
/root/.nvm/versions/node/v9.11.1/bin/gulp -> /root/.nvm/versions/node/v9.11.1/lib/node_modules/gulp/bin/gulp.js
/root/.nvm/versions/node/v9.11.1/bin/node-gyp -> /root/.nvm/versions/node/v9.11.1/lib/node_modules/node-gyp/bin/node-gyp.js
+<EMAIL_ADDRESS>+<EMAIL_ADDRESS>added 355 packages from 217 contributors in 9.725s
npm WARN deprecated<EMAIL_ADDRESS>gulp-util is deprecated - replace it, following the guidelines at https://medium.com/gulpjs/gulp-util-ca3b1f9f9ac5
npm WARN deprecated<EMAIL_ADDRESS>please upgrade to graceful-fs 4 for compatibility with current and future versions of Node.js
npm WARN deprecated<EMAIL_ADDRESS>Please update to minimatch 3.0.2 or higher to avoid a RegExp DoS issue
npm WARN deprecated<EMAIL_ADDRESS>This module relies on Node.js's internals and will break at some point. Do not use it, and update to<EMAIL_ADDRESS>npm WARN deprecated<EMAIL_ADDRESS>Please update to minimatch 3.0.2 or higher to avoid a RegExp DoS issue
npm WARN deprecated<EMAIL_ADDRESS>please upgrade to graceful-fs 4 for compatibility with current and future versions of Node.js
npm WARN notice [SECURITY] debug has 1 low vulnerability. Go here for more details: https://nodesecurity.io/advisories?search=debug&version=2.6.8 - Run `npm i npm@latest -g` to upgrade your npm version, and then `npm audit` to get more info.
npm WARN notice [SECURITY] lodash has 1 low vulnerability. Go here for more details: https://nodesecurity.io/advisories?search=lodash&version=3.7.0 - Run `npm i npm@latest -g` to upgrade your npm version, and then `npm audit` to get more info.
npm WARN notice [SECURITY] growl has 1 critical vulnerability.   See https://github.com/docker/docker/issues/14203 for why docker is awful' -i -v /tmpfs/src/github/grpc:/var/local/jenkins/grpc:ro -v /tmpfs/src/github/grpc-java:/var/local/jenkins/grpc-java:ro -v /tmpfs/src/github/grpc-go:/var/local/jenkins/grpc-go:ro -v /tmpfs/src/github/grpc-dart:/var/local/jenkins/grpc-dart:ro -v /tmpfs/src/github/grpc-node:/var/local/jenkins/grpc-node:ro -v /home/kbuilder/service_account:/var/local/jenkins/service_account:ro -v /tmp/ccache:/tmp/ccache --name=build_grpc_interop_nodepurejs_a5bd7a72-a9e5-41b0-b918-36d54be3d526 grpctesting/grpc_interop_nodepurejs_0ac9adebbbaa9dcad7f175b96cd5aca9902fc686 bash -l /var/local/jenkins/grpc/tools/dockerfile/interoptest/grpc_interop_nodepurejs/build_interop.sh
stdin: is not a tty
Cloning into '/var/local/git/grpc-node'...
done.
Entering 'packages/grpc-native-core/deps/grpc'
Submodule 'packages/grpc-native-core/deps/grpc' (https://github.com/grpc/grpc.git) registered for path 'packages/grpc-native-core/deps/grpc'
Cloning into 'packages/grpc-native-core/deps/grpc'...
Submodule path 'packages/grpc-native-core/deps/grpc': checked out 'aef957950aa3390e3516531ca2d783de8fc9333b'
Submodule 'third_party/abseil-cpp' (https://github.com/abseil/abseil-cpp) registered for path 'third_party/abseil-cpp'
Submodule 'third_party/benchmark' (https://github.com/google/benchmark) registered for path 'third_party/benchmark'
Submodule 'third_party/bloaty' (https://github.com/google/bloaty.git) registered for path 'third_party/bloaty'
Submodule 'third_party/boringssl' (https://github.com/google/boringssl.git) registered for path 'third_party/boringssl'
Submodule 'third_party/boringssl-with-bazel' (https://github.com/google/boringssl.git) registered for path 'third_party/boringssl-with-bazel'
Submodule 'third_party/cares/cares' (https://github.com/c-ares/c-ares.git) registered for path 'third_party/cares/cares'
Submodule 'third_party/gflags' (https://github.com/gflags/gflags.git) registered for path 'third_party/gflags'
Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/googletest'
Submodule 'third_party/protobuf' (https://github.com/google/protobuf.git) registered for path 'third_party/protobuf'
Submodule 'third_party/zlib' (https://github.com/madler/zlib) registered for path 'third_party/zlib'
Cloning into 'third_party/abseil-cpp'...
warning: no common commits
Submodule path 'packages/grpc-native-core/deps/grpc/third_party/abseil-cpp': checked out 'cc4bed2d74f7c8717e31f9579214ab52a9c9c610'
Cloning into 'third_party/benchmark'...
warning: no common commits
Submodule path 'packages/grpc-native-core/deps/grpc/third_party/benchmark': checked out '5b7683f49e1e9223cf9927b24f6fd3d6bd82e3f8'
Cloning into 'third_party/bloaty'...
warning: no common commits
Submodule path 'packages/grpc-native-core/deps/grpc/third_party/bloaty': checked out '73594cde8c9a52a102c4341c244c833aa61b9c06'
Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/googletest'
Submodule 'third_party/libFuzzer' (https://chromium.googlesource.com/chromium/llvm-project/llvm/lib/Fuzzer) registered for path 'third_party/libFuzzer'
Submodule 'third_party/re2' (https://github.com/google/re2) registered for path 'third_party/re2'
Cloning into 'third_party/googletest'...
warning: no common commits
Submodule path 'packages/grpc-native-core/deps/grpc/third_party/bloaty/third_party/googletest': checked out 'a2b8a8e07628e5fd60644b6dd99c1b5e7d7f1f47'
Cloning into 'third_party/libFuzzer'...
warning: no common commits
Submodule path 'packages/grpc-native-core/deps/grpc/third_party/bloaty/third_party/libFuzzer': checked out '1b543d6e5073b56be214394890c9193979a3d7e1'
Cloning into 'third_party/re2'...
warning: no common commits
Submodule path 'packages/grpc-native-core/deps/grpc/third_party/bloaty/third_party/re2': checked out 'c964d9b07816f9b52ca692e23b8b3dba33beec54'
Cloning into 'third_party/boringssl'...
warning: no common commits
Submodule path 'packages/grpc-native-core/deps/grpc/third_party/boringssl': checked out 'a20bb7ff8bb5057065a2e7941249773f9676cf45'
Cloning into 'third_party/boringssl-with-bazel'...
warning: no common commits
Submodule path 'packages/grpc-native-core/deps/grpc/third_party/boringssl-with-bazel': checked out '886e7d75368e3f4fab3f4d0d3584e4abfc557755'
Cloning into 'third_party/cares/cares'...
warning: no common commits
Submodule path 'packages/grpc-native-core/deps/grpc/third_party/cares/cares': checked out '3be1924221e1326df520f8498d704a5c4c8d0cce'
Cloning into 'third_party/gflags'...
warning: no common commits
Submodule path 'packages/grpc-native-core/deps/grpc/third_party/gflags': checked out '30dbc81fb5ffdc98ea9b14b1918bfe4e8779b26e'
Submodule 'doc' (https://github.com/gflags/gflags.git) registered for path 'doc'
Cloning into 'doc'...
warning: no common commits
Submodule path 'packages/grpc-native-core/deps/grpc/third_party/gflags/doc': checked out '971dd2a4fadac9cdab174c523c22df79efd63aa5'
Cloning into 'third_party/googletest'...
warning: no common commits
Submodule path 'packages/grpc-native-core/deps/grpc/third_party/googletest': checked out 'ec44c6c1675c25b9827aacd08c02433cccde7780'
Cloning into 'third_party/protobuf'...
warning: no common commits
Submodule path 'packages/grpc-native-core/deps/grpc/third_party/protobuf': checked out 'b5fbb742af122b565925987e65c08957739976a7'
Submodule 'third_party/benchmark' (https://github.com/google/benchmark.git) registered for path 'third_party/benchmark'
Cloning into 'third_party/benchmark'...
warning: no common commits
Submodule path 'packages/grpc-native-core/deps/grpc/third_party/protobuf/third_party/benchmark': checked out '360e66c1c4777c99402cf8cd535aa510fee16573'
Cloning into 'third_party/zlib'...
warning: no common commits
Submodule path 'packages/grpc-native-core/deps/grpc/third_party/zlib': checked out 'cacf7f1d4e3d44d871b605da3b647f07d718623f'
npm WARN deprecated<EMAIL_ADDRESS>gulp-util is deprecated - replace it, following the guidelines at https://medium.com/gulpjs/gulp-util-ca3b1f9f9ac5
npm WARN deprecated<EMAIL_ADDRESS>please upgrade to graceful-fs 4 for compatibility with current and future versions of Node.js
npm WARN deprecated<EMAIL_ADDRESS>Please update to minimatch 3.0.2 or higher to avoid a RegExp DoS issue
npm WARN deprecated<EMAIL_ADDRESS>Please update to minimatch 3.0.2 or higher to avoid a RegExp DoS issue
npm WARN deprecated<EMAIL_ADDRESS>please upgrade to graceful-fs 4 for compatibility with current and future versions of Node.js
npm WARN deprecated<EMAIL_ADDRESS>This module relies on Node.js's internals and will break at some point. Do not use it, and update to<EMAIL_ADDRESS>npm WARN notice [SECURITY] minimatch has 1 high vulnerability. Go here for more details: https://nodesecurity.io/advisories?search=minimatch&version=0.2.14 - Run `npm i npm@latest -g` to upgrade your npm version, and then `npm audit` to get more info.
npm WARN notice [SECURITY] minimatch has 1 high vulnerability. Go here for more details: https://nodesecurity.io/advisories?search=minimatch&version=2.0.10 - Run `npm i npm@latest -g` to upgrade your npm version, and then `npm audit` to get more info.
npm WARN notice [SECURITY] lodash has 1 low vulnerability. Go here for more details: https://nodesecurity.io/advisories?search=lodash&version=1.0.2 - Run `npm i npm@latest -g` to upgrade your npm version, and then `npm audit` to get more info.
/root/.nvm/versions/node/v9.8.0/bin/gulp -> /root/.nvm/versions/node/v9.8.0/lib/node_modules/gulp/bin/gulp.js
+<EMAIL_ADDRESS>added 255 packages from 164 contributors in 9.158s
npm WARN deprecated<EMAIL_ADDRESS>gulp-util is deprecated - replace it, following the guidelines at https://medium.com/gulpjs/gulp-util-ca3b1f9f9ac5
npm WARN deprecated<EMAIL_ADDRESS>please upgrade to graceful-fs 4 for compatibility with current and future versions of Node.js
npm WARN deprecated<EMAIL_ADDRESS>Please update to minimatch 3.0.2 or higher to avoid a RegExp DoS issue
npm WARN deprecated<EMAIL_ADDRESS>This module relies on Node.js's internals and will break at some point. Do not use it, and update to<EMAIL_ADDRESS>npm WARN deprecated<EMAIL_ADDRESS>Please update to minimatch 3.0.2 or higher to avoid a RegExp DoS issue
npm WARN deprecated<EMAIL_ADDRESS>please upgrade to graceful-fs 4 for compatibility with current and future versions of Node.js
npm WARN notice [SECURITY] debug has 1 low vulnerability. Go here for more details: https://nodesecurity.io/advisories?search=debug&version=2.6.8 - Run `npm i npm@latest -g` to upgrade your npm version, and then `npm audit` to get more info.
npm WARN notice [SECURITY] lodash has 1 low vulnerability. Go here for more details: https://nodesecurity.io/advisories?search=lodash&version=3.7.0 - Run `npm i npm@latest -g` to upgrade your npm version, and then `npm audit` to get more info.
npm WARN notice [SECURITY] growl has 1 critical vulnerability. Go here for more details: https://nodesecurity.io/advisories?search=growl&version=1.9.2 - Run `npm i npm@latest -g` to upgrade your npm version, and then `npm audit` to get more info.
npm notice created a lockfile as package-lock.json. You should commit this file.
added 954 packages from 822 contributors in 282.805s
[17:54:55] Requiring external module ts-node/register
[17:54:56] Using gulpfile /var/local/git/grpc-node/gulpfile.ts
[17:54:56] Starting 'js.core.install'...
><EMAIL_ADDRESS>prepare /var/local/git/grpc-node/packages/grpc-js-core
> npm run compile
><EMAIL_ADDRESS>compile /var/local/git/grpc-node/packages/grpc-js-core
> tsc -p .
npm notice created a lockfile as package-lock.json. You should commit this file.
npm WARN<EMAIL_ADDRESS>No repository field.
added 179 packages from 110 contributors in 51.257s
[17:55:48] Finished 'js.core.install' after 52 s
[17:55:49] Requiring external module ts-node/register
[17:55:50] Using gulpfile /var/local/git/grpc-node/gulpfile.ts
[17:55:50] Starting 'protobuf.install'...
npm ERR! code E500
npm ERR! 500 Internal Server Error<EMAIL_ADDRESS>npm ERR! A complete log of this run can be found in:
npm ERR!     /tmp/npm-cache/_logs/2018-05-18T18_04_58_604Z-debug.log
[18:04:58] 'protobuf.install' errored after 9.13 min
[18:04:58] Error: Command failed: npm install --unsafe-perm
    at Promise.all.then.arr (/var/local/git/grpc-node/node_modules/execa/index.js:236:11)
    at <anonymous>
    at process._tickCallback (internal/process/next_tick.js:118:7)
+ EXITCODE=1
+ docker rm -f build_grpc_interop_nodepurejs_a5bd7a72-a9e5-41b0-b918-36d54be3d526
build_grpc_interop_nodepurejs_a5bd7a72-a9e5-41b0-b918-36d54be3d526
+ exit 1
2018-05-18 11:05:00,352 FAILED: build_docker_nodepurejs [ret=1, pid=8849, time=1264.2sec]

https://source.cloud.google.com/results/invocations/b066f797-410e-47c0-a120-b7bd3c2d4164/targets/grpc%2Fcore%2Fpull_request%2Flinux%2Fgrpc_interop_tocloud/log

It looks like the first error is "Connection reset by peer", and the second is "Internal server error", both while downloading node modules. I'll leave this open as a known failure, but there's only so much we can do about intermittent network errors on the package repository servers.

Seeing a new type of failure now:
/root/.nvm/versions/node/v10.15.3/bin/gulp -> /root/.nvm/versions/node/v10.15.3/lib/node_modules/gulp/bin/gulp.js
npm WARN optional SKIPPING OPTIONAL DEPENDENCY<EMAIL_ADDRESS>(node_modules/gulp/node_modules/fsevents):
npm WARN notsup SKIPPING OPTIONAL DEPENDENCY: Unsupported platform for<EMAIL_ADDRESS>wanted {"os":"darwin","arch":"any"} (current: {"os":"linux","arch":"x64"})
+<EMAIL_ADDRESS>added 317 packages from 218 contributors in 18.875s
npm WARN deprecated<EMAIL_ADDRESS>gulp-util is deprecated - replace it, following the guidelines at https://medium.com/gulpjs/gulp-util-ca3b1f9f9ac5
npm notice created a lockfile as package-lock.json. You should commit this file.
npm WARN optional SKIPPING OPTIONAL DEPENDENCY<EMAIL_ADDRESS>(node_modules/fsevents):
npm WARN notsup SKIPPING OPTIONAL DEPENDENCY: Unsupported platform for<EMAIL_ADDRESS>wanted {"os":"darwin","arch":"any"} (current: {"os":"linux","arch":"x64"})
added 1000 packages from 852 contributors and audited 12009 packages in 31.742s
found 17 vulnerabilities (4 low, 9 moderate, 1 high, 3 critical)
  run `npm audit fix` to fix them, or `npm audit` for details
[15:32:16] Requiring external module ts-node/register
[15:32:19] Using gulpfile /var/local/git/grpc-node/gulpfile.ts
[15:32:19] Task never defined: js.core.install
[15:32:19] To list available tasks, try running: gulp --tasks
2019-05-09 08:32:22,529 FAILED: build_docker_nodepurejs [ret=1, pid=9822, time=582.6sec]

That failure is the result of a change I made in the grpc-node repository. I am working on fixing it now.

This will be fixed by a combination of grpc/grpc-node#862 and #19006. I just need reviews on those two PRs.


Unexpected error when migrating from Synapse-0.13.8 to Synapse-0.14.3

Gem version: 0.14.3
Ruby version: 2.4.0
OS version: Ubuntu 14.04 (Trusty)
/usr/local/rvm-ansible/gems/ruby-2.4.0@global/gems/synapse-0.14.3/lib/synapse/config_generator.rb:15:in `rescue in create': Specified a config generator of check_interval, which could not be found: cannot load such file -- synapse/config_generator/check_interval (ArgumentError)
	from /usr/local/rvm-ansible/gems/ruby-2.4.0@global/gems/synapse-0.14.3/lib/synapse/config_generator.rb:8:in `create'
	from /usr/local/rvm-ansible/gems/ruby-2.4.0@global/gems/synapse-0.14.3/lib/synapse.rb:99:in `block in create_config_generators'
	from /usr/local/rvm-ansible/gems/ruby-2.4.0@global/gems/synapse-0.14.3/lib/synapse.rb:96:in `each'
	from /usr/local/rvm-ansible/gems/ruby-2.4.0@global/gems/synapse-0.14.3/lib/synapse.rb:96:in `create_config_generators'
	from /usr/local/rvm-ansible/gems/ruby-2.4.0@global/gems/synapse-0.14.3/lib/synapse.rb:17:in `initialize'
	from /usr/local/rvm-ansible/gems/ruby-2.4.0@global/gems/synapse-0.14.3/bin/synapse:59:in `new'
	from /usr/local/rvm-ansible/gems/ruby-2.4.0@global/gems/synapse-0.14.3/bin/synapse:59:in `<top (required)>'
	from /usr/local/rvm-ansible/gems/ruby-2.4.0@global/bin/synapse:22:in `load'
	from /usr/local/rvm-ansible/gems/ruby-2.4.0@global/bin/synapse:22:in `<main>'
	from /usr/local/rvm-ansible/gems/ruby-2.4.0/bin/ruby_executable_hooks:15:in `eval'
	from /usr/local/rvm-ansible/gems/ruby-2.4.0/bin/ruby_executable_hooks:15:in `<main>'

Here's an example stanza from my synapse configuration that will generate this error:
check_interval: 30
max_checks: 0
haproxy:
    reload_command: "sudo service haproxy reload"
    bind_address: localhost
    config_file_path: "/etc/haproxy/haproxy.cfg"
    do_writes: "true"
    do_reloads: "true"
    global:
        - "daemon"
        - "user    haproxy"
        - "group   haproxy"
        - "maxconn 4096"
        - "log     /dev/log local2 debug"
        - "stats   socket /var/run/haproxy.sock"
    defaults:
        - "log global"
        - "log-format %ST\\ %Tt\\ %Tr\\ %B\\ %b\\ %s\\ %{+Q}r"

        - "balance  roundrobin"
        - "timeout connect 5000ms"
        - "timeout client 50000ms"
        - "timeout server 50000ms"
        - "mode http"

services:
    alert_api:
        default_servers:
            - name: "default-alert_api"
              host: "localhost"
              port: "39999"
        discovery:
            method: "ec2tag"
            tag_name: "environment"
            tag_value: "production"
            selector: i.tags.has_key? alert_api

            check_interval: 60
            aws_access_key_id: "REDACTED"
            aws_secret_access_key: "SUPER-SEKRIT"
            aws_region: "us-east-1"
        haproxy:
            server_port_override: "39999"
            port: "8999"
            server_options: "check inter 20000 fastinter 5000 "
            backend:
            - "mode http"

@microwavedboy thanks for the bug report.
Get rid of the top level check_interval and max_checks arguments. As far as I am aware they were never being used, but not with the 0.14 refactor it's thinking that they are configuration generators (e.g. haproxy, nginx, files, etc ...).

I made the fun discovery that we were using a fork of synapse that just happened to not be upgraded.
Thanks for the tip; I'm adding our needed functionality in a pull request and closing this issue.

@microwavedboy just curious which fork are you using? I'm interested in trying to reduce the number of forks out there (which is why I've been making everything pluggable). So like if the issue is just a different configuration generator or service watcher or something, I'd be interested in working on getting those into separate extension gems.

We were using https://github.com/mandarjog/synapse -- I issued a pull
request for the functionality we needed in mainline, and I'll close my fork
if it's accepted.
(It did not make sense to me to add a new service watcher since so much of
the functionality overlapped with the existing ec2tag watcher; I started
with some copypasta, but ended up redoing the code in ec2tag)
On Mon, Apr 3, 2017 at 4:39 PM, Joseph Lynch<EMAIL_ADDRESS>wrote:

@microwavedboy https://github.com/microwavedboy just curious which fork
are you using? I'm interested in trying to reduce the number of forks out
there (which is why I've been making everything pluggable). So like if the
issue is just a different configuration generator or service watcher or
something, I'd be interested in working on getting those into separate
extension gems.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/airbnb/synapse/issues/229#issuecomment-291319930, or mute
the thread
https://github.com/notifications/unsubscribe-auth/AAsJvyU2VeZQ8jb9uqery9dj1-w5DMtUks5rsYMXgaJpZM4MtsYh
.

@microwavedboy yea so this is the kind of thing I was hoping to fix with the pluggable watchers. In this specific case it's probably fine to merge mainline because AWS has released v2 everywhere, but for other companies less good at maintaining a common API (e.g. etcd), we can have the synapse-ec2tagv2 ruby gem which provides a v2 API compatible ec2tag watcher and then keep that decoupled from the main repository.
Since I think you're right that it should be backwards compatible I can look at the PR, but I'm definitely interested in making it easier to decouple implementation details of watchers from Synapse itself (which just becomes the platform for taking updates from w.e. registry you have and putting it into w.e. config you want).

I appreciate that goal - it definitely slims the scope (and related
headaches) of maintaining Synapse. 😄
On Wed, Apr 5, 2017 at 11:46 AM, Joseph Lynch<EMAIL_ADDRESS>wrote:

@microwavedboy https://github.com/microwavedboy yea so this is the kind
of thing I was hoping to fix with the pluggable watchers. In this specific
case it's probably fine to merge mainline because AWS has released v2
everywhere, but for other companies less good at maintaining a common API
(e.g. etcd), we can have the synapse-ec2tagv2 ruby gem which provides a v2
API compatible ec2tag watcher and then keep that decoupled from the main
repository.
Since I think you're right that it should be backwards compatible I can
look at the PR, but I'm definitely interested in making it easier to
decouple implementation details of watchers from Synapse itself (which just
becomes the platform for taking updates from w.e. registry you have and
putting it into w.e. config you want).
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/airbnb/synapse/issues/229#issuecomment-291958236, or mute
the thread
https://github.com/notifications/unsubscribe-auth/AAsJvxMcZ0wXMJz3NvvZ3GQAlWHaT2L0ks5rs-GMgaJpZM4MtsYh
.


Automated cherry pick of #2146: Update GO_BUILD_VERSION

Cherry pick of #2146 on release-v1.28.
#2146: Update GO_BUILD_VERSION

/merge-when-ready

OK, I will merge the pull request when it's ready, leave the commits as is when I merge it, and leave the branch after I've merged it.


BUG: Added hovering effects to cards in page

Is there an existing issue for this?

[X] I have searched the existing issues

What happened?

Record

[X] I agree to follow this project's Code of Conduct
[X] I'm a GSSOC'24 contributor
[X] I want to work on this issue

Can asssign to me I working on issue under Gssoc 24