linked post inlcude instructions that no longer work

The documentation links to an old post which, unfortunately, reports commands that no longer work.
The post is: https://techcommunity.microsoft.com/t5/itops-talk-blog/how-to-setup-nested-virtualization-for-azure-vm-vhd/ba-p/1115338
The first command reported in the post does no longer work and it gives an error as follows:
PS C:\Users\fausto> Install-WindowsFeature -Name DHCP,Hyper-V  –IncludeManagementTools
>>
Success Restart Needed Exit Code      Feature Result
------- -------------- ---------      --------------
False   Maybe          Failed         {}
Install-WindowsFeature : A prerequisite check for the Hyper-V feature failed.
1. Hyper-V cannot be installed because virtualization support is not enabled in the BIOS.
At line:1 char:1
+ Install-WindowsFeature -Name DHCP,Hyper-V  –IncludeManagementTools
+ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
    + CategoryInfo          : InvalidOperation: (Hyper-V:ServerComponentWrapper) [Install-WindowsFeature], Exception
    + FullyQualifiedErrorId : Alteration_PrerequisiteCheck_Failed,Microsoft.Windows.ServerManager.Commands.AddWindowsF
   eatureCommand

The following command instead works:
Enable-WindowsOptionalFeature -Online -FeatureName Microsoft-Hyper-V -All -Verbose

Document Details
⚠ Do not edit this section. It is required for learn.microsoft.com ➟ GitHub issue linking.

ID: 9a13cf32-4be1-94d9-b764-0faf79372065
Version Independent ID: 6787036e-5a30-bd17-e87a-54f61b0ba47f
Content: What is Nested Virtualization for Hyper-V?
Content Source: virtualization/hyper-v-on-windows/user-guide/nested-virtualization.md
Service: windows-10-hyperv
GitHub Login: @robinharwood
Microsoft Alias: wscontent

to be precise, before running the commands in the post, it is needed to run the command:
Enable-WindowsOptionalFeature -Online -FeatureName Microsoft-Hyper-V -All -Verbose

We hugely appreciate your contribution, feedback, and support to our technical documentation.
We’ve phased out GitHub Issues on this repository as the feedback mechanism for content and have replaced it with a new feedback system. For more information see, Content User Feedback. As part of this rollout, we are migrating your issue where our team will use your comments to improve the documentation experience. Unfortunately, this does mean you won't be able to access this issue after the migration is complete.
All issues will be migrated by Thursday 29th August 2024.
Once again, thank you for your valuable feedback, we hope you’ll continue to contribute using our new feedback system.


Triggering events, search for them

To be able to give feedback, we should hardly try to find triggering events.
Speeding up and slowing down one's.
Discussed in the issue #70, giving an example: HS:n datadeski.
There is no doubt, volleyball match was a speeding triggering event. The response was immediate and inevitable (as participants were unprotected), done by virus. But it was also partly invisible in our charts (not all contaminated persons were tested).
Nevertheless peaks in charts show some regularity (at least in early stages, where there is one triggering event, not several at the same time). This obviousness disappeares by time as spread routes with different incubation times mix with each other (spread starts to be local).
In slowing triggering events we have a longer delay: incubation time+testing+input to the statistics+decision making by authorities+announcement+response time by public(depends on local culture). A far more dimmed correlation.
I feel, at this point we should start to work together with true epidemiologits and epidemic statisticians (as mentioned in my comment to issue #24 - 3 days ago).
I'd assume, search for triggering events would be more productive and better localized than predicting amount of contaminated persons/"possible cases" (#24).

This is not within scope of the application, so will have to close the issue.

Thanks,...
But, what's the scope of the Koroonakaart application?
Is it written anywhere here?
Did I miss something?


Making TM_SELECTED_TEXT snippet variable working with overtyped text v2

Continuation of #105220
Fixes #62907

suggestController.ts is entry point of changes
I did not implemented fixed storage for small overtypes since calling ITextModel.getValueInRange() is producing garbage anyway. So, simply storing. Restricted by 1000000 bytes as was suggested.
Made the retrieval of stored text deferred until needed in the SelectionBasedVariableResolver.
off topic
I noticed that SuggestWidget.onDidHide gets called constantly when typing, even when SuggestWidget.onDidShow has not been called before and the widget is not active. Perhaps this should be removed for performance.


abstract away serialize and deserialize on user defined structs

Blocked by https://github.com/noir-lang/noir/issues/3379

Waiting on derived macros from Noir

Related to #5078


Actions need to be updated to v3 to avoid deprecation

Workflows have the following warning:

Node.js 12 actions are deprecated. For more information see: https://github.blog/changelog/2022-09-22-github-actions-all-actions-will-begin-running-on-node16-instead-of-node12/. Please update the following actions to use Node.js 16: actions/checkout, actions/checkout

Need to update to v3 to use Node.js 16

@nikParasyr released: https://github.com/EmilienM/devstack-action/releases/tag/v0.9


fix: Loop in MySQL

loop is a keyword in MySQL. So it throws an error when executing.
I renamed it to _loop in the generated SQL

Good idea!


New Cumulus Lab

Just adding a new lab-example for Cumulus

good to merge along with #507 ?

yup :+1

@networkop there is some issue with links - https://github.com/srl-labs/containerlab/runs/3036128969?check_suite_focus=true#step:4:23


JRuby-9K: Lotus Server Doesn't Work

We use WeBrick as the default server in development and we use Shotgun to reload the app.
Shotgun uses fork to spawn a new child process and then quits the old one. Since fork is not supported on JRuby we get a runtime error when trying to visit the app on browser.
Here's the stacktrace.
lotus-sample git:(master) ✗ bundle exec lotus server
uri:classloader:/jruby/kernel/kernel.rb:28: warning: unsupported exec option: close_others
[2015-05-27 11:46:28] INFO  WEBrick 1.3.1
[2015-05-27 11:46:28] INFO  ruby 2.2.2 (2015-05-25) [java]
[2015-05-27 11:46:28] INFO  WEBrick::HTTPServer#start: pid=5205 port=2300
[2015-05-27 11:46:39] ERROR NotImplementedError: fork is not available on this platform
	org/jruby/RubyKernel.java:1728:in `fork'
	/Users/serdardogruyol/.rvm/gems/jruby-head/gems/shotgun-0.9.1/lib/shotgun/loader.rb:27:in `call!'
	/Users/serdardogruyol/.rvm/gems/jruby-head/gems/shotgun-0.9.1/lib/shotgun/loader.rb:18:in `call'
	/Users/serdardogruyol/.rvm/gems/jruby-head/gems/rack-1.6.1/lib/rack/lint.rb:49:in `_call'
	/Users/serdardogruyol/.rvm/gems/jruby-head/gems/rack-1.6.1/lib/rack/lint.rb:37:in `call'
	/Users/serdardogruyol/.rvm/gems/jruby-head/gems/rack-1.6.1/lib/rack/showexceptions.rb:24:in `call'
	/Users/serdardogruyol/.rvm/gems/jruby-head/gems/rack-1.6.1/lib/rack/commonlogger.rb:33:in `call'
	/Users/serdardogruyol/.rvm/gems/jruby-head/gems/rack-1.6.1/lib/rack/content_length.rb:15:in `call'
	/Users/serdardogruyol/.rvm/gems/jruby-head/gems/rack-1.6.1/lib/rack/handler/webrick.rb:89:in `service'
	/Users/serdardogruyol/.rvm/rubies/jruby-head/lib/ruby/stdlib/webrick/httpserver.rb:138:in `service'
	/Users/serdardogruyol/.rvm/rubies/jruby-head/lib/ruby/stdlib/webrick/httpserver.rb:94:in `run'
	/Users/serdardogruyol/.rvm/rubies/jruby-head/lib/ruby/stdlib/webrick/server.rb:294:in `block in start_thread'
[2015-05-27 11:46:39] ERROR NotImplementedError: fork is not available on this platform
	org/jruby/RubyKernel.java:1728:in `fork'
	/Users/serdardogruyol/.rvm/gems/jruby-head/gems/shotgun-0.9.1/lib/shotgun/loader.rb:27:in `call!'
	/Users/serdardogruyol/.rvm/gems/jruby-head/gems/shotgun-0.9.1/lib/shotgun/loader.rb:18:in `call'
	/Users/serdardogruyol/.rvm/gems/jruby-head/gems/rack-1.6.1/lib/rack/lint.rb:49:in `_call'
	/Users/serdardogruyol/.rvm/gems/jruby-head/gems/rack-1.6.1/lib/rack/lint.rb:37:in `call'
	/Users/serdardogruyol/.rvm/gems/jruby-head/gems/rack-1.6.1/lib/rack/showexceptions.rb:24:in `call'
	/Users/serdardogruyol/.rvm/gems/jruby-head/gems/rack-1.6.1/lib/rack/commonlogger.rb:33:in `call'
	/Users/serdardogruyol/.rvm/gems/jruby-head/gems/rack-1.6.1/lib/rack/content_length.rb:15:in `call'
	/Users/serdardogruyol/.rvm/gems/jruby-head/gems/rack-1.6.1/lib/rack/handler/webrick.rb:89:in `service'
	/Users/serdardogruyol/.rvm/rubies/jruby-head/lib/ruby/stdlib/webrick/httpserver.rb:138:in `service'
	/Users/serdardogruyol/.rvm/rubies/jruby-head/lib/ruby/stdlib/webrick/httpserver.rb:94:in `run'
	/Users/serdardogruyol/.rvm/rubies/jruby-head/lib/ruby/stdlib/webrick/server.rb:294:in `block in start_thread'
^C[2015-05-27 11:50:19] INFO  going to shutdown ...
[2015-05-27 11:50:19] INFO  WEBrick::HTTPServer#start done.

We need to replace either WeBrick or Shotgun with something else on JRuby.

Related PR at https://github.com/lotus/lotus/pull/238 :+1:

@Sdogruyol Can you please test this for me using JRuby?
brew update && brew install entr
cd path/to/project
find . | entr -r bundle exec lotus server --no-code-reloading

Visit a page, edit a source file and visit again, to check if code reloading works. It does locally for me.

@jodosha gonna check now. Btw what is entr?

Unfortunately it's not working on JRuby probably not related to entr
Here's the stacktrace
uri:classloader:/jruby/kernel/kernel.rb:28: warning: unsupported exec option: close_others
IOError: closed stream
  gets at org/jruby/RubyIO.java:2202
uri:classloader:/jruby/kernel/kernel.rb:28: warning: unsupported exec option: close_others
JRuby doesn't support code reloading.
JRuby doesn't support code reloading.
/Users/serdardogruyol/.rvm/gems/jruby-head/gems/lotus-utils-0.4.3/lib/lotus/utils/path_prefix.rb:140: warning: private attribute?
/Users/serdardogruyol/.rvm/gems/jruby-head/gems/lotusrb-0.3.2/lib/lotus/loader.rb:34: warning: private attribute?
/Users/serdardogruyol/.rvm/gems/jruby-head/gems/lotusrb-0.3.2/lib/lotus/loader.rb:34: warning: private attribute?
RuntimeError: Cannot instantiate adapter of Lotus::Model::Adapters::SqlAdapter (LoadError: no such file to load -- pg)
                instantiate_adapter at /Users/serdardogruyol/.rvm/gems/jruby-head/gems/lotus-model-0.3.2/lib/lotus/model/config/adapter.rb:101
                              build at /Users/serdardogruyol/.rvm/gems/jruby-head/gems/lotus-model-0.3.2/lib/lotus/model/config/adapter.rb:81
                     _build_adapter at /Users/serdardogruyol/.rvm/gems/jruby-head/gems/lotus-model-0.3.2/lib/lotus/model/configuration.rb:168
                              load! at /Users/serdardogruyol/.rvm/gems/jruby-head/gems/lotus-model-0.3.2/lib/lotus/model/configuration.rb:59
                              load! at /Users/serdardogruyol/.rvm/gems/jruby-head/gems/lotus-model-0.3.2/lib/lotus/model.rb:87
                              <top> at /Users/serdardogruyol/playground/lotus-sample/lib/lotus-sample.rb:4
                            require at org/jruby/RubyKernel.java:941
                             (root) at uri:classloader:/jruby/kernel/kernel.rb:1
                              <top> at uri:classloader:/jruby/kernel/kernel.rb:24
                            require at org/jruby/RubyKernel.java:941
                    block in (root) at /Users/serdardogruyol/playground/lotus-sample/config/environment.rb:4
                      instance_eval at org/jruby/RubyBasicObject.java:1639
                             (root) at /Users/serdardogruyol/playground/lotus-sample/config.ru:1
                             <eval> at /Users/serdardogruyol/playground/lotus-sample/config.ru:1
                               eval at org/jruby/RubyKernel.java:980
                         initialize at /Users/serdardogruyol/.rvm/gems/jruby-head/gems/rack-1.6.1/lib/rack/builder.rb:55
                    new_from_string at /Users/serdardogruyol/playground/lotus-sample/config.ru:0
                    new_from_string at /Users/serdardogruyol/.rvm/gems/jruby-head/gems/rack-1.6.1/lib/rack/builder.rb:49
                         parse_file at /Users/serdardogruyol/.rvm/gems/jruby-head/gems/rack-1.6.1/lib/rack/builder.rb:40
  build_app_and_options_from_config at /Users/serdardogruyol/.rvm/gems/jruby-head/gems/rack-1.6.1/lib/rack/server.rb:299
                                app at /Users/serdardogruyol/.rvm/gems/jruby-head/gems/rack-1.6.1/lib/rack/server.rb:208
                        wrapped_app at /Users/serdardogruyol/.rvm/gems/jruby-head/gems/rack-1.6.1/lib/rack/server.rb:336
                              start at /Users/serdardogruyol/.rvm/gems/jruby-head/gems/rack-1.6.1/lib/rack/server.rb:272
                              start at /Users/serdardogruyol/.rvm/gems/jruby-head/gems/lotusrb-0.3.2/lib/lotus/commands/server.rb:47
                             server at /Users/serdardogruyol/.rvm/gems/jruby-head/gems/lotusrb-0.3.2/lib/lotus/cli.rb:32
                                run at /Users/serdardogruyol/.rvm/gems/jruby-head/gems/thor-0.19.1/lib/thor/command.rb:27
                     invoke_command at /Users/serdardogruyol/.rvm/gems/jruby-head/gems/thor-0.19.1/lib/thor/invocation.rb:126
                              <top> at /Users/serdardogruyol/.rvm/gems/jruby-head/gems/thor-0.19.1/lib/thor.rb:359
                               load at org/jruby/RubyKernel.java:959
                             <eval> at /Users/serdardogruyol/.rvm/gems/jruby-head/gems/thor-0.19.1/lib/thor/base.rb:440
                               eval at org/jruby/RubyKernel.java:980
                              <top> at /Users/serdardogruyol/.rvm/gems/jruby-head/bin/jruby_executable_hooks:15

@Sdogruyol http://entrproject.org/

@Sdogruyol ping

@joneslee85 pong

@Sdogruyol any update?

+1

Closing in favor of #307


embassy_net: should DNS resolve IP adresses without asking the DNS server?

I'm using an address like "<IP_ADDRESS>:8086" with reqwless.
This fails with a DNS error since neither reqwless or embassy recognizes this is an IP address and not a hostname.
I think ether reqwless or embassy should handle this case and immediately return an IP if the query is for an IP. Should embassy handle this case?
I'd add something like this to Stack::dns_query
match qtype {
    dns::DnsQueryType::A => {
        if let Ok(ip) = name.parse().map(IpAddress::Ipv4) {
            return Ok(iter::once(ip).collect());
        }
    }
    #[cfg(feature = "proto-ipv6")]
    dns::DnsQueryType::AAAA => {
        if let Ok(ip) = name.parse().map(IpAddress::Ipv6) {
            return Ok(iter::once(ip).collect());
        }
    }
    _ => {}
}

I think it makes sense 👍


Chef Knife task output empty lines to the logs

Output from PowerShell scripts run by the Chef Knife task get multiple empty lines with every line written to the logs in VSTS Releases. This happens on Agents using VSO v2.x and not on Agents using VSO v1.x
The Agent queue owners suspect that the task is handling character returns differently. They think that the Chef Knife Task is using VSO v1.x and suggest updating it to use VSO v2.x.
See sample from the logs with duplicate lines

Here is a sample from a normal PowerShell Task in the same release:

Thanks @goreish
As this is not a functionality bug or automation blocker - we will take it up with the next functionality update to the task


connector for DUNDAS BI Dashboard

Hello to all Amazing community of OMD,
a rich and sophisticated BI dashboard tool is Dundas https://www.dundas.com/ it is a good service for OMD.
i was wondering if OMD community will make it or not.
thanks a lot.

Hi @son-mostafa thank you for raising the issue. Will you be willing to contribute this connector to the community? We have a dedicated documentation page for building a connector on OpenMetadata.


Debugger step-over is unintuitive during WAI

When attempting to step during a WAI, the debugger only steps one cycle, instead of stepping until the WAI instruction ends.
Discovered while fixing https://github.com/commanderx16/x16-emulator/issues/392 and porting over as ec0ce83472136fec051e9de507410c7cde4574bd.

See also commanderx16/x16-emulator#393

Was improved way back when with the following commit: be07cfc30b8aa8f4fd29ac2b90e41a6bafd4ec67


[FOR DISCUSSION] Proposed new Code Style rules for DSpace "master" branch

DO NOT MERGE. This PR is for discussion purposes, and will only be merged once approved.
I'd like to propose the following new Java Code Style Rules for DSpace master branch (these rules will not be backported to any previous branches):

4-space indents for Java, and 2-space indents for XML. NO TABS ALLOWED. (Only exception is throws clause, which should be indented 8 spaces if on a new line)
K&R style braces required. Braces required on all blocks.
Do not use wildcard imports (e.g. import java.util.*). Duplicated or unused imports also not allowed.
Javadocs required for all public classes and methods. Keep it short and to the point
Maximum line length is 120 characters
No trailing spaces allowed (except in comments)
Tokens should be surrounded by whitespace (see http://checkstyle.sourceforge.net/config_whitespace.html#WhitespaceAround)
Each source file must include our license header (validated separately by license-maven-plugin, see pom.xml)

These rules are both listed and enforced in the checkstyle.xml configuration applied to this PR's branch.  More information on Checkstyle settings can be found at http://checkstyle.sourceforge.net/checks.html
This PR serves as public notification of this proposal, and I ask that all interested developers add your feedback into this PR (feel free to comment on individual line numbers in the checkstyle.xml file).  Please let us know if you have objections to any proposed rule, or propose tweaks or additions to the set of rules.  If you approve of these code style rules as-is, you are also welcome to 👍 this PR.
By default, the Checkstyle configuration is currently not executed (as the existing code has many violations to these new rules, see below).  However, you can test them locally by running:
# First, you may wish to ensure SNAPSHOT versions of JARs are installed in your local maven cache
mvn install
# Then, you can run this in any single module's (e.g. dspace-api) directory
mvn -U checkstyle:check

Currently, based on the rules proposed above, here's the counts of violations in each DSpace module:

dspace: 0 violations
dspace-api:  41,619 violations
dspace-oai: 775 violations
dspace-rdf: 72 violations
dspace-rest: 1,952 violations
dspace-services: 1,115 violations
dspace-solr: 26 violations
dspace-spring-rest: 7,482 violations
dspace-sword: 7,134 violations
dspace-swordv2: 1,640 violations

As the number of violations are significant, this work is being performed on a shared, public branch (code-style-rules). That way we can collaborate on fixing the violations.
More information on this effort (including other sample Checkstyle configs from other projects) can be found at: https://wiki.duraspace.org/pages/viewpage.action?pageId=90967266

It is fine for me. I have tested the eclipse plugin and it works (add notes to the wiki page).

👍  on these rules...it's a good opportunity to do this, and these particular ones have the advantage of being well-accepted and understood by other java developers out there.
A couple other non-controversial ones you might consider adding, while you're at it:

https://google.github.io/styleguide/javaguide.html#s6.1-override-annotation
https://google.github.io/styleguide/javaguide.html#s6.2-caught-exceptions

I'm more concerned that we have a common style at all, than that we change it.  In particular, I would be very wary of adding too many new rules at once.  Which qualities of code on the screen are most important?  Which contribute the most to readability and comprehension? why?
Left to myself, I tend to use Allman brace style (although I only just found that it has a name).  This is probably due to being a fossil from the PL/I era, when blocks opened with BEGIN and closed with END.  I'll have to train myself to rely more on NetBeans' block-level indicator.  Just grumbling....
The two things I have long wished we would enforce are tab/space discipline, and class and method documentation.  Sadly I don't think Checkstyle can help with documentation that doesn't actually tell one anything significant.  And then there's the issue of the well-known argument:  when a method takes a org.dspace.core.Context, we all know what it is but one must write something anyway.
One other thing that just occurred to me is that we ought to keep in mind a distinction between style rules and code-quality rules.  Styling is for human readers.  (Documentation rules are for human readers who are assisted by tooling that is sensitive to doc comments.)
Beyond the rules themselves, I think that we would do well to make it simple for contributors to adjust their several development environments to follow those rules, and especially make it simple to make adjustments when developing for DSpace separately from those for use with local code (which may be subject to different standards).  We'll need a clear human-readable articulation of The Rules.  We would greatly facilitate adoption of The Rules by providing comprehensive and maintained style sets for all of the IDEs we can support.  (I will help with NetBeans.)

@mwoodiupui : Quick note regarding IDE support.  We've begun drafting some notes on enabling Checkstyle rules in various IDEs here: https://wiki.duraspace.org/pages/viewpage.action?pageId=90967266#CodeStyleGuide(WIP)-IDESupport  I haven't yet tested NetBeans' Checkstyle import plugin, but would welcome enhancing the notes there.
The overall goal is to use IDE-specific Checkstyle plugins, which would mean we'd be able to simply maintain our checkstyle definition, and ask everyone to import it into their IDE of choice.  That should make IDE support a bit more seamless, assuming the IDE's Checkstyle plugin has no "gotchas".

I've now tried out the NetBeans plugin "Checkstyle Beans".
It partially integrates with the editor.  Rule violations cause the line to be underlined in pale yellow, and a "tag" icon appears in the left margin.  Hovering on the tag shows the rule's message.  Plugin and built-in annotations rotate as a single list when you click on the arrow icon that means "multiple annotations this line."
Unlike the built-in rule engine, no hints are offered to the editor to "just fix it".  Corrections are not noted until the file is saved.  Hovering on the underlined text itself does nothing, instead of showing the rule message(s).
So:  using IDE plugins with a common style file works for NetBeans, but will take some getting used to.

I'd like to see  at some point, but we have a lot of them.

I've made some minor enhancements to the rules, based on above comments. I only pulled in suggestions which seem minor / non-controversial, as I'd like to avoid larger code refactors in this first cut, and instead concentrate mostly on obvious wins.  Here's what I've added in https://github.com/DSpace/DSpace/pull/1895/commits/2fccaa4ba819ca433c94ae1ca164ecef73078297

An exception to the 120char max line length for packages, imports and URLs
Requirement that import statements be alphabetized and grouped.
switch statement checks. Must have a default clause, and no fall throughs allowed
Require that each line of code only include one statement
Require that catch clauses (in a try/catch) not be empty (must at least include a comment).

Further feedback is welcome. Again, though, I'd encourage us to limit the number of initial rules here to only those that are non-controversial, quick wins (with the primary goals being to standardize our code alignment and braces).  We can always follow up this initial code style with further enhancements.

Good work, thank you @tdonohue. 👍

+1 thanks Tim!

Closing as this was included in the newly rebased #1952.
So this exact code style has been merged to master via #1952.


[Question] Domain Entity Collection without private set

Hi Jason,
Good job setting up this repo, it contains really good guidelines.
I have a question related to the domain entity Order, inside it has a ICollection of OrderDetail which doesn't have a private set.
The other entities I look at it all have collections with private set, I think I remember from your video that the reasoning behind is to grantee that the collection is always initialized and dev are not confused if the collection was initialized before or not.

The reason was related to the Northwind Initializer, it was accessing the collection directly to seed the database. This has been fixed now. Thank you.


Add docstrings per #1715

Finally got around to this. Had to do code reading for some of this. Hopefully this will make LT more accessible and encourage us to document more :)
@kenny-evitt @rundis  Feedback welcome on anything that's unclear

@cldwalker This is great! Feel free to merge unless you want @rundis to review it first.

:clap: :clap: :beers: :smile:

Two eyes is plenty :)

:+1:
Nice work !


Support secret GitHub gists

On selecting a line in a gist, #filename-linenumber is appended to the url. Maybe the bot can show relevant line(s)?

This is supported already

Doing a bit of recon, I realised that public gists work as expected, but secret gists do not.
Is there any way this functionality can be made to work with secret gists, or does the API not support it?

It also works with secret gists?

Hmm, there's something weird going on here, it works with some gists and doesn't work with others ..

#9


Could not find financial-connections-20.5.0.jar

After I added the library @stripe/stripe-react-native,execute yarn android to throw this exception,Please how can I solve this problem
Execution failed for task ':stripe_stripe-react-native:compileDebugKotlin'.
> Could not resolve all files for configuration ':stripe_stripe-react-native:debugCompileClasspath'.
   > Failed to transform financial-connections-20.5.0.jar (com.stripe:financial-connections:20.5.0) to match attributes {artifactType=android-classes-jar, org.gradle.category=library, org.gradle.libraryelements=jar, org.gradle.status=release, org.gradle.usage=java-api}.
      > Could not find financial-connections-20.5.0.jar (com.stripe:financial-connections:20.5.0).
        Searched in the following locations:
            http://maven.aliyun.com/nexus/content/groups/public/com/stripe/financial-connections/20.5.0/financial-connections-20.5.0.jar

+1

@cnhuz Did you find the solution to this?

@cnhuz Did you find the solution to this?
Yes. But it took a long time, it should be modified repositories


Reconsider interface

While fixing #9 , it seems like the current approach of mutating the old state variables to the new one might not be the best approach.
If, inside FerriteAssembly, we could support handling of state variables that would probably be good since we dictate the structure anyways. Several reasons for doing this change:

The solution in #10 might be slow for large elements (but not tested, might also be good with large chunk size),
With old and new it doesn't matter if the assembly is done twice, no accumulation occurs
We avoid copying the states in each iteration for nonlinear problems, only one copy is required per time step.

The disadvantage is (1) that we get one extra input in the interface and (2) that we have to work with two parallel state vectors in the assembly loops. But these seem like minor issues.

One option could be
element_routine!(
    Ke::AbstractMatrix, re::AbstractVector, new_state,
    ae::AbstractVector, material, cellvalues, buffer)

where Δt is moved into buffer, in addition to a variable old_state. These can be queried as get_timestep(buffer) and get_old_state(buffer).
Info from dh_fh is also moved into buffer, such that we can call dof_range(buffer, ::Symbol) instead of  dof_range(dh_fh, ::Symbol)
Motivation would be that the following items should go in the function signature

Arguments being modified (Ke, re , new_state)
Arguments being differentiated wrt. (ae)
Arguments being dispatched (material)
Arguments always being used (cellvalues)

The remaining items stay in buffer with access functions.

Closed by #15


JedisClusterInfoCache why not use ConcurrentHashMap instead of lock

Expected behavior
Why not use ConcurrentHashMap instead of Lock. When concurrency is high, performance is down quickly.
Actual behavior
Why not use ConcurrentHashMap instead of Lock. When concurrency is high, performance is down quickly.
Steps to reproduce:
Please create a reproducible case of your problem. Make sure
that case repeats consistently and it's not random

no
no
no

Redis / Jedis Configuration
redis cluster
Jedis version: 2.6.0+
Redis version: 3.0.*+
Java version: jdk1.8

Because ConcurrentHashMap only locks for writing whether JedisClusterInfoCache needs to lock for both reading and writing depending on the operation.

We update bunch of elements on map rather than updating one. In that case thread-safe is not achieved only use of ConcurrentHashMap.
Please raise your opinion with valid analysis. If you have fix for that it would be great.
Closing this.


merging stdout/stderr cleanly

Note the difference between these 2 shell scripts:

this is what somebody familiar with pipes and sockets would expect:

script = "for s in $(seq 1 10); do echo stdout $s; echo stderr $s >&2; done"
cmd = ["sh", "-c", script]
Exile.stream!(cmd, stderr: :consume, ignore_epipe: true) |> Enum.to_list()

[
  stdout: "stdout 1\nstdout 2\nstdout 3\nstdout 4\nstdout 5\nstdout 6\n",
  stdout: "stdout 7\nstdout 8\nstdout 9\nstdout 10\n",
  stderr: "stderr 1\nstderr 2\nstderr 3\nstderr 4\nstderr 5\nstderr 6\nstderr 7\nstderr 8\nstderr 9\nstderr 10\n"
]

this is what a naive user would expect in output

script = "for s in $(seq 1 10); do echo stdout $s; echo stderr $s >&2; done 2>&1"
cmd = ["sh", "-c", script]
Exile.stream!(cmd, ignore_epipe: true) |> Enum.to_list() |> IO.puts()

stdout 1
stderr 1
stdout 2
stderr 2
stdout 3
stderr 3
stdout 4
stderr 4
stdout 5
stderr 5
stdout 6
stderr 6
stdout 7
stderr 7
stdout 8
stderr 8
stdout 9
stderr 9
stdout 10
stderr 10

Evidently this is all related to buffering inside the kernel, depending on how fast
the NIF handles data before the next read, and there may not be a lot to work
around this.
Is it possible to add a further stderr mode that handles the redirection already? stderr: :merge or similar, such that its not necessary to wrap a shell invocation around?
Or are there other options to handle this?

I will try to come up with a (short) explanation of the risks involved here, but yes if it is possible to use the same file descriptor/handle inside the NIF for this case, then at least text-based tools that alternate output between stderr/stdout can work as expected, without needing to wrap the shell.
For threaded, forked processes, or raw binary data this will obviously produce garbage, but this is also likely to be relatively obvious during even basic tests.

Yeah, that makes sense.
I added a basic support in dev branch. Just need pass stderr: :redirect_to_stdout option. I have to test few more things before merge. But If possible please try it out and share your feedback.
Thanks

this works very nicely, thanks. How is this for a sample explanation?
Using redirect_to_stdout
On many systems, stdout and stderr are separated, and between
the source programme, via the kernel, to Exile, are several places
that may buffer data, even temporarily, before Exile is ready
to read them. There is no enforced ordering of the readiness of
these independent buffers, for Exile to make use of.
This can result in unexpected behaviour, including:

mangled data, for example, UTF-8 characters may be incomplete
until an additional buffered segment is released on the same
source
raw data, where binary data sent on one source, is incompatible
with data sent on the other source
interleaved data, where what appears to be synchronous, is not

Most well-behaved command-line programmes are unlikely to exhibit
this, but you need to be aware of the risk.
A good example is streaming JSON from an external tool to Exile,
where normal JSON output is expected on stdout, and errors
or warnings via stderr. In the case of an unexpected error,
the stdout stream could be incomplete, or the stderr message
might arrive before the closing data on the stdout stream.

Hey @dch, that's much better than I could have come up with!
Thanks for checking the changes and explanation 👍🏼


[feat][broker] Update AuthenticationProvider to simplify HTTP Authn

PIP: https://github.com/apache/pulsar/issues/12105
Motivation
This is the first of several PRs to implement PIP 97.
This PR seeks to start to solve the fact that the AuthenticationState class currently authenticates authData twice instead of just once. This change is important to make before we are able to utilize the async methods introduced in https://github.com/apache/pulsar/pull/12104.
Historical context: https://github.com/apache/pulsar/pull/14044 introduced the AuthenticationProvider#newHttpAuthState  method. The only use case for this method in the pulsar code base is to let custom providers specify the AuthenticationDataSource on http request attributes. The primary problem with that implementation is that the AuthenticationState class currently involves authenticating the authData passed in to the newHttpAuthState. As such, this code is sub-optimal, and creates a confusing flow.
I propose we deprecate the newHttpAuthState method and instead start using the authenticateHttpRequestAsync and authenticateHttpRequest methods to allow custom implementations to configure the desired AuthenticationDataSource on the request attributes.
In order to simplify the diff for reviewers, this PR uses the deprecated AuthenticationProvider#authenticateHttpRequest method. I plan to follow up and switch to use the AuthenticationProvider#authenticateHttpRequestAsync method.
Note that these changes are completely backwards compatible. The only risk is to users that have custom code loaded into the broker that calls the AuthenticationProvider#authenticateHttpRequest method.
Modifications

Deprecate AuthenticationService#authenticateHttpRequest(HttpServletRequest request, AuthenticationDataSource authData). It is no longer used.
Deprecate AuthenticationProvider#newHttpAuthState(HttpServletRequest request). It is no longer used outside of the AuthenticationProvider interface itself.
Remove @InterfaceStability.Unstable annotation from the authenticateHttpRequestAsync method. When I introduced that annotation, I was under the impression that we didn't need it. However, in order to meet the requirements introduced in #14044, we need to let custom AuthenticationProviders add their own attributes.
Update the default implementation of authenticateHttpRequest. Because the previous implementation was unreachable by all auth providers except for the SASL implementation, this is a backwards compatible change.
Implement changes for the AuthenticationProviderToken so that it no longer relies on newHttpAuthState.

Verifying this change
I added new tests.
Does this pull request potentially affect one of the following parts:

[x] The public API

This changes the public API within the broker by marking some methods as @Deprecated.
Documentation

[x] doc-not-needed

We document the AuthenticationProvider interface in the code. I added these docs. There is currently no where else to update docs.
Matching PR in forked repository
PR in forked repository: https://github.com/michaeljmarshall/pulsar/pull/12

Codecov Report

Merging #19197 (8786d14) into master (334c3a5) will increase coverage by 0.18%.
The diff coverage is 21.99%.

@@             Coverage Diff              @@
##             master   #19197      +/-   ##
============================================
+ Coverage     47.04%   47.22%   +0.18%
- Complexity     9190    18840    +9650
============================================
  Files           607     1625    +1018
  Lines         57677   132324   +74647
  Branches       6007    14567    +8560
============================================
+ Hits          27132    62491   +35359
- Misses        27598    63528   +35930
- Partials       2947     6305    +3358

Flag
Coverage Δ

unittests
47.22% <21.99%> (+0.18%)
:arrow_up:

Flags with carried forward coverage won't be shown. Click here to find out more.


Can't find a way to add legend to stacked bar chart

Hello.
First of all thank you for your great plugin. It is totally helpful.
I'm using the stacked bar chart.
I'm  looking for a way to add a legend next to each part of a stacked bar chart so that the users are able to visually identify what each (colored) part of the stacked bar chart represents.
Thanks again.

Hi @osymo 👋
Thanks for pointing out the issue.
Currently, we don't have in-built legend components for any chart in the library. However, it's quite easy to make your own custom legend component.
I have shared an example of custom legend here
If you wanted something different, please do let me know. I will work on it.
Hope it helps🤗


Could not install under node 0.12 + ubuntu

Has anyone else tried this yet? Let me know and I can provide any other info required like install logs
Thanks

It installs successfully, but fails to load.
This was in builderror.log:
../cpu_profiler.cc:15:13: error: ‘v8::ThrowException’ has not been declared
   using v8::ThrowException;
             ^
../cpu_profiler.cc: In static member function ‘static void nodex::CpuProfiler::GetProfilesCount(const v8::FunctionCallbackInfo<v8::Value>&)’:
../cpu_profiler.cc:33:58: error: ‘class v8::CpuProfiler’ has no member named ‘GetProfileCount’
     args.GetReturnValue().Set(isolate->GetCpuProfiler()->GetProfileCount());
                                                          ^
../cpu_profiler.cc: In static member function ‘static void nodex::CpuProfiler::GetProfile(const v8::FunctionCallbackInfo<v8::Value>&)’:
../cpu_profiler.cc:40:39: error: ‘New’ is not a member of ‘v8::String’
       ThrowException(Exception::Error(String::New("No index specified")));
                                       ^
../cpu_profiler.cc:40:73: error: ‘ThrowException’ was not declared in this scope
       ThrowException(Exception::Error(String::New("No index specified")));
                                                                         ^
../cpu_profiler.cc:43:43: error: ‘New’ is not a member of ‘v8::String’
       ThrowException(Exception::TypeError(String::New("Argument must be an integer")));
                                           ^
../cpu_profiler.cc:43:86: error: ‘ThrowException’ was not declared in this scope
       ThrowException(Exception::TypeError(String::New("Argument must be an integer")));
                                                                                ^
../cpu_profiler.cc:47:60: error: ‘class v8::CpuProfiler’ has no member named ‘GetCpuProfile’
     const CpuProfile* profile = isolate->GetCpuProfiler()->GetCpuProfile(index);
                                                            ^
../cpu_profiler.cc: In static member function ‘static void nodex::CpuProfiler::DeleteAllProfiles(const v8::FunctionCallbackInfo<v8::Value>&)’:
../cpu_profiler.cc:74:32: error: ‘class v8::CpuProfiler’ has no member named ‘DeleteAllCpuProfiles’
     isolate->GetCpuProfiler()->DeleteAllCpuProfiles();
                                ^
make: *** [Release/obj.target/profiler/cpu_profiler.o] Error 1

Have you found any profiling tools that work in node 0.12? I last looked a month or two ago and couldn't find any that seemed stable. If I remember, the only one that worked read in a v8.log that was generated by passing the --prof option to node, but it had a buggy gui.

Yeah, incompatibilities with 0.12 is a pain. @hhamilto https://github.com/thlorenz/v8-perf might be a good resource to get started.


Format Code Blocks

Hey @deadcoder0904 I just noticed this PR, sorry for missing your changes! Will take a look at this tonight and get it merged. Really appreciate the PR, cheers!

It doesn't change anything 😂
I thought bash code would be syntax highlighted but Github doesn't recognise it. So feel free to close it.

Ah yeah bash just appears as normal shell. Yeah since this doesn't make any changes I'll go ahead and close it. Feel free to contribute in the future and I'll be more prompt 😉


Suggestion

Hey,
it would be nice when you can add 2 Features.

player cann teleport to plot without write the complete name and with strtolower
Example:
PlayerName: SuPeRcRaFtEr333
Command: /p h super 1 or 2 ......

2.player can Teleport to OfflinePlayer Plot
OfflinePlayerName: Supercrafter333
Command: /p h super 1 or 2 ......
Thx man

Thank's for your suggestions.
I'll try to implement that in the coming versions of PlotHomes.

THX :)

I can't implement this suggestion because MyPlot isn't saving player datas as lower strings.


Fix table tokenizer for node help markdown renderer

[x] Bugfix (non-breaking change which fixes an issue)

We added the ability to format node help using markdown in #3169
Shortly later, we updated to the latest marked release. This was a major version change and despite testing the basic markdown rendering, we didn't have an explicit test for the new message property table parsing... which promptly broke
We give with one PR, we take with another.
This PR updates the token parsing to the new API.
I have also updated the Node Help Style guide to include Markdown examples alongside the HTML examples
https://nodered.org/docs/creating-nodes/help-style-guide
fyi @Steve-Mcl

Coverage remained the same at 68.269% when pulling 155e1be494f8f864e207a1142ea719fa68d95620 on fix-md-help into cf5e125cb367a1863fa7fb502740061448f45cc3 on dev.


[SPARK-6602][Core] Update MapOutputTrackerMasterActor to MapOutputTrackerMasterEndpoint

This is the second PR for [SPARK-6602]. It updated MapOutputTrackerMasterActor and its unit tests.
cc @rxin

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/29730/
Test PASSed.

Test build #29736 has started for   PR 5371 at commit 93c6c20.

LGTM.

Test build #29737 has started for   PR 5371 at commit 4013a22.

Test build #29737 has finished for   PR 5371 at commit 4013a22.

This patch fails Scala style tests.
This patch merges cleanly.
This patch adds no public classes.
This patch does not change any dependencies.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/29737/
Test FAILed.

Test build #29738 has started for   PR 5371 at commit fcf3816.

Test build #29736 has finished for   PR 5371 at commit 93c6c20.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.
This patch does not change any dependencies.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/29736/
Test PASSed.

Test build #29738 has finished for   PR 5371 at commit fcf3816.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.
This patch does not change any dependencies.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/29738/
Test PASSed.

Merging in master. Thanks.


fix: update.ts fails when there is no islands directory

Fix #1326
Fixed to ignore the error if the directory did not exist, referring to the change diff in #1185.

I added a test to see if the command can be executed.
Does it look ok like this...?


PowerRename - Have option to replace using "date-taken" instead of "date-created"

Description of the new feature / enhancement
It would be nice to have the option to replace using "date-taken" and not just "date-created".
Scenario when this would be used?
This would be used when renaming photos. I have nearly a thousand photos where I want to include the date the photo was taken in the file name.
Supporting information
No response

Tracked via https://github.com/microsoft/PowerToys/issues/5612


Add a way to list all requirable languages

Hi tinganho,
I use l10ns for a mobile app translated in five languages.
I have to find the available language closest to the one of the phone.
For now, I just compare the two first letters, falling back to en-US by default.
In order to do so, I would find very useful if we had a way to list all supported languages (the five ones for my case). I proposed this #144 to do that, and here is the issue you requested.
You should notice that I put the function listLanguages beside requireLocalizations which give us a getter, not a localized string.
On an API design side, I am not completely satisfied, but it could open the way to more utilitaries functions. If I had a configuration file to parse that would contains the available languages, I would not need this feature.

Still this is more suitable for an external library. It shouldn't be part of L10ns. I think there should be  some library that does some language acceptance for your platform right now.

Ok, there is something I probably missed, so let me summarize:
I have my codebase using the getter l('SOME_KEY').
Then I perform l10ns update to add all new keys.
With l10ns set ref -l lang value, I match value with the key for the given lang.
Finally, l10ns compile create all.js (and all lang.js).
All these operations are performed by multiple team members at different time and the result is stored on a git repository. This result is evolving all the time, so I have to decide at execution what is the best option on a given context (the phone language in that case).
The information I need is store on two locations:

In the name of all lang.js files
In the code of all.js

So I only see two options to do what I want:

List all the lang.js files (unfeasible on browser)
Add a function in all.js aware of the l10ns configuration

Maybe a third possibility where I get all.js in a string format and parse it, but this seems to be a little bit painful.
I don't really understand how an external library could help me on this.

The way I do it is to duplicate all languages I have written in l10ns.json on to some source files. Though it requires duplicate work.
It might make sense to compile it directly on the output file. I think I need some time to reflect on this first.


bug(MatCheckbox): Checkbox not disabled when form is disabled.

Reproduction
https://stackblitz.com/edit/components-issue-g38766?file=src%2Fapp%2Fexample-com
Steps to reproduce:

Create a form with a checkbox. Have it enabled in your form definition.
Disable form in ngOnInit. All fields become disabled and the disabled() method on the checkbox form element is true, but the checkbox behaves like it's still enabled.

Expected Behavior
What behavior were you expecting to see?
Checkbox should be disabled like the rest of the fields.
Actual Behavior
What behavior did you actually see?
Checkbox stays enabled.
Environment

Angular: 9
CDK/Material: 9
Browser(s): Chrome
Operating System (e.g. Windows, macOS, Ubuntu): Windows, macOS

You have a typo in your template. It's supposed to be formControlName, not formGroupName.


No audio in Safari

Didn't see this previously reported.  I have a bunch of p5 sound projects that are currently working in Chrome (thanks to the userStartAudio workaround), but do not work in Safari (no audio).
Chrome: Version 76.0.3809.132 (Official Build) (64-bit)
Safari: Version 12.1.2 (14607.3.9)
Here are some of my projects which currently work in Chrome but not Safari:
http://www.seijinair.com/waves.html
http://www.seijinair.com/jazz.html
http://www.seijinair.com/musicbox.html
Is it related to this?  https://www.ibm.com/developerworks/library/wa-ioshtml5/

I also found this problem.Have you solved it?

I'm also having this problem. I added a one line polyfill that fixed some errors but not all:
window.navigator.getUserMedia = (...args) => window.navigator.mediaDevices.getUserMedia(...args);

Its just a hypothesis, but could it be because p5 is using the promise-based form of the getUserMedia function?
    window.navigator.mediaDevices.getUserMedia( constraints )
      .then( function(stream) {
        self.stream = stream;
        self.enabled = true;
        // Wrap a MediaStreamSourceNode around the live input
        self.mediaStream = p5sound.audiocontext.createMediaStreamSource(stream);
        self.mediaStream.connect(self.output);
        // only send to the Amplitude reader, so we can see it but not hear it.
        self.amplitude.setInput(self.output);
        if (successCallback) successCallback();
      })
      .catch( function(err) {
        if (errorCallback) errorCallback(err);
        else console.error(err);
      });
  };

https://github.com/processing/p5.js-sound/blob/master/src/audioin.js

This polyfill promises to fix it
https://github.com/mozdevs/mediaDevices-getUserMedia-polyfill

What finally fixed it was updating to the newest version of p5sound

Thanks for this update, didn't realize the issue had been addressed!
Updated my p5sound and sound is working now.
On Fri, Nov 22, 2019 at 7:55 AM Joel<EMAIL_ADDRESS>wrote:

What finally fixed it was updating to the newest version of p5sound
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/processing/p5.js-sound/issues/383?email_source=notifications&email_token=AE5J63HU3M5NHHUWCTEDD4DQU76ILA5CNFSM4IY5GPP2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEE6BX7Y#issuecomment-557587455,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AE5J63BY6EL7VJZYLEC62UTQU76ILANCNFSM4IY5GPPQ
.

since the issue has addressed and it's working now, i will close this issue.


Dimension incompatability when using EoT rotation

Describe the bug
When generating 1000 adversarial samples with PGD and EoT, Python returns a ValueError.
To Reproduce
Steps to reproduce the behavior:

Choose 1000 images from the CIFAR10 dataset.
Initialize an instance of EoTImageRotationTensorflow with nb_samples=10.
Train a simple CNN (TensorFlowV2Classifier) with prepocessing_defence = [eot_rotation] on the whole CIFAR10 dataset.
Initialize an instance of ProjectedGradientDescentTensorFlowV2 with 100 iterations and eps = 8.0 / 255.0 and eps_step = 2.0 / 255.0
Generate 1000 adversarial samples.
Error message:
ValueError: Dimensions 1000 and 10000 are not compatible

Expected behavior
Successfully generate 1000 adversarial samples with ProjectedGradientDescentTensorFlowV2 and EoTImageRotationTensorflow
System information (please complete the following information):

Windows 10
Python 3.7
ART 1.7.1
TensorFlow 2.4.2

An example file for reproducing the error is attached.
test.txt

Hi @McLovin90 Thank you very much for using ART and reporting this issue! We will test your example script and fix the bug as soon as possible.

Hi @McLovin90 Yes, instead of true labels (for untargeted attacks) you also can provide any other label (for targeted attacks) but you will have to set the argument targeted=True.

Thanks for your answer and your help. I think we can close this issue.


Handle EvaluatorFailure before master setup

When the YARN evaluator has been failed because of misconfiguration or other possible reasons, we need to handle these failures to help debug the yarn errors.

We have observed that MIST does not FAIL but instead becomes a COMPLETED task when we handle evaluator failures with handlers. This could be confusing, so we decided not to handle this case, but let MIST fail instead. In this case, debugging MIST is still possible via RM logs.


Missing parent: GO:0035694   mitochondrial protein catabolic process

not sure about this one:

GO term ID and label for which you request a new superclass

GO:0035694   mitochondrial protein catabolic process
The chemical reactions and pathways resulting in the breakdown of a mitochondrial protein. This process is necessary to maintain the healthy state of mitochondria and is thought to occur via the induction of an intramitochondrial lysosome-like organelle that acts to eliminate the damaged oxidised mitochondrial proteins without destroying the mitochondrial structure. PMID:21264221 PMID:21264228

New superclass (parent) suggested

GO:0006515   protein quality control for misfolded or incompletely synthesized proteins

Reference(s), if appropriate

based on the definition of  GO:0035694   mitochondrial protein catabolic process

It doesn't seem like this is how it's always been used, see for eg
https://amigo.geneontology.org/amigo/reference/PMID:21264221
"MALM is involved in the degradation of oxidized mitochondrial proteins, leading to increased ATP synthesis and decreased reactive oxygen species generation."
So, this is not misfolded or incompletely synthesized, but damaged.

OK, good point!

Thats what the def says too!

sorry, I agreed, forgot to close


Fixing executor and flow control issues in subscriber

The current subscriber logic has a few concurrency issues explained as follows:

The flow controller blocks the user's executor threads; so in the event of all the threads getting blocked because of flow control limits, the subscriber won't be able to dispatch messages to the user code hence unable to release flow control permits and to make forward progress; a deadlock. This change makes the flow control non-blocking and instead regulates the flow of messages by either suspending the streaming or not issuing more pulls but until permits are released from flow controller
Lease extensions are handled under the user's executor, in the event of the user code monopolizing all the threads in the executor, the subscriber won't be able to execute any lease extension which will make the leases to expire and increase the chances of message redelivery; if there is a time when it is more important to maintain lease extensions is when the user code is busy working on the messages. This code change sets up a separate small (two threads) shared-across-subscribers executor for taking care of lease extensions, under my load tests (with >600 hundred subscriber objects) this executor performed well not showing signs of work backup, this is mainly because the work of scheduling and sending lease extensions is fairly cheap.
Flow control permits were being drawn on a per batch basis while the messages were dispatch one at a time, this could cause a deadlock if ever receiving a batch larger than the limit of message in the flow controller. This change makes the code reserve flow control permits on a per messages basis as they are dispatched to the user code.

Lastly, I have also address a minor issues which is the inability of choosing the number of messages to pull per pull request, now such number is taken from the flow controller settings.
This change fixes #1868, fixes #1865 and fixes #1855

@pongad @garrettjonesgoogle all yours to review thanks

I will have @pongad review it first.

Looks like there is some fallout from the merge that is causing the build to fail

LGTM

Coverage decreased (-0.01%) to 80.886% when pulling f71628089dc4cca28789b91beeb2ad90b555d418 on davidtorres:master into a722e95c5c137257d9d20131d6e01f23cb0aadc6 on GoogleCloudPlatform:master.


Alter repo to be used in production environments

[x] Remove DEBUG mode
[x] Check how to resolve secret for other users on other machines
[x] possibly other stuff...

Done in 3d643bcaa16ff57c810e36975967e06343e88d3e


Optional restart of dnsmasq

Since this is probably often used with dnsmasq, it could have an optional restart of dnsmasq on hostfile changes, defaulting to false.

See #4

Resolved by #4


Canceled attribute not true for canceled connections

The problem
The ongoing strike today is a good chance to test the "canceled" attribute.
Steps to reproduce:

Add a connection, in this example Frankfurt(M)Flughafen to Köln, direct connection. Check the DB website and compare to the integration's attributes

Expected result:

Trains shown as canceled on the DB website should be shown as canceled in the integration.

Actual result:

Canceled: false

What version of Home Assistant Core has the issue?
2023.11.2
What version of DeutscheBahn Integration has the issue?
bbd7bcd
What type of installation are you running?
Home Assistant OS
Example YAML snippet
No response
Anything in the logs that might be useful for us?
No response
Additional information
No response

I had many chances throughout the last days (including today, even now) to test this and wanted to create an issue for the very same problem.
Integration says everything is fine (even on time, no delay). Actually not a single train is driving. "SEV" by bus is the alternative following the DB app / website.
As I just started to actually use this integration productively, this first impression does not calculate a very reliable picture unfortunately.

Where does the data come from? Why the difference to the DB data (website / app)?
Idea to improve the entity status in regards to this:

current implementation: on time = hh:mm, delayed = hh:mm +X
proposed addition when train is cancelled: (!) hh:mm (!) (or a similar indicator the train is cancelled)

Hi, thanks for the issue. Unfortunatly I dont think it's a issue with the integration. Most likely its a issue with the dependency where this integration is based on:
https://github.com/kennell/schiene
The schiene module graps the informations from the bahn.de website. More details can be found above.
The better solution is fetching the data via hafas api, but until now it has not been merged to Homeassistant:
https://github.com/home-assistant/core/pull/78839

So what can we do NOW about this?

wait for the hafas being integrated into core?
raise an issue in the schiene repo?

Unfortunatly at homeassistant noone has showed support to the hafas homeassistant integration developer, therefore no new work has been done since some months on the pull request.
You can give the custom integration a try here: https://github.com/akloeckner/hacs-hafas
Otherwise you can raise a ticket at schiene repo, but the developer there is not actively working anymore on schiene and I dont think that he will work on it.

For now I have no better options for you. The best to try is the custom integration from above.
Please note that me and all the other developers mentioned here are doing it as a hobby within our free time. The current way is more a "hacky" way to grab the data from the bahn.de website, since DB does not offer any API connection. The HAFAS way is a real API (which is not meant for personal use, but does work).

Hi, I tried the custom integration you mentioned above. To me it seems that the same "mistake" exists since the GDL is on its "usual" strike today ;-). Also with that  integration I receive cancelled = false even on the bahn.de Site the connection is cancelled. Pretty sad that it also doesn't work properly. :-(

Unfortunatly I dont think that we can do there anything on our end, since the API from the train sites then is providing it wrongly 👎🏼

Today:
Integration: punctual
DB app/actual reality:

Doesn't add anything to this issue - but reminded me once again I simply can't rely on the integration's data. Therefore unfortunately useless most of the time. Very sad to say.


Consecutive tests fail with Capybara::Webkit::CrashError: Broken pipe

I'm using capybara-webkit with qt5 and jruby-<IP_ADDRESS>, and I'm trying to get my tests to run consecutively, rather than in parallel. Unfortunately, it looks like webkit crashes after the first test that's run, and none of the issues so far have resembled my problem. Upgrading Qt to 5 didn't resolve the issue, and the error message+debug output isn't offering any insight on what's happening.
My setup:
Capybara: 2.4.4
capybara-webkit: 1.11.1
Qt: 5.3.2
WebKit: 538.1
QtWebKit: 5.3.2

Here's an example output of the tests:
Received "FindXpath(/html/body/*)"
Started "FindXpath(/html/body/*)"
Finished "FindXpath(/html/body/*)" with response "Success()"
Wrote response true ""
      shows number of people that are out of office
    when no one is out of office
Finished "EnableLogging()" with response "Success()"
Wrote response true ""
Received "SetTimeout(-1)"
Started "SetTimeout(-1)"
Finished "SetTimeout(-1)" with response "Success()"
Wrote response true ""
Received "AllowUrl(http://www.google.com/jsapi)"
Started "AllowUrl(http://www.google.com/jsapi)"
Finished "AllowUrl(http://www.google.com/jsapi)" with response "Success()"
Wrote response true ""
Received "AllowUrl(www.google-analytics.com)"
Started "AllowUrl(www.google-analytics.com)"
Finished "AllowUrl(www.google-analytics.com)" with response "Success()"
Wrote response true ""
Received "FindXpath(/html/body/*)"
Started "FindXpath(/html/body/*)"
Finished "FindXpath(/html/body/*)" with response "Success()"
Wrote response true ""
      gang-all-here tile preview (FAILED - 1)
  tile actions
    when member
Finished "EnableLogging()" with response "Success()"
Wrote response true ""
Received "SetTimeout(-1)"
Started "SetTimeout(-1)"
Finished "SetTimeout(-1)" with response "Success()"
Wrote response true ""
Received "AllowUrl(http://www.google.com/jsapi)"
Started "AllowUrl(http://www.google.com/jsapi)"
Finished "AllowUrl(http://www.google.com/jsapi)" with response "Success()"
Wrote response true ""
Received "AllowUrl(www.google-analytics.com)"
Started "AllowUrl(www.google-analytics.com)"
Finished "AllowUrl(www.google-analytics.com)" with response "Success()"
Wrote response true ""
Received "FindXpath(/html/body/*)"
Started "FindXpath(/html/body/*)"
Finished "FindXpath(/html/body/*)" with response "Success()"
Wrote response true ""
      adding OOO entry (FAILED - 2)
      existing OOO entry
Finished "EnableLogging()" with response "Success()"
Wrote response true ""
Received "SetTimeout(-1)"
Started "SetTimeout(-1)"
Finished "SetTimeout(-1)" with response "Success()"
Wrote response true ""
Received "AllowUrl(http://www.google.com/jsapi)"
Started "AllowUrl(http://www.google.com/jsapi)"
Finished "AllowUrl(http://www.google.com/jsapi)" with response "Success()"
Wrote response true ""
Received "AllowUrl(www.google-analytics.com)"
Started "AllowUrl(www.google-analytics.com)"
Finished "AllowUrl(www.google-analytics.com)" with response "Success()"
Wrote response true ""
Received "FindXpath(/html/body/*)"
Started "FindXpath(/html/body/*)"
Finished "FindXpath(/html/body/*)" with response "Success()"
Wrote response true ""
        editing (FAILED - 3)
Finished "EnableLogging()" with response "Success()"
Wrote response true ""
Received "SetTimeout(-1)"
Started "SetTimeout(-1)"
Finished "SetTimeout(-1)" with response "Success()"
Wrote response true ""
Received "AllowUrl(http://www.google.com/jsapi)"
Started "AllowUrl(http://www.google.com/jsapi)"
Finished "AllowUrl(http://www.google.com/jsapi)" with response "Success()"
Wrote response true ""
Received "AllowUrl(www.google-analytics.com)"
Started "AllowUrl(www.google-analytics.com)"
Finished "AllowUrl(www.google-analytics.com)" with response "Success()"
Wrote response true ""
Received "FindXpath(/html/body/*)"
Started "FindXpath(/html/body/*)"
Finished "FindXpath(/html/body/*)" with response "Success()"
Wrote response true ""
        deleting (FAILED - 4)
      other stuff
        prev-next buttons (PENDING: Temporarily disabled with xscenario)
Finished "EnableLogging()" with response "Success()"
Wrote response true ""
Received "SetTimeout(-1)"
Started "SetTimeout(-1)"
Finished "SetTimeout(-1)" with response "Success()"
Wrote response true ""
Received "AllowUrl(http://www.google.com/jsapi)"
Started "AllowUrl(http://www.google.com/jsapi)"
Finished "AllowUrl(http://www.google.com/jsapi)" with response "Success()"
Wrote response true ""
Received "AllowUrl(www.google-analytics.com)"
Started "AllowUrl(www.google-analytics.com)"
Finished "AllowUrl(www.google-analytics.com)" with response "Success()"
Wrote response true ""
Received "FindXpath(/html/body/*)"
Started "FindXpath(/html/body/*)"
Finished "FindXpath(/html/body/*)" with response "Success()"
Wrote response true ""
        changing months (FAILED - 5)

<snip>

Failures:

  1) Out of office dashboard preview when no one is out of office gang-all-here tile preview
     Failure/Error: visit new_session_path
     Capybara::Webkit::CrashError:
       The webkit_server process crashed!

         Broken pipe - No message available

       This is a bug in capybara-webkit. For help with this crash, please visit:

       https://github.com/thoughtbot/capybara-webkit/wiki/Reporting-Crashes
     # /usr/local/bundle/gems/capybara-webkit-1.11.1/lib/capybara/webkit/browser.rb:218:in `command'
     # /usr/local/bundle/gems/capybara-webkit-1.11.1/lib/capybara/webkit/browser.rb:19:in `visit'
     # /usr/local/bundle/gems/capybara-webkit-1.11.1/lib/capybara/webkit/driver.rb:50:in `visit'
     # /usr/local/bundle/gems/capybara-2.4.4/lib/capybara/session.rb:227:in `visit'
     # /usr/local/bundle/gems/capybara-2.4.4/lib/capybara/dsl.rb:51:in `block in DSL'
     # ./spec/features/out_of_office_spec.rb:16:in `block in (root)'
     # ./spec/support/headless.rb:4:in `block in (root)'
     # /usr/local/bundle/gems/headless-2.3.1/lib/headless.rb:143:in `run'
     # ./spec/support/headless.rb:3:in `block in (root)'

  2) Out of office tile actions when member adding OOO entry
     Failure/Error: visit new_session_path
     Capybara::Webkit::CrashError:
       The webkit_server process crashed!

         Broken pipe - No message available

       This is a bug in capybara-webkit. For help with this crash, please visit:

       https://github.com/thoughtbot/capybara-webkit/wiki/Reporting-Crashes
     # /usr/local/bundle/gems/capybara-webkit-1.11.1/lib/capybara/webkit/browser.rb:218:in `command'
     # /usr/local/bundle/gems/capybara-webkit-1.11.1/lib/capybara/webkit/browser.rb:19:in `visit'
     # /usr/local/bundle/gems/capybara-webkit-1.11.1/lib/capybara/webkit/driver.rb:50:in `visit'
     # /usr/local/bundle/gems/capybara-2.4.4/lib/capybara/session.rb:227:in `visit'
     # /usr/local/bundle/gems/capybara-2.4.4/lib/capybara/dsl.rb:51:in `block in DSL'
     # ./spec/features/out_of_office_spec.rb:16:in `block in (root)'
     # ./spec/support/headless.rb:4:in `block in (root)'
     # /usr/local/bundle/gems/headless-2.3.1/lib/headless.rb:143:in `run'
     # ./spec/support/headless.rb:3:in `block in (root)'

<repeat exception for every other failing test>

Finished in 16.24 seconds (files took 16.16 seconds to load)
10 examples, 5 failures, 4 pending

I was hoping to figure out why this was happening based on the stack trace, but I'm not sure I have the chops to figure that out. Any idea why this might be happening?
Let me know if you need more information about my platform or anything.

Does it pass without crashing if you run only one spec? Does it matter which spec you run? If it works once and then crashes no matter what, it seems likely that it's crashing somewhere when trying to reset the driver. This is one of the trickier parts of the driver, because everything is asynchronous and needs to be synced up and then deallocated.
One thing that's suspicious is that I don't see any Reset commands in your log. Usually, a reset command is sent after each spec. This should happen just before the options are reset, so it should be before Finished command EnableLogging.
Are you able to share anything from your RSpec setup, like your spec_helper.rb or rails_helper.rb? Anything related to database setup (DatabaseCleaner, etc) might be helpful as well.

Here's our spec_helper:

Running a single spec works fine, and the spec that's run doesn't seem to matter.
Here's our spec_helper:
require 'simplecov'
SimpleCov.start

require 'capybara/rspec'
require 'capybara-webkit'
require 'rack_session_access/capybara'

Capybara.javascript_driver = :webkit_debug

Capybara::Webkit.configure do |config|
  config.allow_url("http://www.google.com/jsapi")
  config.allow_url("www.google-analytics.com")
end

RSpec.configure do |config|

  config.expect_with :rspec do |expectations|
    expectations.include_chain_clauses_in_custom_matcher_descriptions = true
  end

  config.mock_with :rspec do |mocks|
    mocks.verify_partial_doubles = true
  end

  config.run_all_when_everything_filtered = true
  config.filter_run_excluding :type => :request

  config.disable_monkey_patching!
  if config.files_to_run.one?
    config.default_formatter = 'doc'
  end
  config.order = :random
 Kernel.srand config.seed
end

and our rails_helper:
ENV['RAILS_ENV'] ||= 'test'
require 'spec_helper'
require File.expand_path('../../config/environment', __FILE__)
require 'rspec/rails'

Dir[Rails.root.join('spec/support/**/*.rb')].each { |f| require f }

RSpec.configure do |config|
  config.use_transactional_fixtures = false
  config.infer_spec_type_from_file_location!

  config.include Capybara::DSL
end

You don't appear to be requiring capybara/rspec anywhere - so you don't have the session being reset between each test - https://github.com/jnicklas/capybara/blob/master/lib/capybara/rspec.rb#L19  . That's why you're not seeing reset commands between each spec, not sure if that's whats causing the crashes though.

It's on line 4 of spec_helper:
require 'simplecov'
SimpleCov.start

require 'capybara/rspec'
require 'capybara-webkit'
require 'rack_session_access/capybara'
<etc>

Should it be required elsewhere as well?

@rpazyaquian Sorry I noticed it as soon as I had posted (not sure how I missed it before) - I immediately thereafter deleted my comment

No problem!

@rpazyaquian Have you tried updating Capybara ?  capybara-webkit supports up to 2.7.1  - the versions you're using (2.4.4) is pretty old.

I upgraded to Capybara 2.7.1, but it looks like consecutive specs are still failing with the same message. :( Still not seeing any Reset()s after finishing the first spec...although, I did run into an ArrayOutOfBoundsException related to JRuby threading or whatever. Could that be a clue?

No idea about the ArrayOutOfBoundsException, or why you're not having resets occur -- do you have any other RSpec after hooks?

Not that I know of.
Let me speak a little more of our setup. We're running in a Vagrant-Docker setup, using JRuby and docker-compose. I don't know if that environment could possibly cause any issues, but it's more information that may help. We're currently using JRuby <IP_ADDRESS>, and I don't know if that would affect anything.
What code determines whether a Reset() should occur? We do have this line in rails_helper, and I'm wondering if it's possibly causing this:
  # If you're not using ActiveRecord, or you'd prefer not to run each of your
  # examples within a transaction, remove the following line or assign false
  # instead of true.
  #config.use_transactional_fixtures = true
  config.use_transactional_fixtures = false

although I tried changing it to true and the errors continued, so maybe that's not the case.

Out of curiosity: if you add page.reset! at the end of a few it blocks and then run them consecutively, do they still fail the same way? Do you see Reset calls coming into the debug log?

@jferris, it looks like they continue to fail and no extra Reset() calls come in. Here's how the spec looks:
  describe "dashboard preview" do
    context "when no one is out of office" do
      it "gang-all-here tile preview" do
        ooo_preview = page.find("#ooo")
        expect(ooo_preview).to have_selector("div.all-here")
        page.reset!
      end
    end

    context "when someone is out of office" do
      before(:each) do
        FactoryGirl.create(:event, :now, board_id: board.id, person_id: admin.id)
        go_to_board(board.id)
      end

      it "shows number of people that are out of office", js: true do
        ooo_preview = page.find("#ooo")
        expect(ooo_preview).to have_selector("div.overview-main-content")
        within ooo_preview do
          ooos = find("ul").all("li")
          expect(ooos.count).to eq board.out_today.count
        end
        page.reset!
      end
    end
  end

The only instances of Reset() are in this snippet, occurring prior to the first block passing:
<...>
Received "Reset()"
Started "Reset()"
Finished "Reset()" with response "Success()"
Wrote response true ""
<...>

@rpazyaquian This doesn't help at all with your failures but when testing counts your tests will be more robust if you pass them in as options to Capybaras matchers rather than testing them separately since it allows Capybaras waiting/retrying behavior to work when pages are loading dynamically etc.   In your test case - something like
it "shows number of people that are out of office", js: true do
    ooo_preview = page.find("#ooo")
    expect(ooo_preview).to have_css("div.overview-main-content")
    expect(ooo_preview).to have_css('ul li', count: board.out_today.count)
  end

@twalpole Good to know, I will keep that in mind for future tests - I may have been relying on outdated information and cheat sheets.
Any more insights on why the page is not being reset? I can try writing and running simpler specs as a way to triangulate the core problem, if that helps.

@rpazyaquian When you require capybara/rspec it adds an after hook that should call reset_sessions! between every test - If you can step through code and figure out whether that is getting called or why it's not that would narrow this down.  Or if you can produce a small example that produces the same behavior we can look at.

Any updates on this? I'm getting the same errors running consecutive specs.

ruby 2.3
capybara 2.13.0
capybara-webkit 1.14.0
qt 5.3.2

I have the same problem with the following setup:

OSX 10.11.6 (El Capitan)
Ruby 2.2
capybara 2.13.0
capybara-webkit 1.14.0
qt 5.5.1

@emerson-h Without an example that reproduces this error, it's basically impossible to debug - can you provide one?

@twalpole I'll try to pull together a minimum reproduction repo later this afternoon and will post a link here.

@emerson-h How'd that repo go? Also getting a similar issue on my end. To be more clear, errors include:
EOFError:             end of file reached           # <internal:prelude>:78:in__read_nonblock'
# internal:prelude:78:in read_nonblock'           # ./spec/support/helpers/features/donations/create/helpers.rb:37:in when_customer_enters_credit_card_on_payment_page'
# ./spec/features/donations/create/payment/error_spec.rb:21:in block (2 levels) in <top (required)>'
and
`
raise(Capybara::Webkit::CrashError, <<-MESSAGE.strip)
The webkit_server process crashed!
          #{exception.message}

        This is a bug in capybara-webkit. For help with this crash, please visit:

        https://github.com/thoughtbot/capybara-webkit/wiki/Reporting-Crashes
              MESSAGE

      Capybara::Webkit::CrashError:
        The webkit_server process crashed!

          Broken pipe

`
Also, seeing warnings about blocking/allowing urls. This is despite the following rails_helper config:
`
ENV['RAILS_ENV'] ||= 'test'
require File.expand_path('../../config/environment', FILE)
abort("The Rails environment is running in production mode!") if Rails.env.production?
require 'spec_helper'
require 'rspec/rails'
require 'capybara/rails'
require 'capybara/webkit'
ActiveRecord::Migration.maintain_test_schema!
RSpec.configure do |config|
config.infer_spec_type_from_file_location!
config.filter_rails_from_backtrace!
config.include FactoryGirl::Syntax::Methods
end
Capybara.javascript_driver = :webkit
Capybara.configure do |config|
config.default_max_wait_time = 10 # seconds
config.default_driver        = :webkit
end
Capybara::Webkit.configure do |config|
config.allow_url("js.stripe.com")
config.skip_image_loading
config.block_unknown_urls
end
Copied all of it to show that I'm not loading a different driver. Here's my spec_helper preemptively:
require 'capybara/rspec'
require 'factory_girl_rails'
Dir[File.dirname(FILE) + "/support/**/*.rb"].each { |f| require f }
RSpec.configure do |config|
config.expect_with :rspec do |expectations|
expectations.include_chain_clauses_in_custom_matcher_descriptions = true
end
config.mock_with :rspec do |mocks|
mocks.verify_partial_doubles = true
end
config.shared_context_metadata_behavior = :apply_to_host_groups
STDOUT configs
config.color = true
config.formatter = :documentation
end
`

We also get this issue but it doesn't occur on our development machines (MacBooks). It only crops up on our continuous testing runners - seemingly at random.

Linux 4.4.0-83-generic #106-Ubuntu Server 16.04 LTS
ruby 2.3.3p222 (2016-11-21 revision 56859) [x86_64-linux]
capybara 2.13.0
capybara-webkit 1.14.0
Qt 5.5.1

@emerson-h Did you make any progress with that minimum reproduction repo?

Closing due to lack of ability to reproduce,  we can reopen if someone provides a way to reproduce this.


Add option to automatically open default browser when server starts.

At the moment I'm running nc as a background process to ping the endpoint (e.g. http://localhost:3000) multiple times until it becomes available and then I open the browser with opener.

:+1:

:+1:

This should probably be optional since sc5-styleguide might only be one of the development servers that are run as part of the developer task and for someone not touching UI code it would never be relevant so opening it automatically might become really irritating if you could not turn it off.


master 0.9.0rc2 goes wrong when execute deepdive do sentences

Hi!
When I followed the tutorial (exmaple-spouse)[https://github.com/HazyResearch/deepdive/blob/master/doc/example-spouse.md] in master 0.9.0rc2 version, when i execute step1.2 ‘deepdive do sentences’， something goes wrong with me.
Here is the log info:
2017-03-12 12:29:28.372237 ################################################################################
2017-03-12 12:29:28.372352 # Host: ga89
2017-03-12 12:29:28.372383 # DeepDive: deepdive v0.9.0rc2-1063-g7b82f5a (Linux x86_64)
2017-03-12 12:29:28.372407 export PATH='/home/jyj/local/bin':"$PATH"
2017-03-12 12:29:28.372432 export DEEPDIVE_PWD='/home/jyj/spouse_example'
2017-03-12 12:29:28.372456 export DEEPDIVE_APP='/home/jyj/spouse_example'
2017-03-12 12:29:28.372480 cd "$DEEPDIVE_APP"/run
2017-03-12 12:29:28.372504 export DEEPDIVE_RUN_ID='20170312/122928.147677579'
2017-03-12 12:29:28.372526 # Plan: 20170312/122928.147677579/plan.sh
2017-03-12 12:29:28.372559 # Targets: sentences
2017-03-12 12:29:28.372583 ################################################################################
2017-03-12 12:29:28.372605
2017-03-12 12:29:28.372629     # process/init/app/run.sh ####################################### last done: 2017-03-12T09:44:29+0800 (2h 44m 59s ago
2017-03-12 12:29:28.372654     # process/init/relation/articles/run.sh ######################### last done: 2017-03-12T09:45:55+0800 (2h 43m 33s ago
2017-03-12 12:29:28.372677     # deepdive mark 'done' data/articles ############################ last done: 2017-03-12T09:45:55+0800 (2h 43m 33s ago
2017-03-12 12:29:28.372699 process/ext_sentences_by_nlp_markup/run.sh ########################## last done: N/A
2017-03-12 12:29:28.372722 ++ dirname process/ext_sentences_by_nlp_markup/run.sh
2017-03-12 12:29:28.372746 + cd process/ext_sentences_by_nlp_markup
2017-03-12 12:29:28.372770 + : dd_tmp_ dd_old_
2017-03-12 12:29:28.372793 + export DEEPDIVE_CURRENT_PROCESS_NAME=process/ext_sentences_by_nlp_markup
2017-03-12 12:29:28.372817 + DEEPDIVE_CURRENT_PROCESS_NAME=process/ext_sentences_by_nlp_markup
2017-03-12 12:29:28.372840 + export DEEPDIVE_LOAD_FORMAT=tsv
2017-03-12 12:29:28.372864 + DEEPDIVE_LOAD_FORMAT=tsv
2017-03-12 12:29:28.372887 + output_relation=sentences
2017-03-12 12:29:28.372911 + output_relation_tmp=dd_tmp_sentences
2017-03-12 12:29:28.372934 + output_relation_old=dd_old_sentences
2017-03-12 12:29:28.372957 + deepdive create table-if-not-exists sentences
2017-03-12 12:29:28.510974 + deepdive create table dd_tmp_sentences like sentences
2017-03-12 12:29:28.766148 CREATE TABLE
2017-03-12 12:29:28.767107 + deepdive compute execute 'input_sql=
2017-03-12 12:29:28.767176
2017-03-12 12:29:28.767202 SELECT R0.id AS column_0
2017-03-12 12:29:28.767225      , R0.content AS column_1
2017-03-12 12:29:28.767249 FROM articles R0
2017-03-12 12:29:28.767271
2017-03-12 12:29:28.767295 ' 'command=cd "$DEEPDIVE_APP" && udf/nlp_markup.sh' output_relation=dd_tmp_sentences
2017-03-12 12:29:28.918606 Executing with the following configuration:
2017-03-12 12:29:28.918673  DEEPDIVE_NUM_PROCESSES=31
2017-03-12 12:29:28.918700  DEEPDIVE_NUM_PARALLEL_UNLOADS=1
2017-03-12 12:29:28.918730  DEEPDIVE_NUM_PARALLEL_LOADS=1
2017-03-12 12:29:28.918754  DEEPDIVE_NAMED_PIPES_DIR=/home/jyj/spouse_example/run/process/ext_sentences_by_nlp_markup
2017-03-12 12:29:29.016113 unloading to /home/jyj/spouse_example/run/process/ext_sentences_by_nlp_markup/deepdive-compute-execute.96hSQAD/feed_processes-1: '
2017-03-12 12:29:29.016211
2017-03-12 12:29:29.016274 SELECT R0.id AS column_0
2017-03-12 12:29:29.016315      , R0.content AS column_1
2017-03-12 12:29:29.016346 FROM articles R0
2017-03-12 12:29:29.016368
2017-03-12 12:29:29.016390 '
2017-03-12 12:29:29.171637 Loading dd_tmp_sentences from /home/jyj/spouse_example/run/process/ext_sentences_by_nlp_markup/deepdive-compute-execute.96hSQAD/output_computed-1 (tsv format)
2017-03-12 12:29:29.437548 Parsing db60062c-cd21-40a5-ab3b-648d5a320bf2
2017-03-12 12:29:29.437652 malformed JSON string, neither tag, array, object, number, string or atom, at character offset 0 (before "A Beverley businessm...") at /home/jyj/local/util/nlp/tsj2corenlp-http-reqs line 38, <STDIN> line 1.
2017-03-12 12:29:29.437702 Parsing fc6ad33a-ae70-41ff-9f0e-7283f85878f6
2017-03-12 12:29:29.437748 malformed JSON string, neither tag, array, object, number, string or atom, at character offset 0 (before "Today I have a speci...") at /home/jyj/local/util/nlp/tsj2corenlp-http-reqs line 38, <STDIN> line 1.
2017-03-12 12:29:29.450501 Parsing 9d486048-bcc2-488c-be8a-32d7913c3b3b
2017-03-12 12:29:29.450610 malformed JSON string, neither tag, array, object, number, string or atom, at character offset 0 (before "You can learn a lot ...") at /home/jyj/local/util/nlp/tsj2corenlp-http-reqs line 38, <STDIN> line 1.
2017-03-12 12:29:29.456443 Parsing 9662058b-fca5-4771-8058-c7fd7bd548a3
2017-03-12 12:29:29.456519 malformed JSON string, neither tag, array, object, number, string or atom, at character offset 0 (before "Rick Perry is gone. ...") at /home/jyj/local/util/nlp/tsj2corenlp-http-reqs line 38, <STDIN> line 1.
2017-03-12 12:29:29.475290 Parsing 82c0c1d4-45b1-4861-b880-c414de299948
2017-03-12 12:29:29.475392 malformed JSON string, neither tag, array, object, number, string or atom, at character offset 0 (before "I took the Man to hi...") at /home/jyj/local/util/nlp/tsj2corenlp-http-reqs line 38, <STDIN> line 1.
2017-03-12 12:29:29.476808 Parsing dbc798be-9a6e-48b7-8721-31f84e89c10b
2017-03-12 12:29:29.476885 malformed JSON string, neither tag, array, object, number, string or atom, at character offset 0 (before "Is Reformed Theology...") at /home/jyj/local/util/nlp/tsj2corenlp-http-reqs line 38, <STDIN> line 1.
2017-03-12 12:29:29.479385 Parsing d8ec5d11-bf4d-4464-8dc7-c0984563181b
2017-03-12 12:29:29.479440 malformed JSON string, neither tag, array, object, number, string or atom, at character offset 0 (before "FOX LAKE, Ill. \x{2014}...") at /home/jyj/local/util/nlp/tsj2corenlp-http-reqs line 38, <STDIN> line 1.
2017-03-12 12:29:29.486478 Parsing c27a162d-f2d1-4bdb-84ba-0915a082775b
2017-03-12 12:29:29.486542 malformed JSON string, neither tag, array, object, number, string or atom, at character offset 0 (before "NBC's new drama The ...") at /home/jyj/local/util/nlp/tsj2corenlp-http-reqs line 38, <STDIN> line 1.
2017-03-12 12:29:29.491662 Parsing e7ea7dd7-0266-431a-bfb4-c8e88532c0d4
2017-03-12 12:29:29.491717 malformed JSON string, neither tag, array, object, number, string or atom, at character offset 0 (before "After four days of i...") at /home/jyj/local/util/nlp/tsj2corenlp-http-reqs line 38, <STDIN> line 1.
2017-03-12 12:29:29.501727 Parsing 2dea8451-cbcd-42b9-a263-ffc3397bde43
2017-03-12 12:29:29.501797 malformed JSON string, neither tag, array, object, number, string or atom, at character offset 0 (before "The veteran captain ...") at /home/jyj/local/util/nlp/tsj2corenlp-http-reqs line 38, <STDIN> line 1.
2017-03-12 12:29:29.503267 Parsing 340bb625-bb7e-49af-aa8d-781e5762f7a3
2017-03-12 12:29:29.503321 malformed JSON string, neither tag, array, object, number, string or atom, at character offset 0 (before "Peter Edelstein M.D....") at /home/jyj/local/util/nlp/tsj2corenlp-http-reqs line 38, <STDIN> line 1.
2017-03-12 12:29:29.507124 Parsing 70ecb3ad-cbbe-4097-8608-e3373a34a728
2017-03-12 12:29:29.507175 malformed JSON string, neither tag, array, object, number, string or atom, at character offset 0 (before "The President of the...") at /home/jyj/local/util/nlp/tsj2corenlp-http-reqs line 38, <STDIN> line 1.
2017-03-12 12:29:29.509941 /home/jyj/local/util/compute-driver/local/compute-execute: line 129: kill: (3961) - No such process
2017-03-12 12:29:29.510023 /home/jyj/local/util/compute-driver/local/compute-execute: line 129: kill: (3971) - No such process
2017-03-12 12:29:29.510064 /home/jyj/local/util/compute-driver/local/compute-execute: line 129: kill: (3973) - No such process
2017-03-12 12:29:29.510109 /home/jyj/local/util/compute-driver/local/compute-execute: line 129: kill: (3974) - No such process
2017-03-12 12:29:29.510149 /home/jyj/local/util/compute-driver/local/compute-execute: line 129: kill: (3977) - No such process
2017-03-12 12:29:29.510186 /home/jyj/local/util/compute-driver/local/compute-execute: line 129: kill: (3978) - No such process
2017-03-12 12:29:29.510222 /home/jyj/local/util/compute-driver/local/compute-execute: line 129: kill: (3980) - No such process
2017-03-12 12:29:29.510256 /home/jyj/local/util/compute-driver/local/compute-execute: line 129: kill: (3982) - No such process
2017-03-12 12:29:29.510290 /home/jyj/local/util/compute-driver/local/compute-execute: line 129: kill: (3983) - No such process
2017-03-12 12:29:29.510329 /home/jyj/local/util/compute-driver/local/compute-execute: line 129: kill: (3984) - No such process
2017-03-12 12:29:29.510356 /home/jyj/local/util/compute-driver/local/compute-execute: line 129: kill: (3985) - No such process
2017-03-12 12:29:29.510378 /home/jyj/local/util/compute-driver/local/compute-execute: line 129: kill: (3986) - No such process
2017-03-12 12:29:29.510404 /home/jyj/local/util/compute-driver/local/compute-execute: line 129: kill: (3998) - No such process
2017-03-12 12:29:29.510426 /home/jyj/local/util/compute-driver/local/compute-execute: line 129: kill: (3999) - No such process
2017-03-12 12:29:29.511309 Parsing f6e047d0-e409-42a6-ab0e-13ab926719a6
2017-03-12 12:29:29.511391 malformed JSON string, neither tag, array, object, number, string or atom, at character offset 0 (before "Valley Journal/Times...") at /home/jyj/local/util/nlp/tsj2corenlp-http-reqs line 38, <STDIN> line 1.
2017-03-12 12:29:29.514226 [ERROR] deepdive-unload: PID 3999: finished with non-zero exit status (141)
2017-03-12 12:29:29.514454 Parsing ba44d0cd-bff2-4875-8036-86f37419b5e7
2017-03-12 12:29:29.514523 malformed JSON string, neither tag, array, object, number, string or atom, at character offset 0 (before "Words kill or give l...") at /home/jyj/local/util/nlp/tsj2corenlp-http-reqs line 38, <STDIN> line 1.
2017-03-12 12:29:29.522593 /home/jyj/local/util/compute-driver/local/compute-execute: line 126:  3962 Terminated              DEEPDIVE_CURRENT_PROCESS_INDEX=$i bash -c "$command" < "$pipes"/process-$i.input > "$pipes"/process-$i.output
2017-03-12 12:29:29.522650 /home/jyj/local/util/compute-driver/local/compute-execute: line 126:  3963 Terminated              DEEPDIVE_CURRENT_PROCESS_INDEX=$i bash -c "$command" < "$pipes"/process-$i.input > "$pipes"/process-$i.output
2017-03-12 12:29:29.522678 /home/jyj/local/util/compute-driver/local/compute-execute: line 126:  3964 Terminated              DEEPDIVE_CURRENT_PROCESS_INDEX=$i bash -c "$command" < "$pipes"/process-$i.input > "$pipes"/process-$i.output
2017-03-12 12:29:29.522703 /home/jyj/local/util/compute-driver/local/compute-execute: line 126:  3965 Terminated              DEEPDIVE_CURRENT_PROCESS_INDEX=$i bash -c "$command" < "$pipes"/process-$i.input > "$pipes"/process-$i.output
2017-03-12 12:29:29.522727 /home/jyj/local/util/compute-driver/local/compute-execute: line 126:  3966 Terminated              DEEPDIVE_CURRENT_PROCESS_INDEX=$i bash -c "$command" < "$pipes"/process-$i.input > "$pipes"/process-$i.output
2017-03-12 12:29:29.522750 /home/jyj/local/util/compute-driver/local/compute-execute: line 126:  3967 Terminated              DEEPDIVE_CURRENT_PROCESS_INDEX=$i bash -c "$command" < "$pipes"/process-$i.input > "$pipes"/process-$i.output
2017-03-12 12:29:29.522774 /home/jyj/local/util/compute-driver/local/compute-execute: line 126:  3968 Terminated              DEEPDIVE_CURRENT_PROCESS_INDEX=$i bash -c "$command" < "$pipes"/process-$i.input > "$pipes"/process-$i.output
2017-03-12 12:29:29.522798 /home/jyj/local/util/compute-driver/local/compute-execute: line 126:  3969 Terminated              DEEPDIVE_CURRENT_PROCESS_INDEX=$i bash -c "$command" < "$pipes"/process-$i.input > "$pipes"/process-$i.output
2017-03-12 12:29:29.522824 /home/jyj/local/util/compute-driver/local/compute-execute: line 126:  3970 Terminated              DEEPDIVE_CURRENT_PROCESS_INDEX=$i bash -c "$command" < "$pipes"/process-$i.input > "$pipes"/process-$i.output
2017-03-12 12:29:29.522848 /home/jyj/local/util/compute-driver/local/compute-execute: line 126:  3972 Terminated              DEEPDIVE_CURRENT_PROCESS_INDEX=$i bash -c "$command" < "$pipes"/process-$i.input > "$pipes"/process-$i.output
2017-03-12 12:29:29.522872 /home/jyj/local/util/compute-driver/local/compute-execute: line 126:  3975 Terminated              DEEPDIVE_CURRENT_PROCESS_INDEX=$i bash -c "$command" < "$pipes"/process-$i.input > "$pipes"/process-$i.output
2017-03-12 12:29:29.522896 /home/jyj/local/util/compute-driver/local/compute-execute: line 126:  3976 Terminated              DEEPDIVE_CURRENT_PROCESS_INDEX=$i bash -c "$command" < "$pipes"/process-$i.input > "$pipes"/process-$i.output
2017-03-12 12:29:29.522920 /home/jyj/local/util/compute-driver/local/compute-execute: line 126:  3979 Terminated              DEEPDIVE_CURRENT_PROCESS_INDEX=$i bash -c "$command" < "$pipes"/process-$i.input > "$pipes"/process-$i.output
2017-03-12 12:29:29.522943 /home/jyj/local/util/compute-driver/local/compute-execute: line 126:  3981 Terminated              DEEPDIVE_CURRENT_PROCESS_INDEX=$i bash -c "$command" < "$pipes"/process-$i.input > "$pipes"/process-$i.output
2017-03-12 12:29:29.522967 /home/jyj/local/util/compute-driver/local/compute-execute: line 126:  3987 Terminated              DEEPDIVE_CURRENT_PROCESS_INDEX=$i bash -c "$command" < "$pipes"/process-$i.input > "$pipes"/process-$i.output
2017-03-12 12:29:29.522991 /home/jyj/local/util/compute-driver/local/compute-execute: line 126:  3988 Terminated              DEEPDIVE_CURRENT_PROCESS_INDEX=$i bash -c "$command" < "$pipes"/process-$i.input > "$pipes"/process-$i.output
2017-03-12 12:29:29.523015 /home/jyj/local/util/compute-driver/local/compute-execute: line 126:  3989 Terminated              DEEPDIVE_CURRENT_PROCESS_INDEX=$i bash -c "$command" < "$pipes"/process-$i.input > "$pipes"/process-$i.output
2017-03-12 12:29:29.523038 /home/jyj/local/util/compute-driver/local/compute-execute: line 126:  3990 Terminated              DEEPDIVE_CURRENT_PROCESS_INDEX=$i bash -c "$command" < "$pipes"/process-$i.input > "$pipes"/process-$i.output
2017-03-12 12:29:29.523062 /home/jyj/local/util/compute-driver/local/compute-execute: line 126:  3991 Terminated              DEEPDIVE_CURRENT_PROCESS_INDEX=$i bash -c "$command" < "$pipes"/process-$i.input > "$pipes"/process-$i.output
2017-03-12 12:29:29.523086 /home/jyj/local/util/compute-driver/local/compute-execute: line 126:  3994 Terminated              mkmimo "$pipes"/process-*.output \> "$pipes"/output_computed-*
2017-03-12 12:29:29.523109 /home/jyj/local/util/compute-driver/local/compute-execute: line 126:  3995 Terminated              deepdive-load "$output_relation" "$pipes"/output_computed-*

Have you solved it? That also goes wrong with me

        Sorry but not solved with me.
        On 04/23/2017 16:01, dqqian wrote: Have you solved it? That also goes wrong with me

—You are receiving this because you authored the thread.Reply to this email directly, view it on GitHub, or mute the thread.
{"api_version":"1.0","publisher":{"api_key":"05dde50f1d1a384dd78767c55493e4bb","name":"GitHub"},"entity":{"external_key":"github/HazyResearch/deepdive","title":"HazyResearch/deepdive","subtitle":"GitHub repository","main_image_url":"https://cloud.githubusercontent.com/assets/143418/17495839/a5054eac-5d88-11e6-95fc-7290892c7bb5.png","avatar_image_url":"https://cloud.githubusercontent.com/assets/143418/15842166/7c72db34-2c0b-11e6-9aed-b52498112777.png","action":{"name":"Open in GitHub","url":"https://github.com/HazyResearch/deepdive"}},"updates":{"snippets":[{"icon":"PERSON","message":"@dqqian in #631: Have you solved it? That also goes wrong with me"}],"action":{"name":"View Issue","url":"https://github.com/HazyResearch/deepdive/issues/631#issuecomment-296426548"}}}


Refactors MainViewController into separate view controllers.

Using proper view controller containment. Everything should work the way it did before, more or less. I made a few tweaks here and there:

The enclosing category is now expanded when a sample is selected.
Search no longer returns an incorrect number of results the first time.
The divider is now moveable as a result of using a split view controller.
Sample child view controller views are only loaded and displayed as needed as a result of using a tab view controller.

@nixta I tried to use the main storyboard as much as possible. But due to the dynamic nature of our UI, it wasn't possible to model everything in a storyboard. The view controller in the right split view item is based off of the selection in the left split view item and there isn't really a good way to model that in a storyboard. The iOS workflow is much easier to model in a storyboard: Categories > Samples > Sample.

I do that in the maps-app-ios, though granted there's some code that needs to go with it to swap out subviews, so fair enough.
However, I still don't see why the SampleCollectionHeaderView needs to be a separate XIB? Shouldn't that just be a subview in SampleCollectionViewController.xib's view hierarchy?

Sorry. I didn't realize/notice that the SampleCollectionHeaderView was a collection view section heading. Looks good then.

@nixta @qsmmorgan I pushed a change that dismissed your approvals. Please re-review.


Replace lodash with lodash.defaults.

Since defaults is the only lodash function used.  Closes #8.

@wtgtybhertgeghgtwtg Thanks!

Thank you for merging.


Dashboard Activities Product is null in ActivityModel

Server is giving no product for activity type 2 (Generation).
Also everything is in this weird b'XXX' format and it looks weird.
This is causing a crash.

Crash has been fixed but b'XX' has not


Add my pgp key

Can we merge it into master branch?

yeah, wrong target.. thanks for spotting

merged into master


R script example

Pull Request Test Coverage Report for Build 569

0 of 0   changed or added relevant lines in 0 files are covered.
28 unchanged lines in 14 files lost coverage.
Overall coverage remained the same at 86.757%

Files with Coverage Reduction
New Missed Lines
%

datmo/cli/command/base.py
1
93.33%

datmo/snapshot.py
1
80.34%

datmo/core/util/misc_functions.py
2
77.7%

datmo/core/controller/file/driver/local.py
2
91.71%

datmo/cli/driver/helper.py
2
60.81%

datmo/task.py
2
91.13%

datmo/cli/command/session.py
2
100.0%

datmo/cli/command/datmo_command.py
2
100.0%

datmo/core/controller/code/driver/git.py
2
81.76%

datmo/core/util/i18n.py
2
100.0%

Totals

Change from base Build 562:
0.0%

Covered Lines:
2889

Relevant Lines:
3330

💛  - Coveralls

verified that simple R example works with RStudio. Added some pointers that were helpful for me to the README


[Crash on Boot] Crashes on version 2.0.16, works on 2.0.13

Crash log: https://mclo.gs/OqbeTRR
Modlist: https://mclo.gs/khvijob

Are you sure this is being caused by Alloy Forgery?
A Feature Order Cycle crash happens during worldgen, which is something we do not touch at all.

Crash log: https://mclo.gs/OqbeTRR Modlist: https://mclo.gs/khvijob

Your Crash log doesn't even have alloy forgery so How is it our fault?