Centralized district heating slider is 0% even though local dataset sets it to 99.7%

In the .yml I set:
  :"buildings_chp_engine_biogas-buildings_final_demand_steam_hot_water@steam_hot_water": 0.0029
  :"buildings_collective_chp_network_gas-buildings_final_demand_steam_hot_water@steam_hot_water": 0
  :"buildings_collective_chp_wood_pellets-buildings_final_demand_steam_hot_water@steam_hot_water": 0
  :"buildings_collective_geothermal-buildings_final_demand_steam_hot_water@steam_hot_water": 0
  :"buildings_heat_network_connection_steam_hot_water-buildings_final_demand_steam_hot_water@steam_hot_water": 0.9971

Biogas chp is correctly set to 0.3% but centralized heating district is 0 (see screenshot). Setting biomass, gas, geothermal to non-zero values works fine.

Workaround:
  :"buildings_chp_engine_biogas-buildings_final_demand_steam_hot_water@steam_hot_water": 0.0029
  :"buildings_collective_chp_network_gas-buildings_final_demand_steam_hot_water@steam_hot_water": 0
  :"buildings_collective_chp_wood_pellets-buildings_final_demand_steam_hot_water@steam_hot_water": 0
  :"buildings_collective_geothermal-buildings_final_demand_steam_hot_water@steam_hot_water": 0
  #:"buildings_heat_network_connection_steam_hot_water-buildings_final_demand_steam_hot_water@steam_hot_water": 0.9971

On which branch are you working @MichielDenHaan?

I actually made this issue together with @MichielDenHaan so all is fine actually 👍 this is a bug. It's either ETModel which can't balance the sliders or it's something in the initializers. What is odd, is that I can remember something similar was happening with the initializer inputs (specify all but 1 of a share group).

The buildings_heat_network_connection_steam_hot_water-buildings_final_demand_steam_hot_water@steam_hot_water edge is a 'flexible' edge. Which I think exists as a share which share value are determined like I specified in the above comment:

Specify all but 1 of a share group (so 1 - 'the sum of the rest of the shares in that share group')

By actually explicitly specifying this share the whole things breaks.
Please correct me if I'm wrong @antw

Now the real questions:

How do we deal with this in the Excel?
Should they be explicitly in the yml?
Are there any other 'flex' shares which are set, which are causing similar issues?

How do we deal with this in the Excel?

I don't understand why it is relevant how we deal with this in Excel 😟 . This is behaviour which is happening in ETEngine right?

Should they be explicitly set in the graph values yml?

It would be nice for completeness IMO but not essential.

Are there any other 'flex' shares which are set, which are causing similar issues?

Households space heating:

Households hot water:

Households cooking

Buildings heating

Possibly others

What confuses me is that for instance this share group (cars) in transport does not have a flexible share:

@antw can we remove all flexible links in share groups and would this solve the above issue?

can we remove all flexible links in share groups and would this solve the above issue?

There would almost certainly be some queries to be updated, but I guess so.
However I don't like that as a solution to this problem, because it will happen again someday that someone tries to specify a share for a flexible edge with initializer methods.
I think it should be the responsibility of the initializer method to check the type of the edge and do the correct thing (i.e., in this case, ignore the value and do not set a share).
With that said, I do not understand why the custom share for the flexible edge is ignored and instead results in 0.0. Either ETE should respect the share set, or ignore it and calculate the share dynamically. Either way, it should result in 99%. How does it end up as 0%?

--
In response to @ChaelKruip :

I don't understand why it is relevant how we deal with this in Excel 😟 . This is behaviour which is happening in ETEngine right?

It would be nice for completeness IMO but not essential.

Yes, but @MichielDenHaan now copy pastes the end-result of that Excel into the Yaml, so it's the source - kind of. And I'm more thinking about the 'documentation' of that number. It could be left out of the Yaml (as the workaround suggests).
--
In response to @antw :

I think it should be the responsibility of the initializer method to check the type of the edge and do the correct thing (i.e., in this case ignore the value and do not set a share?).

That, or write a new validator that will raise an error whenever somebody whitelists a flexible share.

How does it end up as 0%?

I was hoping you could tell me 😅 but it's clearly a bug than. Could it be related to merit in someway? Or let me ask a more basic question first: what is the purpose of a flexible share?

This does not seem to be an issue for all flexible shares. I just tested for households hot water by setting:
  :"households_water_heater_combined_network_gas_aggregator-households_useful_demand_for_hot_water_after_solar_heater_and_p2h@useable_heat": 0.848889120002718
  :"households_water_heater_crude_oil_aggregator-households_useful_demand_for_hot_water_after_solar_heater_and_p2h@useable_heat": 0
  :"households_water_heater_district_heating_steam_hot_water_aggregator-households_useful_demand_for_hot_water_after_solar_heater_and_p2h@useable_heat": 0
  :"households_water_heater_fuel_cell_chp_network_gas_aggregator-households_useful_demand_for_hot_water_after_solar_heater_and_p2h@useable_heat": 0
  :"households_water_heater_heatpump_air_water_electricity_aggregator-households_useful_demand_for_hot_water_after_solar_heater_and_p2h@useable_heat": 0.0176397866914411
  :"households_water_heater_heatpump_ground_water_electricity_aggregator-households_useful_demand_for_hot_water_after_solar_heater_and_p2h@useable_heat": 0.0749336638103457
  :"households_water_heater_hybrid_heatpump_air_water_electricity_aggregator-households_useful_demand_for_hot_water_after_solar_heater_and_p2h@useable_heat": 0
  :"households_water_heater_micro_chp_network_gas_aggregator-households_useful_demand_for_hot_water_after_solar_heater_and_p2h@useable_heat":  0
  :"households_water_heater_network_gas_aggregator-households_useful_demand_for_hot_water_after_solar_heater_and_p2h@useable_heat": 0.0334983128299795
  :"households_water_heater_resistive_electricity_aggregator-households_useful_demand_for_hot_water_after_solar_heater_and_p2h@useable_heat": 0.0250391166655157

Result:

According to @ChaelKruip's post, the gas water heater share is flexible. However, the share is correct (3.3%) even though it is explicitly set in the .yml.

So perhaps it's just this (buildings_heat_network_connection_steam_hot_water-buildings_final_demand_steam_hot_water@steam_hot_water) single share for some reason 🤔

When I set:
:"households_heat_network_connection_steam_hot_water-households_final_demand_steam_hot_water@steam_hot_water": 1 it breaks down as well (all shares are 0)


happen some ui error when making a removing operation

Apologies in advance if this is a basic question -- I'm in the process of learning React and this library.     =.=
specific situation :

I need dynamic operation to add or remove mesh just like a simple editor.
My initial data stem from object imported.  I keep it as a array in state.
when adding or removing , I change the array (splice by object) directly.  and setState.

unexpected ：
whichever i remove,   this comes out the last one  to disappear。
I think I ignore something about re-rendering, maybe. Can you give me some advise?

Can you please paste the code, it could help resolve the issue

=.=     thanks simida~
just a simple demo extends from your example of DraggableCubes.  So I just paste some differ code.
+ and - codes
` onIncreaseClick() {
let p_x = Math.random() * 150 - 50;
let p_y = Math.random() * 150 + 60;
let p_z = Math.random() * 120 - 60;
this.models.push({position: new THREE.Vector3(p_x, p_y, p_z)});
this.setState({
models: this.models,
})
}
onDecreaseClick() {
this.selecteModel.parent.remove(this.selecteModel);
// this.models.splice(this.selected, 1);
// this.setState({
//   models: this.models,
// })
this.setState({})  // to re-render
}`
when click someone,
  setChoiceItem(models, choice) {     this.selected = choice;  //index of this.models     this.selecteModel = models;    // refs of it   }
in render
 ...    <scene>     <TouchableModels models={this.state.models}             onCubesMounted={this._onCubesMounted.bind(this)}             mouseInput={mouseInput}             camera={camera}             setChoiceItem={this.setChoiceItem.bind(this)}/>   </scene>
when i click someone ,  will callback setChoiceItem.  then i click remove --> onDecreaseClick. in method of onDecreaseClick, if use the code annotated, whichever i remove, this comes out the last one to disappear.  then i try to use   this.selecteModel.parent.remove(this.selecteModel); . but there will be wrong when i use draggable mesh because of i cant control the doms,  maybe

I have dealed with it today. The problem is about re-rendering specific cubes. thanks at all.


[OTHER] Update KendallDoesCoding.json

What would you like to share?
Update my bio
Additional information
No response

I do not think there is need to make issues for these 😅

I do not think there is need to make issues for these 😅

Ok lol, closing!


visualize function in README is not defined.

visualize mentioned in readme is not defined

Thanks, removed that section. The visualization was changed to use the parsed representation only.


[WIP] Sync vendor and add validation

Signed-off-by: Antonio Murdaca<EMAIL_ADDRESS>
- What I did

[x] sync up the vendor tree
[ ] pin versions in vendor.conf to have deterministic vndr runs
[ ] removed the PKG env from make vendor; we want to run them all to have determinism
[ ] add validation to the vendor tree in the CI

- How I did it
- How to verify it
- Description for the changelog

@mrunalp @runcom, I think we can close this PR in favour of https://github.com/pulls


Adaptive card supported as message attachment using 'Connectors for Microsoft 365 Groups'

The table here states that adaptive cards are not supported for Connectors for Microsoft 365 Groups.
However, using the format documented here, it is possible to send adaptive cards for these connectors.
Perhaps it's worth adding it to the notes below the table.
You may also want to consider updating the note at the top of this page.

Document Details
⚠ Do not edit this section. It is required for learn.microsoft.com ➟ GitHub issue linking.

ID: 3fb4394d-25b1-8752-3996-fe3a2934732d
Version Independent ID: 6d391381-89d0-117c-27cc-00043bd26a36
Content: Types of cards - Teams
Content Source: msteams-platform/task-modules-and-cards/cards/cards-reference.md
Service: msteams
GitHub Login: @surbhigupta
Microsoft Alias: lajanuar

@timeverts - Thanks for reporting your issue.
We will check this at our end and update the document accordingly.

@timeverts -We have tried the same but showing the error while tried the adaptive card for Connectors for Microsoft 365 Groups.
Could you please share the repro steps so that we can try it from our end?

@sayali-MSFT, after you have setup a Connector for Microsoft 365 groups, follow the steps here to create an adaptive card that can be sent to the connector URL.
A message in that format can be used to send an adaptive card to a Connector for Microsoft 365 groups.

@timeverts -We ae also trying the same as mentioned above. We are able to send the adaptive card.
We are confirming with the engineering team and update the document accordingly.

Got the reply from engineering teams, "The table is accurate in that Adaptive cards are only supported for Incoming Webhook type Connectors, not for all other Connectors."

So the table itself might be accurate, but it would be worth informing users there is a way to get it working using a different format of the JSON (as we've both shown it is. possible)
As mentioned in my original post, my suggestions are:

Perhaps it's worth adding it to the notes below the table.

You may also want to consider updating the note at the top of this page.

@timeverts -We are confirming with the engineering team and update the document accordingly.

@surbhigupta12 -Could you please help us to update the document.
Add the note in below document-
Note-Adaptive Card supports only Incoming Webhook O365 Connector type and not any other O365 Connector types. You can send the adaptive cards for these connectors using below JSON format.
Document Link-https://learn.microsoft.com/en-us/microsoftteams/platform/webhooks-and-connectors/how-to/connectors-using?tabs=cURL#send-adaptive-cards-using-an-incoming-webhook


Support for one time configuration

If I want to give the user, for example, to choose which css preprocessor he preferred sass/less/stylus ( for the file extension ) and I need to save this somewhere for not asking him again every time, There is a way to do that?

I'm working on a way to let plop do a one time setup of an entire codebase. So this would allow a user to clone your repo, run plop and answer some questions, then plop would make the appropriate changes to the codebase to customize it. This is not in place yet, but it is definitely on the roadmap along with sharable plop "packs" that would allow you to publish a set of generators that others could use in their own plopfiles.
Would this feature (once available) fit your need?

Yes, thank you.


ReqResp encoded bytes API

Issue https://github.com/ChainSafe/lodestar/pull/5229 would benefit greatly from ReqResp dealing with non deserialized SSZ data structures

Since ReqResp requests and responses must cross the worker boundary it's best to just wait to de-serialize them on the main thread. For it the API exposed by the reqresp package must deal exclusively with Uint8Array instead of T representing the deserialized object. For reference of how the API should look like PR https://github.com/ChainSafe/lodestar/pull/5229 is quasi complete reference.

Based on discussion with @wemeetagain came up with this diagram to align the understanding for everyone.


Fix Python syntax in readme

Numbers prefixed with 0 are recognised as octal numbers in Python 2, but this is a syntax error in Python 3

Good catch - thanks @kaedroho !


Fixed the error mapping for the NoSuchIngredientException

:warning: Please install the  to ensure uploads and comments are reliably processed by Codecov.
Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 79.77%. Comparing base (14915fa) to head (6bbe697).
Report is 1 commits behind head on master.

:exclamation: Your organization needs to install the Codecov GitHub app to enable full functionality.
Additional details and impacted files
@@           Coverage Diff           @@
##           master    #1699   +/-   ##
=======================================
  Coverage   79.77%   79.77%
=======================================
  Files         144      144
  Lines        4865     4865
  Branches      161      161
=======================================
  Hits         3881     3881
  Misses        984      984

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


Backport UseProgramMain template option

Contributes to #40945

@wtgodbe so it seems I should hold off on merging this until we fully understand how and where these changes will flow into the 6.0.xxx SDK trains, yes?

@wtgodbe so it seems I should hold off on merging this until we fully understand how and where these changes will flow into the 6.0.xxx SDK trains, yes?

Yes


Deploy with Azure portal - 'run instance' greyed out

Have a container registry and and a repository with a tag (latest)
The 'run instance' button on the context menu is greyed out
Is there a reason for this and is it possible to add an explanation to the documentation here?
(Portal trying to forbid using 'latest' vs. locking to a version?)

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: c06ec64b-fd1c-892d-88cf-e1c8fa66473a
Version Independent ID: 9a57446a-8ded-4ccd-11d1-e574617e6741
Content: Deploy to Azure Container Instances from Azure Container Registry
Content Source: articles/container-instances/container-instances-using-azure-container-registry.md
Service: container-instances
GitHub Login: @dlepow
Microsoft Alias: danlep

@MicahMcKittrick-MSFT no, no running instances
It seems to be regardless of image or tag

Container images from the marketplace
Custom images created and pushed to the registry

'Run instance' always shows as greyed out:

Is there some other resource that is a prerequisite that I'm missing here? (I have the registry, I have no running instances - is there something it's expecting to allow running?)

I've figured this out:
You have to ensure the administrator user is enabled under Access keys:

This setting is not enabled by default, but as soon as it is enabled, 'Run instance' becomes usable.
Maybe this is addressed by the  "Configure registry authentication" section (which I did not do), but the way the article is laid out makes it seem as though that is specific to doing it via the subsequent steps (CLI) and that it (might) not apply to doing it via the portal.
It would be good if the portal section could open with 'Ensure you either enable administrator user OR '

@DavidR91 ah yes! As you found you do need to have Admin User enabled.
I believe we should have that noted in the doc. @dlepow can you take a look?

@DavidR91 - Thanks for pointing out this documentation gap. I updated the portal section to state the requirement to enable the admin user account to enable "Run instance" command.
#please-close

I found that even with if the admin option was turned on, the the run instance was grayed out. I tagged my image with latest and only then did it work

very good


Add payment refund handler

This PR adds a payment refund handler to the paypal payment method. This allows payments created with order transaction captures to be refunded through Shopware.

Closing here in favor of https://github.com/shopwareLabs/SwagPayPal/pull/14

Closing here in favor of https://github.com/shopwareLabs/SwagPayPal/pull/14


[import/no-duplicates] False positive on multiple imports from submodules

I am seeing the following warning twice for .../node_modules/firebase/empty-import.d.ts' imported multiple times  import/no-duplicates for the following code:
import firebase from 'firebase/app';
import 'firebase/auth';
import 'firebase/database';

Interesting I am no seeing this warning if its simply
import firebase from 'firebase/app';
import 'firebase/database';

Additionally I saw this PR https://github.com/benmosher/eslint-plugin-import/pull/1612 where a comment is made about circling back on the second case. The fact that the second case isn't triggering a warning makes me think that maybe this is just a bug handling 3 and not 2 🤷♂ .

This seems like it's related to the typescript resolver.

If it helps I am using eslint-import-resolver-typescript with the following settings:
'import/resolver': {
      typescript: {
        alwaysTryTypes: true,
      },
    },

If this is an issue in that lib, happy to move this issue. I am a bit new to these two libs so I am stilling trying to get my bearings on what owns what part.

What I mean is, if all of the imports are resolving to the same d.ts file, then the import plugin will assume they're duplicate imports.

I have the same problem, but with date-fns lib.
this is the code where I got the "import/no-duplicates" warning:
import ptBR from 'date-fns/locale/pt-BR';
import { addDays, format, getYear } from 'date-fns';

this is not correct, right?

@murilocp you're correct, those are two different specifiers/modules and should not be warned on.

I have the same problem, but with date-fns lib.
this is the code where I got the "import/no-duplicates" warning:
import ptBR from 'date-fns/locale/pt-BR';
import { addDays, format, getYear } from 'date-fns';

this is not correct, right?

This stil seems to be a problem.
Is this something which should be fixed in date-fns or in estlint-plugin-import?

@the-ult here, which is why there’s a help wanted label.

duplicate of #1479


fix(Makefile): failing missing tiller directory

The clean command fails when /rootfs/tiller is missing.

This change is

Thanks! I think Makefile.orig accidentally got merged in here during a rebase. Can you remove it?

I had an old version of the makefile that was causing this to fail. Figured out it isn't an issue. So closing the PR.

Thanks for the PR nonetheless!


Add Spanish translations

Hey there! 👋

I've added the Spanish translations of the whole application!
On how to handle the switching locales logic, there are a few options on how to do this. For now, I've added an around_action and have been passing the :es locale as a param. Let me know how you want to handle this!
On a rake task that checks which translations are missing... By executing bundle exec i18n-tasks health when running bin/check, this task will return if there are any missing translations in any locale!
As @hungmi posted in this issue, there are indeed some design changes that need to be done. For example, in this view👇

Let me know what you think!
Pull request checklist

[ ] Your code contains tests relevant for code you modified
[X] You have linted and tested the project with bin/check

Hi~ @salochara
I just started to do some Chinese translations based on your work. 👍
You may want to add something like
def default_url_options
  { locale: I18n.locale }
end

to application_controller. It helps me when I clicking around.
BTW, I want to know what is the preferred way to set the current locale, too.
I think this has something to do with the url structure.
Ex, the site I work for is using urls like https://example.com/es/..., https://example.com/zh-TW/....

This is amazing - thank you so much for the contribution! Before we merge it in I want to make sure a few things are addressed.
First, I want to ensure a missing Spanish (or other language) translation does not break the build. Development on the site is fast, and I don't want to be held up because we don't have translations ready for a new feature. If missing, lets fall back to the English translation. Ideally, bin/check only checks English but we have other tasks (probably already in the i18n gem) that can check other languages on their own.
Second, Devise provides translations for other languages via devise-i18n. Let's use that instead of the manual translations since they will work if/when we use more of Devise.
Finally, since this is my first localized application, I have some questions on how this works in practice. What is standard practice for someone changing locales? I see you can add the ?locale=es param, but that resets on each request and there's no way to discover it. Also, what are the SEO implications of our decisions? I know we can use a subdomain, a different domain entirely, and a top-level path, but would love to hear your experience here. I'm a bit concerned of doing a (sub)domain because the developer profiles will never be translated.

After reading the Rails i18n guide (again) I think I'm leaning towards railsdevs.com/es/developers where railsdevs.com/developers defaults to English. Then, a dropdown or links in the footer can link to different locales. This approach preserves the locale when sharing a URL with someone.
There are a few caveats with this approach that I'm not yet sure how to handle.

For the sitemap, are translated pages no longer canonical? How do we reflect this when sending to Google and such?
How does one see the Spanish version of the homepage? railsdevs.com/es would try to route to the /es path!
The language should be specified in <head>.

Hey! 👋
This makes sense to me. I believe this is a good approach.
After reading the Rails i18n guide (again) I think I'm leaning towards railsdevs.com/es/developers where railsdevs.com/developers defaults to English. Then, a dropdown or links in the footer can link to different locales. This approach preserves the locale when sharing a URL with someone.
This is also the first time I work with a localized application, so no expierence from this side either 🙃 haha.
As for the devise translations, I've taken taken the trasnlations we're currently using direclty from devise-i18n
Also, after reading a bit on this, I believe we can implement the translate-missing keys using Google Translate, DeepL or Yandex as described here. I feel this will come in handy for this project
Let me know what do you think about all of this and what steps to take to move forward!
Best!

As for the devise translations, I've taken taken the trasnlations we're currently using direclty from devise-i18n

Let's use that gem directly instead of copy-pasting the file in. That ensures us that if any updates to Devise occur we will get the changes here, too.

Also, after reading a bit on this, I believe we can implement the translate-missing keys using Google Translate, DeepL or Yandex as described here. I feel this will come in handy for this project

For now, I'd prefer not to automate any translations and have them all done manually. Which is why we still need to fallback to English if a translation is missing. Can you try this approach and see if it works as I'm describing?

Once these are taken care of I will revisit #256 to hopefully merge them in together.

Let's use that gem directly instead of copy-pasting the file in. That ensures us that if any updates to Devise occur we will get the changes here, too.

Hmm. I don't see the way of doing that with the gem. As far as I undesrtand, with the customize view part, it will regenerate the devise views. I might need some help from you on this one!

For now, I'd prefer not to automate any translations and have them all done manually. Which is why we still need to fallback to English if a translation is missing. Can you try this approach and see if it works as I'm describing?

As for this, with this line in application.rb
# Use default language as fallback if translation is missing
config.i18n.fallbacks = true

I've tested with a case where there is a missing translation in the Spanish version, ask for the Spanish version via /?locale=es in the params, and will indeed fallback to the English translation. In short, I believe we're covered!
As for the logic for changing params, I see there's some work done on that in this PR https://github.com/joemasilotti/railsdevs.com/pull/256
I have removed the logic I implemented for it and will leave these on my PR:

Translation (whole app and devise)
Check only for i18n english health

Merged into #264.


Update 11-explore-the-azure-ai-extension.md

Module: 00
Lab/Demo: 00
Fixes # .
Changes proposed in this pull request:

Maybe we want to mention that the user can encounter this error when trying to deploy Language Service resource in a subscription on which Responsible AI terms have not been read and accepted.
`{"code": "InvalidTemplateDeployment", "message": "The template deployment 'deploy' is not valid according to the validation procedure. The tracking id is '41606ff3-8de4-4d57-804c-304e00843a35'. See inner errors for details."}
Inner Errors:
{"code": "ResourceKindRequireAcceptTerms", "message": "This subscription cannot create TextAnalytics until you agree to Responsible AI terms for this resource. You can agree to Responsible AI terms by creating a resource through the Azure Portal then trying again. For more detail go to https://go.microsoft.com/fwlink/?linkid=2164190"}`

Also, would be worth mentioning this one too:
{"status":"Failed","error":{"code":"DeploymentFailed","target":"/subscriptions/16af841d-db7d-4bd8-b606-c845c1a56152/resourceGroups/myresourcegrou_nacho/providers/Microsoft.Resources/deployments/deploy","message":"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.","details":[{"code":"ResourceDeploymentFailure","target":"/subscriptions/{subscriptionId}/resourceGroups/myresourcegrou_nacho/providers/Microsoft.DBforPostgreSQL/flexibleServers/psql-learn-eastus2-2baiar52p7ly4","message":"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.","details":[{"code":"RegionIsOfferRestricted","message":"Subscriptions are restricted from provisioning in this region. Please choose a different region. For exceptions to this rule please open a support request with Issue type of 'Service and subscription limits'. See https://review.learn.microsoft.com/en-us/azure/postgresql/flexible-server/how-to-request-quota-increase for more details."}]}]}}

This could also happen if user attempts to deploy more than once on the same subscription:
`{"code": "InvalidTemplateDeployment", "message": "The template deployment 'deploy' is not valid according to the validation procedure. The tracking id is '4e87a33d-a0ac-4aec-88d8-177b04c1d752'. See inner errors for details."}
Inner Errors:
{"code": "FlagMustBeSetForRestore", "message": "An existing resource with ID '/subscriptions/{subscriptionId}/resourceGroups/myrg-nacho/providers/Microsoft.CognitiveServices/accounts/oai-learn-eastus-buhgtxv6ggkrw' has been soft-deleted. To restore the resource, you must specify 'restore' to be 'true' in the property. If you don't want to restore existing resource, please purge it first."}`

@nachoalonsoportillo, I have made multiple changes, so there are many conflicts between your PR and the current file. However, I went through your requested changes and incorporated them into the document. I also added info about common errors and solutions to the Before you start section of the document. Once you have a chance to review the updated document, you should be able to close this PR.

@kylebunting Should I close this PR and review the current version already integrated in the main branch of MicrosoftLearning/mslearn-postgresql's repo?
Or is it the ADO repo the one I should be reviewing now?

@nachoalonsoportillo, I would close this PR and review the updated content in the main branch.


snpEff Error for Manta: end before start.

Something in a Manta.vcf.gz broke snpEff.
[2016-01-27T11:30Z] ChrPosStats.sample(78):	Error counting samples on chromosome 'GL000210.1'. Position '27712' => count[277]  (count.length: 277, factor: 100, chrLength: 27682).
[2016-01-27T11:30Z] Error: Error while processing VCF entry (line 10156) :
[2016-01-27T11:30Z] 	GL000220.1	1	MantaBND:231425:0:1:2:0:0:0	G	]GL000205.1:122316]G	.	PASS	SVTYPE=BND;MATEID=MantaBND:231425:0:1:2:0:0:1;IMPRECISE;CIPOS=-114,115;BND_DEPTH=100;MATE_BND_DEPTH=222;AC=0;AN=0	PR	68,33
[2016-01-27T11:30Z] java.lang.RuntimeException: Interval error: end before start.
[2016-01-27T11:30Z] 	Class        : Marker
[2016-01-27T11:30Z] 	Start        : 0
[2016-01-27T11:30Z] 	End          : -1
[2016-01-27T11:30Z] 	ID           :
[2016-01-27T11:30Z] 	Parent class : Chromosome
[2016-01-27T11:30Z] 	Parent       : GL000220.1	0-161801 CHROMOSOME 'GL000220.1'
[2016-01-27T11:30Z] java.lang.RuntimeException: Interval error: end before start.
[2016-01-27T11:30Z] 	Class        : Marker
[2016-01-27T11:30Z] 	Start        : 0
[2016-01-27T11:30Z] 	End          : -1
[2016-01-27T11:30Z] 	ID           :
[2016-01-27T11:30Z] 	Parent class : Chromosome
[2016-01-27T11:30Z] 	Parent       : GL000220.1	0-161801 CHROMOSOME 'GL000220.1'
[2016-01-27T11:30Z] 	at ca.mcgill.mcb.pcingola.interval.Interval.<init>(Interval.java:38)
[2016-01-27T11:30Z] 	at ca.mcgill.mcb.pcingola.interval.Marker.<init>(Marker.java:37)
[2016-01-27T11:30Z] 	at ca.mcgill.mcb.pcingola.snpEffect.HgvsDna.isDuplication(HgvsDna.java:124)
[2016-01-27T11:30Z] 	at ca.mcgill.mcb.pcingola.snpEffect.HgvsDna.toString(HgvsDna.java:377)
[2016-01-27T11:30Z] 	at ca.mcgill.mcb.pcingola.snpEffect.VariantEffect.getHgvsDna(VariantEffect.java:531)
[2016-01-27T11:30Z] 	at ca.mcgill.mcb.pcingola.vcf.VcfEffect.set(VcfEffect.java:1027)
[2016-01-27T11:30Z] 	at ca.mcgill.mcb.pcingola.vcf.VcfEffect.<init>(VcfEffect.java:145)
[2016-01-27T11:30Z] 	at ca.mcgill.mcb.pcingola.outputFormatter.VcfOutputFormatter.addInfo(VcfOutputFormatter.java:97)
[2016-01-27T11:30Z] 	at ca.mcgill.mcb.pcingola.outputFormatter.VcfOutputFormatter.toString(VcfOutputFormatter.java:285)
[2016-01-27T11:30Z] 	at ca.mcgill.mcb.pcingola.outputFormatter.OutputFormatter.endSection(OutputFormatter.java:112)
[2016-01-27T11:30Z] 	at ca.mcgill.mcb.pcingola.outputFormatter.VcfOutputFormatter.endSection(VcfOutputFormatter.java:229)
[2016-01-27T11:30Z] 	at ca.mcgill.mcb.pcingola.outputFormatter.OutputFormatter.printSection(OutputFormatter.java:145)
[2016-01-27T11:30Z] 	at ca.mcgill.mcb.pcingola.snpEffect.commandLine.SnpEffCmdEff.annotate(SnpEffCmdEff.java:276)
[2016-01-27T11:30Z] 	at ca.mcgill.mcb.pcingola.snpEffect.commandLine.SnpEffCmdEff.annotateVcf(SnpEffCmdEff.java:443)
[2016-01-27T11:30Z] 	at ca.mcgill.mcb.pcingola.snpEffect.commandLine.SnpEffCmdEff.annotate(SnpEffCmdEff.java:139)
[2016-01-27T11:30Z] 	at ca.mcgill.mcb.pcingola.snpEffect.commandLine.SnpEffCmdEff.run(SnpEffCmdEff.java:969)
[2016-01-27T11:30Z] 	at ca.mcgill.mcb.pcingola.snpEffect.commandLine.SnpEffCmdEff.run(SnpEffCmdEff.java:921)
[2016-01-27T11:30Z] 	at ca.mcgill.mcb.pcingola.snpEffect.commandLine.SnpEff.run(SnpEff.java:883)
[2016-01-27T11:30Z] 	at ca.mcgill.mcb.pcingola.snpEffect.commandLine.SnpEff.main(SnpEff.java:128)
[2016-01-27T11:30Z] Uncaught exception occurred
Traceback (most recent call last):
  File "/home/bwubb/bcbio-nextgen/anaconda/lib/python2.7/site-packages/bcbio/provenance/do.py", line 21, in run
    _do_run(cmd, checks, log_stdout)
  File "/home/bwubb/bcbio-nextgen/anaconda/lib/python2.7/site-packages/bcbio/provenance/do.py", line 95, in _do_run
    raise subprocess.CalledProcessError(exitcode, error_msg)
CalledProcessError: Command 'set -o pipefail; /home/bwubb/bcbio-tools/bin/snpEff -Xms750m -Xmx30720m -Djava.io.tmpdir=/home/bwubb/NGS/WGS_PCC-PGL/data/PP011-F1/work/structural/PP011-F1/manta/tx/tmp0Nsptl/tmp eff -dataDir /home/bwubb/bcbio-nextgen/genomes/Hsapiens/GRCh37/snpeff -cancer -noLog -i vcf -o vcf -s /home/bwubb/NGS/WGS_PCC-PGL/data/PP011-F1/work/structural/PP011-F1/manta/tumorSV-PP011-F1-effects-stats.html GRCh37.75 /home/bwubb/NGS/WGS_PCC-PGL/data/PP011-F1/work/structural/PP011-F1/manta/tumorSV-PP011-F1.vcf.gz | /home/bwubb/tabix-0.2.6/bgzip -c > /home/bwubb/NGS/WGS_PCC-PGL/data/PP011-F1/work/structural/PP011-F1/manta/tx/tmp0Nsptl/tumorSV-PP011-F1-effects.vcf.gz
ChrPosStats.sample(78):	Error counting samples on chromosome 'GL000210.1'. Position '27712' => count[277]  (count.length: 277, factor: 100, chrLength: 27682).
Error: Error while processing VCF entry (line 10156) :
...

I am not quite sure why/how this variant has  a Start=0 and and End=-1, but there are a few of this same error before it is killed. I believe this only occurred in 1 of 17 samples. Thanks.
-bwubb

Brad;
Sorry about the problem. I'm not sure what is going on here -- it seems like something in the Manta output triggers a boundary condition in snpEff. I thought from the output it was that the variant starts at the first position (1) but I couldn't reproduce just trying that. Would you be able to send me the offending variant to see if we can reproduce?
zgrep ^# /home/bwubb/NGS/WGS_PCC-PGL/data/PP011-F1/work/structural/PP011-F1/manta/tumorSV-PP011-F1.vcf.gz > snpeff-problem.vcf
zgrep 'MantaBND:231425:0:1:2:0:0:' /home/bwubb/NGS/WGS_PCC-PGL/data/PP011-F1/work/structural/PP011-F1/manta/tumorSV-PP011-F1.vcf.gz >> snpeff-problem.vcf

Thanks much for reporting the issue and hopefully we can get it squared away to keep your analysis going.

gist ok?
https://gist.github.com/bwubb/9c48d81b0d02bc96b48b
or I can attach here or email directly.

Brad;
Thanks for posting that gist, that helped to reproduce and isolate the problem. It looks like this was a bug in snpEff 4.1l, which has been fixed in the latest release 4.2. I updated the snpEff dependency, which will also require re-preparing your local snpEff databases to match the version change. If you update with:
bcbio_nextgen.py upgrade -u development --tools --data

it should annotate these calls cleanly. Sorry about all the issues and hope this gets your run finished cleanly.

Perhaps this is an unrelated issue, but I can not upgrade successfully. First was an exit code 4 from a bash script but I was able to run that manually. Now there is a 'perl: symbol lookup error'. I am contacting my HPC admin as well to check if this is their fault some how.
2016-02-08 12:04:40 (0.00 B/s) - “homo_sapiens_vep_83_GRCh37.tar.gz” saved [5047961760]
Traceback (most recent call last):
File "/home/bwubb/bcbio-tools/bin/bcbio_nextgen.py", line 207, in
install.upgrade_bcbio(kwargs["args"])
File "/home/bwubb/bcbio-nextgen/anaconda/lib/python2.7/site-packages/bcbio/install.py", line 89, in upgrade_bcbio
upgrade_bcbio_data(args, REMOTES)
File "/home/bwubb/bcbio-nextgen/anaconda/lib/python2.7/site-packages/bcbio/install.py", line 261, in upgrade_bcbio_data
_upgrade_vep_data(s["fabricrc_overrides"]["galaxy_home"], tooldir)
File "/home/bwubb/bcbio-nextgen/anaconda/lib/python2.7/site-packages/bcbio/install.py", line 297, in _upgrade_vep_data
effects.prep_vep_cache(dbkey, ref_file, tooldir)
File "/home/bwubb/bcbio-nextgen/anaconda/lib/python2.7/site-packages/bcbio/variation/effects.py", line 102, in prep_vep_cache
do.run("%s && %s" % (perl_exports, " ".join(cmd)), "Prepare VEP directory for %s" % ensembl_name)
File "/home/bwubb/bcbio-nextgen/anaconda/lib/python2.7/site-packages/bcbio/provenance/do.py", line 21, in run
_do_run(cmd, checks, log_stdout)
File "/home/bwubb/bcbio-nextgen/anaconda/lib/python2.7/site-packages/bcbio/provenance/do.py", line 95, in _do_run
raise subprocess.CalledProcessError(exitcode, error_msg)
subprocess.CalledProcessError: Command 'set -o pipefail; export PATH=/home/bwubb/bcbio-nextgen/anaconda/bin:$PATH && export PERL5LIB=/home/bwubb/bcbio-tools/lib/perl5:$PERL5LIB && /home/bwubb/bcbio-tools/bin/vep_install.pl -a c -s homo_sapiens_vep_83_GRCh37 -c /home/bwubb/bcbio-nextgen/genomes/Hsapiens/GRCh37/vep -u /home/bwubb/bcbio-nextgen/genomes/Hsapiens/GRCh37/vep/homo_sapiens/txtmp
perl: symbol lookup error: /home/bwubb/bcbio-tools/lib/perl5/x86_64-linux-thread-multi/auto/Time/HiRes/HiRes.so: undefined symbol: Perl_Istack_sp_ptr
' returned non-zero exit status 127

Brad;
Sorry about the problems. We're migrated to use a threaded version of Perl in bioconda/bcbio and it looks like you might have gotten caught with a non-threaded runtime. Could you try this workaround to see if it fixes it?
/home/bwubb/bcbio-nextgen/anaconda/bin/conda uninstall perl perl-threaded
bcbio_nextgen.py upgrade --tools

If so, I'll push this fix to the install to prevent the problem in the future. Thanks again for all the patience getting this going.

So it turns out I am still having issues with the OP, or something very similar.
[2016-02-25T19:02Z] Error: Error while processing VCF entry (line 5166) :
[2016-02-25T19:02Z] 	GL000241.1	1	MantaBND:194083:0:1:0:5:0:0	G	]GL000219.1:59505]G	.	MaxDepth	SVTYPE=BND;MATEID=MantaBND:194083:0:1:0:5:0:1;CIPOS=0,10;HOMLEN=10;HOMSEQ=ATCTGAAGAC;BND_DEPTH=101;MATE_BND_DEPTH=247;AC=0;AN=0	PR:SR	0,0:0,0
[2016-02-25T19:02Z] java.lang.RuntimeException: Interval error: end before start.
[2016-02-25T19:02Z] 	Class        : Marker
[2016-02-25T19:02Z] 	Start        : 0
[2016-02-25T19:02Z] 	End          : -1
[2016-02-25T19:02Z] 	ID           :
[2016-02-25T19:02Z] 	Parent class : Chromosome
[2016-02-25T19:02Z] 	Parent       : GL000241.1	0-42151 CHROMOSOME 'GL000241.1'
[2016-02-25T19:02Z] java.lang.RuntimeException: Interval error: end before start.
[2016-02-25T19:02Z] 	Class        : Marker
[2016-02-25T19:02Z] 	Start        : 0
[2016-02-25T19:02Z] 	End          : -1
[2016-02-25T19:02Z] 	ID           :
[2016-02-25T19:02Z] 	Parent class : Chromosome
[2016-02-25T19:02Z] 	Parent       : GL000241.1	0-42151 CHROMOSOME 'GL000241.1'
[2016-02-25T19:02Z] 	at ca.mcgill.mcb.pcingola.interval.Interval.<init>(Interval.java:38)
[2016-02-25T19:02Z] 	at ca.mcgill.mcb.pcingola.interval.Marker.<init>(Marker.java:37)
[2016-02-25T19:02Z] 	at ca.mcgill.mcb.pcingola.snpEffect.HgvsDna.isDuplication(HgvsDna.java:117)
[2016-02-25T19:02Z] 	at ca.mcgill.mcb.pcingola.snpEffect.HgvsDna.toString(HgvsDna.java:394)
[2016-02-25T19:02Z] 	at ca.mcgill.mcb.pcingola.snpEffect.VariantEffect.getHgvsDna(VariantEffect.java:544)
[2016-02-25T19:02Z] 	at ca.mcgill.mcb.pcingola.vcf.VcfEffect.set(VcfEffect.java:1043)
[2016-02-25T19:02Z] 	at ca.mcgill.mcb.pcingola.vcf.VcfEffect.<init>(VcfEffect.java:147)
[2016-02-25T19:02Z] 	at ca.mcgill.mcb.pcingola.outputFormatter.VcfOutputFormatter.addInfo(VcfOutputFormatter.java:97)
[2016-02-25T19:02Z] 	at ca.mcgill.mcb.pcingola.outputFormatter.VcfOutputFormatter.toString(VcfOutputFormatter.java:285)
[2016-02-25T19:02Z] 	at ca.mcgill.mcb.pcingola.outputFormatter.OutputFormatter.endSection(OutputFormatter.java:112)
[2016-02-25T19:02Z] 	at ca.mcgill.mcb.pcingola.outputFormatter.VcfOutputFormatter.endSection(VcfOutputFormatter.java:229)
[2016-02-25T19:02Z] 	at ca.mcgill.mcb.pcingola.outputFormatter.OutputFormatter.printSection(OutputFormatter.java:145)
[2016-02-25T19:02Z] 	at ca.mcgill.mcb.pcingola.snpEffect.commandLine.SnpEffCmdEff.annotate(SnpEffCmdEff.java:278)
[2016-02-25T19:02Z] 	at ca.mcgill.mcb.pcingola.snpEffect.commandLine.SnpEffCmdEff.annotateVcf(SnpEffCmdEff.java:446)
[2016-02-25T19:02Z] 	at ca.mcgill.mcb.pcingola.snpEffect.commandLine.SnpEffCmdEff.annotate(SnpEffCmdEff.java:138)
[2016-02-25T19:02Z] 	at ca.mcgill.mcb.pcingola.snpEffect.commandLine.SnpEffCmdEff.run(SnpEffCmdEff.java:984)
[2016-02-25T19:02Z] 	at ca.mcgill.mcb.pcingola.snpEffect.commandLine.SnpEffCmdEff.run(SnpEffCmdEff.java:939)
[2016-02-25T19:02Z] 	at ca.mcgill.mcb.pcingola.snpEffect.commandLine.SnpEff.run(SnpEff.java:978)
[2016-02-25T19:02Z] 	at ca.mcgill.mcb.pcingola.snpEffect.commandLine.SnpEff.main(SnpEff.java:136)
[2016-02-25T19:02Z] Uncaught exception occurred
Traceback (most recent call last):
  File "/home/bwubb/bcbio-nextgen/anaconda/lib/python2.7/site-packages/bcbio/provenance/do.py", line 21, in run
    _do_run(cmd, checks, log_stdout)
  File "/home/bwubb/bcbio-nextgen/anaconda/lib/python2.7/site-packages/bcbio/provenance/do.py", line 95, in _do_run
    raise subprocess.CalledProcessError(exitcode, error_msg)
CalledProcessError: Command 'set -o pipefail; /home/bwubb/bcbio-tools/bin/snpEff -Xms750m -Xmx30720m -Djava.io.tmpdir=/home/bwubb/NGS/WGS_PCC-PGL/data/PP236-F1/work/structural/PP236-F1/manta/tx/tmp7FpKxi/tmp eff -dataDir /home/bwubb/bcbio-nextgen/genomes/Hsapiens/GRCh37/snpeff -cancer -noLog -i vcf -o vcf -s /home/bwubb/NGS/WGS_PCC-PGL/data/PP236-F1/work/structural/PP236-F1/manta/tumorSV-PP236-F1-effects-stats.html GRCh37.75 /home/bwubb/NGS/WGS_PCC-PGL/data/PP236-F1/work/structural/PP236-F1/manta/tumorSV-PP236-F1.vcf.gz | /home/bwubb/tabix-0.2.6/bgzip -c > /home/bwubb/NGS/WGS_PCC-PGL/data/PP236-F1/work/structural/PP236-F1/manta/tx/tmp7FpKxi/tumorSV-PP236-F1-effects.vcf.gz```

That is how it starts. There are a few of those and then finally an exit code of 255. I have done all of the upgrades and unsets in this thread, and the other issues seem to have been resolved, but this one still remains. Thanks.

Brad;
Sorry about the continued problems. I'd hoped the upgrade to 4.2 would resolve the issues but it looks like there are still other problems. If we can generate a reproducible case again we can report upstream to the snpEff team to resolve. Could you do:
zgrep ^# /home/bwubb/NGS/WGS_PCC-PGL/data/PP236-F1/work/structural/PP236-F1/manta/tumorSV-PP236-F1-effects-stats.html GRCh37.75 /home/bwubb/NGS/WGS_PCC-PGL/data/PP236-F1/work/structural/PP236-F1/manta/tumorSV-PP236-F1.vcf.gz > snpeff-problem.vcf
zgrep 'MantaBND:194083:0:1:0:5:0' /home/bwubb/NGS/WGS_PCC-PGL/data/PP236-F1/work/structural/PP236-F1/manta/tumorSV-PP236-F1-effects-stats.html GRCh37.75 /home/bwubb/NGS/WGS_PCC-PGL/data/PP236-F1/work/structural/PP236-F1/manta/tumorSV-PP236-F1.vcf.gz >> snpeff-problem.vcf

and post the output as a gist again? We can try to put together a minimal example case from that for reporting. Thanks for the help debugging.

https://gist.github.com/bwubb/8b425c7a4bba244ea2d7
Much appreciated. Let me know what more I can do, I have a few samples from several projects that have a similar issue so I can always produce more debug data.

Brad;
Thanks for the reproducible case. I was able to isolate the problem to HGVS parsing and temporary disabled this for structural variant calls in bcbio to avoid the problem. I also reported the problem to Pablo (https://github.com/pcingola/SnpEff/issues/128). If you upgrade to the development version it should work cleanly for you now. Thanks again for all the help and patience.

I'm running into the same issue even though I'm running snpEff 4.2

Sorry about the issue. We're planning to move to snpEff 4.3 with a new release next week so hopefully that will resolve the underlying issue. If you want to fix it sooner you could do:
bcbio_conda install -c bioconda snpeff=4.3
bcbio_nextgen.py upgrade --data

which will move to snpEff 4.3 and then update the snpEff database files to match. Hope that fixes the problem for you.

So is snpEff 4.3 available? I downloaded the latest SnpEff and tried annotating again, but I got the same error message.  I could email my vcf to you and you could take a look at it; maybe that would help solve the problem.  Please let me know.

Brad- I will email the vcf to the email listed on your GitHub profile.  Thanks again for your help.

Rohit -- we do install snpEff 4.3 with bcbio now which has resolved the majority of these errors in all of our testing. If you do:
snpEff -version

does it report 4.3? If so, we can dig more into the cause of your issue with your VCF and try to come up with a reproducible error case. My suggestion would be to minimize your VCF to the lines that are breaking snpEff based on the error message and then post as a gist (http://gist.github.com/). Hope this helps.


CSVSearchTool seem like not functional

I test by  upload csv file that has like 7 record and when i ask about data in csv file it alway random pick  3 record to answer even i ask to give all the record info to me

temp.csv

same for me


Creating new instance based on interface definition dynamically does not work anymore for v2.2.0

TypeScript Version:  2.2.0
Code
export function CustomizationAnnotation() {

  return function <C extends Customization>(target: { new (...args: any[]): C; }): any {

    if (!isCustomization(target)) {
      throw new Error('CustomizationAnnotation can be only used for classes that implement Customization interface!');
    }

    let newTarget = new target();

    return target;
  };
}

function isCustomization(target: any | Customization): target is Customization {
  return (<Customization>target.prototype).getScope !== undefined;
}

export interface Customization {

  getScope(): Scope;

}

export class Scope {
}

tsconfig.json:
{
  "compilerOptions": {
    "target": "es5",
    "module": "system",
    "moduleResolution": "node",
    "sourceMap": true,
    "emitDecoratorMetadata": true,
    "experimentalDecorators": true,
    "removeComments": false,
    "noImplicitAny": true,
    "outDir": "dist/",
    "declaration": true,
    "baseUrl": "",
    "skipLibCheck": true,
    "typeRoots": [
      "../node_modules/@types",
      "node_modules/@types"
    ],
    "paths": {
      "rxjs/*": [
        "node_modules/rxjs"
      ],
      "@angular/*": [
        "node_modules/@angular"
      ]
    }
  },
  "exclude": [
    "node_modules",
    "typings/main",
    "typings/main.d.ts",
    "dist",
    "build",
    "index.d.ts"
  ]
}

Setup:
- project
-- node_modules
-- src
--- customization-annotation.ts
-- tsconfig.json
-- package.json

Expected behavior:
It should compile successfully as it did for e.g. version 2.1.5
Actual behavior:
I get the following compilation error when running > node node_modules/typescript/lib/tsc.js -p .:
src/customization-annotation.ts(9,21): error TS2351: Cannot use 'new' with an expression whose type lacks a call or construct signature.
Maybe I got this wrong, but I thought that by defining target as { new (...args: any[]): C; } I am saying target is a type that has a constructor? And furthermore, just the same code works fine with older TS versions (like 2.1.5).
The really interesting thing is that it does work when I remove the check for the interface (isCustomization()). For me it seems that this check suddenly overwrites the type of "target"...?
Edit:
Updated the code to be self contained. Added tsconfig.json. Updated error code. (We usually call the typescript compiler from a custom script and also do a custom printout of the errors, therefore the kindof unusual error message shown before)

How is Error defined? do you have a custom lib added?
This code compiler with no error locally (other than the missing modules). please provide a self contained reproduction of the issue.

I updated my report to contain more information. I hope it is now reproducible.

I tried again today with typescript@latest (v2.2.2) and I can still reproduce the error.
@mhegazy As you closed the ticket, is this intended behavior then? And if so, could you please explain why? Or point me to some documentation? Because for me this is a quite strange error and behavior...

Target is narrowed to a Customization as a result of the call to the function isCustomization.  Customization does not have a construct signature. I am guessing isCustomization should be defined as:
function isCustomization(target: any | Customization): target is { new (...args: any[]): Customization; } {
  return (<Customization>target.prototype).getScope !== undefined;
}

Thanks a lot - that did the trick! :)


feat(backend): add flag to config watch cache size

What type of PR is this?
Features
What this PR does / why we need it:
add flag to config watch cache size. It will be helpful for

limit memory usage
ensure that apiservers can watch successfully if cluster is very large

Which issue(s) this PR fixes:
None
Special notes for your reviewer:
None

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.


v1: possible false-positive for W3687

CloudFormation Lint Version
cfn-lint 1.3.0
What operating system are you using?
Windows 11
Describe the bug
After updating from v0.87.7 to v1.3.0 i noticed a new finding, which is possibly a false-positive:
  SecurityGroup:
    Type: AWS::EC2::SecurityGroup
    Properties:
      GroupDescription: "Security Group"
      VpcId: !ImportValue VPC1-VPC-ID
      SecurityGroupIngress:
        - Description: "Test"
          IpProtocol: TCP
          FromPort: 443
          ToPort: 443
          CidrIp: <IP_ADDRESS>/0

[cfn-lint] W3687: ['FromPort', 'ToPort'] are ignored when using 'IpProtocol' value 'TCP'

Expected behavior
Not entirely sure what the issue here is, but FromPort and ToPort are not ignored:
https://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/aws-properties-ec2-securitygroup-ingress.html
Reproduction template
AWSTemplateFormatVersion: 2010-09-09
Description: Test

Resources:
  SecurityGroup:
    Type: AWS::EC2::SecurityGroup
    Properties:
      GroupDescription: "Security Group"
      VpcId: !ImportValue VPC1-VPC-ID
      SecurityGroupIngress:
        - Description: "Test"
          IpProtocol: TCP
          FromPort: 443
          ToPort: 443
          CidrIp: <IP_ADDRESS>/0

TCP should be in lowercase

IpProtocol
The IP protocol name (tcp, udp, icmp, icmpv6) or number (see Protocol Numbers).
Use -1 to specify all protocols. When authorizing security group rules, specifying -1 or a protocol number other than tcp, udp, icmp, or icmpv6 allows traffic on all ports, regardless of any port range you specify. For tcp, udp, and icmp, you must specify a port range. For icmpv6, the port range is optional; if you omit the port range, traffic for all types and codes is allowed.

But AWS accept uppercase

TCP should be in lowercase

IpProtocol
The IP protocol name (tcp, udp, icmp, icmpv6) or number (see Protocol Numbers).
Use -1 to specify all protocols. When authorizing security group rules, specifying -1 or a protocol number other than tcp, udp, icmp, or icmpv6 allows traffic on all ports, regardless of any port range you specify. For tcp, udp, and icmp, you must specify a port range. For icmpv6, the port range is optional; if you omit the port range, traffic for all types and codes is allowed.

But AWS accept uppercase

Thank you, you are right. cfn-lint v1 doesn't like my uppercase TCP.

@r-heimann Yes, I notice the same in one of our templates but not all so I got confused first, then I saw it :)


Fixes for serde-yml

Changes

Closes #1121
Closes #1120
feat: look in pubspec.yaml for a flutter_rust_bridge config
docs: general improvements

Checklist

[x] An issue to be fixed by this PR is listed above.
[ ] New tests are added to ensure new features are working. End-to-end tests are usually in the ./frb_example/pure_dart example, more specifically, rust/src/api.rs and dart/lib/main.dart.
[ ] The code generator is run and the code is formatted (via just precommit).
[x] If this PR adds/changes features, documentations (in the ./book folder) are updated.
[x] CI is passing.

Remark for PR creator

Justfile is a task runner for the command line interface that allows you to run shell commands from a file named justfile in your project directory. You can use Justfile after installing it. Note that commands written in justfile of this repository are expected to be run in bash, not cmd or powershell. Running just ... commands in cmd or powershell will produce errors as the syntax is not compatible. On Windows, you can use git bash if you have Git installed.
If fzyzcjy does not reply for a few days, maybe he just did not see it, so please ping him.

Looks good! Ping me when ready for review :)

@fzyzcjy Should be good to review now

No nits, good job :)


fixed outer container (both height and width)

Hey Drew,
excuse me if this like the Enhancement-Issue (#30) but I'm not sure if it is.
it feels like your plugin is doing nearly what I need but I might not be capable of tweaking it accordingly.
What I need is a fixed height and width Container (100%, 100%) and an arbitrary number of elements is getting fitted into the area.
Imagine a Chessboard just with an arbitrary number of black and white fields.
To give you a real world example - we have a Screen here in our office showing some planning (from 5-15 elements) cards / tiles ... and the most important part is that all elements are shown.
and thx for your work, even if it'd turns out I can't use it :) :+1:
Marius

of course if anyone else has some tips for me I'd appreciate that :)

You could probably pull this off with some trickery... the issue is that Mason likes to fill the total space vs a specific space, if that makes sense.
You'll notice in the examples for promoted http://masonjs.com/#grid-c the grid stays the same configuration / size on every refresh. This is because the promoted elements are forcing their size thus creating a grid that never changes.
There could also be some tweaks made to the overall code to change it to use 100% x 100% but that would require some re-tooling and re-thinking around the layout algorithm.

ok, cool. then I guess I need to solve this different.
thx anyways so far.


Fixed Dropdown menu for mobile screen

Description
Fixes #193 - Dropdown button
Type of change

[ ] Bug fix (non-breaking change which fixes an issue)
[ ] User Interface

Checklist:

[ ] My code follows the style guidelines of this project
[ ] I have performed a self-review of my own code
[ ] My changes generate no new warnings

ScreenShots (if any)

please attach git/video.

https://user-images.githubusercontent.com/47476850/135657959-39015ce3-a049-4956-b739-9ea6e54aa35e.mp4

@Neeteshking21 This issue is assinged to you. Do you want to work on it or shall we proceed with this PR?

@kaiwalyakoparkar  yes I want to work on it
.


WIP: testing: runner: wrap stdin+stderr

This also helps with failures during testing, e.g. when using
pdb.set_tracce() somewhere inside the runner's isolation - likely
since it handles write already.
Ref: https://github.com/pallets/click/issues/824

https://github.com/pallets/click/issues/654 has a patch also (only for stdout), that might be simpler.
And see https://github.com/pallets/click/issues/371 for discussion about API changes/adjustments.

@blueyed I merged PR #868 - let's follow on with any changes from that. Thanks.


PriorityValue and PriorityLevel Memory Usage Optimization

Implemented optimization to only construct a dictionary for priority levels if there is more than one in use. This drops memory consumption in most applications by a reasonable amount since most don't use multiple bindings on single properties (like animation and a local binding).

This is a clever optimization! @wieslawsoltes @danwalmsley I'd be interested to see how much memory it saves in your apps.

An even cleverer optimization might be to add an IPriorityValue interface and have two implementations: one that contains just a single binding and the current one. But that would be a deeper change :D

I decided to do the optimization this way so we can generalize it later if we see similar memory performance characteristics with other dictionaries. I can also generalize this to collections and not just dictionaries. My goal was to only change PriorityValue to create a SingleOrDictionary and not make any functional code changes.

Yes, it makes sense to make the change small and self-contained. We can always revisit later if we decide it's worth it - was just putting it out there ;)

I agree 👍

By the way, do you have any figures as to the amount of memory saved?

On ControlCatalog.Desktop immediately after it initially shows onscreen, almost a 200kB difference. And the difference will only get larger the larger the application.
I don't have a chance to check out my oxyplot demo again, but the difference there is probably a little under 1MB.


fix: Use lookup instead of resolve to ensure consider /etc/hosts

Please provide a paragraph or two giving a summary of the change, including relevant motivation and context.
Checklist:
Remove the checklist to signal you've completed it. Enable auto-merge if the PR is ready to merge.

[ ] If the pull request requires a cryptography review (e.g. cryptographic algorithm implementations) I have added the 'crypto' tag.
[ ] I have reviewed my diff in github, line by line and removed unexpected formatting changes, testing logs, or commented-out code.
[ ] Every change is related to the PR description.
[ ] I have linked this pull request to relevant issues (if any exist).

Benchmark results
No metrics with a significant change found.

Detailed results
All benchmarks are run on txs on the Benchmarking contract on the repository. Each tx consists of a batch call  to create_note and increment_balance, which guarantees that each tx has a private call, a nested private call, a public call, and a nested public call, as well as an emitted private note, an unencrypted log, and public storage read and write.
This benchmark source data is available in JSON format on S3 here.
Values are compared against data from master at commit 912df7ee and shown if the difference exceeds 1%.
L2 block published to L1
Each column represents the number of txs on an L2 block published to L1.

Metric
8 txs
32 txs
128 txs

l1_rollup_calldata_size_in_bytes
45,444
179,588
716,132

l1_rollup_calldata_gas
222,948
867,764
3,449,912

l1_rollup_execution_gas
842,035
3,594,872
22,205,574

l2_block_processing_time_in_ms
1,339
5,094
21,185

note_successful_decrypting_time_in_ms
340
1,033 (-2%)
3,960 (+3%)

note_trial_decrypting_time_in_ms
51.4 (+1%)
42.3 (+16%)
137 (-4%)

l2_block_building_time_in_ms
13,520
53,660
217,787

l2_block_rollup_simulation_time_in_ms
9,992
39,726
161,693 (+1%)

l2_block_public_tx_process_time_in_ms
3,495
13,866
55,857

L2 chain processing
Each column represents the number of blocks on the L2 chain where each block has 16 txs.

Metric
5 blocks
10 blocks

node_history_sync_time_in_ms
15,752
29,502

note_history_successful_decrypting_time_in_ms
2,538 (-8%)
5,213 (+2%)

note_history_trial_decrypting_time_in_ms
86.5 (-47%)
135 (-8%)

node_database_size_in_bytes
3,911,595
4,254,329

pxe_database_size_in_bytes
29,940
59,499

Circuits stats
Stats on running time and I/O sizes collected for every circuit run across all benchmarks.

Circuit
circuit_simulation_time_in_ms
circuit_input_size_in_bytes
circuit_output_size_in_bytes

private-kernel-init
199
43,109
20,441

private-kernel-ordering
114
25,833
9,689

base-rollup
2,060
244,144
881

root-rollup
88.5 (+5%)
4,088
889

private-kernel-inner
260
64,516
20,441

public-kernel-private-input
171
25,203
20,441

public-kernel-non-first-iteration
170
25,245
20,441

merge-rollup
11.2
2,608
881

Miscellaneous
Transaction sizes based on how many contracts are deployed in the tx.

Metric
0 deployed contracts
1 deployed contracts

tx_size_in_bytes
10,323
26,359


Page Toolbar does not appear for editors if on a page they did not create

Experiencing an issue where editor accounts' web interface isn't displaying the toolbar when editing pages they themselves did not create. I'm on version 1.4.6.
Example Screenshot of Issue

good find, thank you, it is a very stupid bug/simply fix, because I checked for the right "edit", which does not exist, it should check for "update". I will create a hotfix for it and publish it in the next days...

published the fix with version <IP_ADDRESS>


Dev/fix logout

@kofj hi, how is this logout implemented?

@kofj hi, how is this logout implemented?

make the token expired that client used.


Support shell redirects

"smt run" should support running tools that read data from stdin and/or write data to stdout (also see ticket:104).
e.g.
{{{
$ a.out < input.dat > output.dat
}}}
I suggest something like:
{{{
smt run --stdin=input.dat --stdout=output.dat
}}}
Imported from Bitbucket issue 183,  created by apdavison on 05-31-2013 at 17:52, last modified: 05-31-2013 at 22:19

Implemented in r747
Trac comment by apdavison on 05-31-2013 at 22:19


second sample

So up to now, we have been saying that we want another databinding sample with network connection. Let's discuss the details of it.
-Are we using NewsApi ?
-How do we deal with network request? Retrofit? Raw http request?
-How will be the structure? Will we again show a list of items in recyclerview and a detail page?
-Normally, it is not good practice to make network request from main activity. It would be better to put it in ViewModel or a singleton Repository. But shall we avoid those for simplicity?

My ideas to those questions:

yes, we are going to use NewsAPI;
maybe Retrofit could be simple enough?
Could be the same. Thinking  if there is any reason to change? Do we want to show something more?
we could use ViewModel or Repository, I am not sure if we are going for simplicity or more for good practice:)

@OyaCanli @GretaGri yes, we'd be using NewsApi for that purpose. Retrofit is good but as the focus here is to help people on Databinding mainly, so even simple http call is also fine. We've things implemented in simple form already in the first sample and so now we can have one example with best practice now. That's what I think here.

I don't think retrofit is more complicated than making raw http request. But both are fine for me.
For a news app, I guess it makes sense to show articles in a list and then show individual articles in a details screen. Though, from the databinding perspective, its gonna have a similar structure to previous sample. The only interesting new think I can think of is to pass a boolean to the binding for differentiating loading states and using ternary operator to play with visibilities. And we'll use a binding adapter for loading images with Glide.
May be we can use a layout with include tag, in order to demonstrate how to reach a 'included' layout.
If we use a viewmodel, may be we can pass the viewmodel to databinding, instead of the item..

@OyaCanli the use of included tag would be a nice addition here. For the ViewModel part, I'm not sure how you plan to do that because I've not done deep diving on this topic but I'm sure that you two have done enough research and so it must be something nice. So please  go with what you find the best way there. For http request, I understand that, it's not easy itself but I've seen people working with it from beginning and so even if that's not easy, it look intuitive to them. Retrofit is really nice but people try it generally after already working with simple http request so maybe they'll find http request more natural to them :+1:

Ok. Let's go with http request. Frankly, I had found myself the underlying mechanisms of http request complicated as well. But it was a chunk of code that we could copy paste and reuse, so it was easy in that sense.
I have been playing with viewmodels for a while, I'm comfortable with that. For passing the viewmodel to databinding vs passing directly the item, I'm not sure whichis better in fact. I guess it depends on case. I have seen both in google samples. I'll check them out again and compare. And we'll discuss it more as the project takes shape and we know more details.

This sample is interesting: https://github.com/googlesamples/android-architecture/tree/todo-mvvm-databinding/todoapp/app/src

One interesting thing is the implementation of BaseObservable to make the binding update itself. But I think we can do it with livedata as well. Once we decide the details of project structure, I'm voluntary to experiment with it.

Looking at NewsApi, I see all articles have these attributes: source(name of journal), author, title, description, url(for the article), urlToImage, publishedAt, content.
For the list items, I guess we'll use titles, authors, images(thus image url), publishedAt, and may be also source. Description and content are long for list items. If we'll have a detail view for reading the article in app, we won't need article url. But we'll need description and content.
And if we'll have a detail view for in app reading, one question I'd ask is to whether it is better to parse all these data (including description and content) at once and then simply pass selected item to details screen, OR to exclude the description and content when parsing for the list and then parse whole contents only for the selected item in the details screen. (I mean, in order not to make a large unnecessary operation, since article contents can be very long)
But since this is only a sample, may be we simply limit the article numbers and don't worry about these details?

@GretaGri @rajtheinnovator Shall we finalize the structure of the app and share tasks to begin working?
-Two fragments: one with list and one with details seems ok? (Have you read my concerns above)
-Shall we use a fix simple query, like 8 or 10 articles in a given topic(may be tech?)
@GretaGri Do you want to again design layouts and reuse them on kotlin version? Or do you want to do something else this time?

I can work again with layouts and with Kotin codes.

Ok, that sounds good @GretaGri.
I assume we'll have again a single activity with two fragments, one fragment with a list, one fragment with details?
Something different may be a loading indicator and no network image/message besides recyclerview.

Shall we let you first make the layouts then @GretaGri ? Will you have time for that in the following days, for example? Otherwise I can make some parts without UI..

Ok, great @GretaGri. Yeah, I was thinking the same. I can work on different parts. Since we'll be working on different files, it won't be difficult to merge. Is it ok @rajTheInnovator ?

Yeah, I do think it's all fine. There should not be any issue when merging it. And obviously the approach looks good as this way we can avoid any delay and keep working on it continuously.

@rajtheinnovator @GretaGri I worked on this today and added the parts not related to UI. I made a PR. I'll continue with the rest after Greta adds the layouts.
I wonder something: I get this "Asynctask should be static.." warning. But the asynctask is inside the singleton repository, not inside the activity. Is there still a risk of memory leak?

@OyaCanli  if we're having something singleton, that's one of the best way to avoid memory leaks but if you'd like to really see in action if there is any memory leak, there is an awesome library which I like to use and you can check that yourself. Here's that: https://github.com/square/leakcanary. So give it a go and let me know what you find there.

Thanks @rajtheinnovator ! I had heard LeakCanary, but haven't tried yet. I'll discover that when I have time.
I have a pending PR by the way.

@OyaCanli you can ask for any help if needed for LeakCanary, but I guess you can do that easily as it's not that tricky to use.

@rajtheinnovator I tried out LeakCanary. No leaks are seen in our simple sample.
Though? I can see lots of leaks in another app of mine 😅 Thanks for this tip! I didn't know it was that simple to use.

That's great you found it helpful, @OyaCanli I too found that this helped me realize how and where the problems are in other parts of my various projects. Definitely a thing to have in our development toolbox :)

@GretaGri I'm working on the second sample and once the data began to come from the api, the apperance of the layouts seem different than your intended designs. Titles are long and seem so huge all together. Sometimes authors are long.. And I felt the need to change some fields: descriptions are long for list items, so I want to remove them from there and add to details screen. And I want to seperate date and time either with an empty space or with a new line, or as two textboxes. So I'll make some adjustments in the layouts if you don't mind. You'll look at later and make further adjustments again if you wish, ok?


date formatting change for Safari

Someone just alerted me that the Maptime Chicago "upcoming events" box was showing "TBD" despite an upcoming event this week. I looked into it and, while Chrome and Firefox were working fine, Safari was indeed showing "TBD."

After some poking around, it seems that Safari does not like dashes is a-ok with slashes. The proposed change is to go from yyyy-MM-dd to yyyy/MM/dd. I've made this change to the Maptime Chicago site and it is now working in Chrome, FF and Safari.

:+1:

Hey @danswick: Want to make the appropriate changes to the Readme?
Also, this seems like a fine solution going forward but is going to introduce errors for those with existing sites that pull in upstream changes from this repo unless they rename all of their existing posts.

@geobrando, this just changes the way the item.date variable is parsed when determining whether there's an upcoming event. Post filenames should all be a-ok as they are.
The issue was that the date variable:
date = '{{item.date | date:"%Y,%-m,%-d"}}';

becomes 2014,6,22, which Safari can't parse.
Does that help or did I misunderstand your comment?

@danswick Ah.  I glanced at it.  I get it now.  Thanks.

No prob, @geobrando! Doesn't help that I typed the original date format wrong in my PR description. D'oh!


double click selects word, not the path

Hi,
Thank you for the great tool!
One issue I have switching from the other terminals is: When I double click on the file name with a path like foo lib/index.js bar I get only word index selected. In other terminals I got all lib/index.js path part selected.

Thanks, I'll take a look when I have a chance.


Error when parsing the American Constitution with spacy

I'm trying to run the parse using spacy on the American Constitution (https://pastebin.com/Ss2MWFVr) with this code:
import spacy
from benepar.spacy_plugin import BeneparComponent

nlp = spacy.load('en')
nlp.add_pipe(BeneparComponent("benepar_en"))

nlp(american_constitution_text)

I'm getting an error - the error is different for using CPU or GPU. I've also tried longer text, and there is no problem. If I remove nlp.add_pipe(BeneparComponent("benepar_en")), it works.
CPU Error
---------------------------------------------------------------------------
InvalidArgumentError                      Traceback (most recent call last)
/usr/local/lib/python3.5/dist-packages/tensorflow/python/client/session.py in _do_call(self, fn, *args)
   1321     try:
-> 1322       return fn(*args)
   1323     except errors.OpError as e:

/usr/local/lib/python3.5/dist-packages/tensorflow/python/client/session.py in _run_fn(feed_dict, fetch_list, target_list, options, run_metadata)
   1306       return self._call_tf_sessionrun(
-> 1307           options, feed_dict, fetch_list, target_list, run_metadata)
   1308

/usr/local/lib/python3.5/dist-packages/tensorflow/python/client/session.py in _call_tf_sessionrun(self, options, feed_dict, fetch_list, target_list, run_metadata)
   1408           self._session, options, feed_dict, fetch_list, target_list,
-> 1409           run_metadata)
   1410     else:

InvalidArgumentError: indices[2590] = 29134 is not in [0, 19200)
	 [[Node: GatherV2_1 = GatherV2[Taxis=DT_INT32, Tindices=DT_INT32, Tparams=DT_FLOAT, _device="/job:localhost/replica:0/task:0/device:CPU:0"](Tile, ToInt32, GatherV2_8/axis)]]

During handling of the above exception, another exception occurred:

InvalidArgumentError                      Traceback (most recent call last)
<ipython-input-10-aeb678c45aba> in <module>()
----> 1 nlp_only_parsing(PROBLEMATIC_TEXT)

~/.local/lib/python3.5/site-packages/spacy/language.py in __call__(self, text, disable)
    350             if not hasattr(proc, '__call__'):
    351                 raise ValueError(Errors.E003.format(component=type(proc), name=name))
--> 352             doc = proc(doc)
    353             if doc is None:
    354                 raise ValueError(Errors.E005.format(name=name))

~/.local/lib/python3.5/site-packages/benepar/spacy_plugin.py in __call__(self, doc)
     75     def __call__(self, doc):
     76         constituent_data = PartialConstituentData()
---> 77         for parse_raw, sent in self._batched_parsed_raw(self._process_doc(doc)):
     78             # The optimized cython decoder implementation doesn't actually
     79             # generate trees, only scores and span indices. Indices follow a

~/.local/lib/python3.5/site-packages/benepar/base_parser.py in _batched_parsed_raw(self, sentence_data_pairs)
    220             batch_data.append(datum)
    221             if len(batch_sentences) >= self.batch_size:
--> 222                 for chart_np, datum in zip(self._make_charts(batch_sentences), batch_data):
    223                     yield chart_decoder.decode(chart_np), datum
    224                 batch_sentences = []

~/.local/lib/python3.5/site-packages/benepar/base_parser.py in _make_charts(self, sentences)
    203     def _make_charts(self, sentences):
    204         inp_val = self._charify(sentences)
--> 205         out_val = self._sess.run(self._charts, {self._chars: inp_val})
    206         for snum, sentence in enumerate(sentences):
    207             chart_size = len(sentence) + 1

/usr/local/lib/python3.5/dist-packages/tensorflow/python/client/session.py in run(self, fetches, feed_dict, options, run_metadata)
    898     try:
    899       result = self._run(None, fetches, feed_dict, options_ptr,
--> 900                          run_metadata_ptr)
    901       if run_metadata:
    902         proto_data = tf_session.TF_GetBuffer(run_metadata_ptr)

/usr/local/lib/python3.5/dist-packages/tensorflow/python/client/session.py in _run(self, handle, fetches, feed_dict, options, run_metadata)
   1133     if final_fetches or final_targets or (handle and feed_dict_tensor):
   1134       results = self._do_run(handle, final_targets, final_fetches,
-> 1135                              feed_dict_tensor, options, run_metadata)
   1136     else:
   1137       results = []

/usr/local/lib/python3.5/dist-packages/tensorflow/python/client/session.py in _do_run(self, handle, target_list, fetch_list, feed_dict, options, run_metadata)
   1314     if handle is None:
   1315       return self._do_call(_run_fn, feeds, fetches, targets, options,
-> 1316                            run_metadata)
   1317     else:
   1318       return self._do_call(_prun_fn, handle, feeds, fetches)

/usr/local/lib/python3.5/dist-packages/tensorflow/python/client/session.py in _do_call(self, fn, *args)
   1333         except KeyError:
   1334           pass
-> 1335       raise type(e)(node_def, op, message)
   1336
   1337   def _extend_graph(self):

InvalidArgumentError: indices[2590] = 29134 is not in [0, 19200)
	 [[Node: GatherV2_1 = GatherV2[Taxis=DT_INT32, Tindices=DT_INT32, Tparams=DT_FLOAT, _device="/job:localhost/replica:0/task:0/device:CPU:0"](Tile, ToInt32, GatherV2_8/axis)]]

Caused by op 'GatherV2_1', defined at:
  File "/usr/lib/python3.5/runpy.py", line 184, in _run_module_as_main
    "__main__", mod_spec)
  File "/usr/lib/python3.5/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/usr/local/lib/python3.5/dist-packages/ipykernel_launcher.py", line 16, in <module>
    app.launch_new_instance()
  File "/usr/local/lib/python3.5/dist-packages/traitlets/config/application.py", line 658, in launch_instance
    app.start()
  File "/usr/local/lib/python3.5/dist-packages/ipykernel/kernelapp.py", line 486, in start
    self.io_loop.start()
  File "/usr/local/lib/python3.5/dist-packages/tornado/platform/asyncio.py", line 127, in start
    self.asyncio_loop.run_forever()
  File "/usr/lib/python3.5/asyncio/base_events.py", line 345, in run_forever
    self._run_once()
  File "/usr/lib/python3.5/asyncio/base_events.py", line 1312, in _run_once
    handle._run()
  File "/usr/lib/python3.5/asyncio/events.py", line 125, in _run
    self._callback(*self._args)
  File "/usr/local/lib/python3.5/dist-packages/tornado/ioloop.py", line 759, in _run_callback
    ret = callback()
  File "/usr/local/lib/python3.5/dist-packages/tornado/stack_context.py", line 276, in null_wrapper
    return fn(*args, **kwargs)
  File "/usr/local/lib/python3.5/dist-packages/zmq/eventloop/zmqstream.py", line 536, in <lambda>
    self.io_loop.add_callback(lambda : self._handle_events(self.socket, 0))
  File "/usr/local/lib/python3.5/dist-packages/zmq/eventloop/zmqstream.py", line 450, in _handle_events
    self._handle_recv()
  File "/usr/local/lib/python3.5/dist-packages/zmq/eventloop/zmqstream.py", line 480, in _handle_recv
    self._run_callback(callback, msg)
  File "/usr/local/lib/python3.5/dist-packages/zmq/eventloop/zmqstream.py", line 432, in _run_callback
    callback(*args, **kwargs)
  File "/usr/local/lib/python3.5/dist-packages/tornado/stack_context.py", line 276, in null_wrapper
    return fn(*args, **kwargs)
  File "/usr/local/lib/python3.5/dist-packages/ipykernel/kernelbase.py", line 283, in dispatcher
    return self.dispatch_shell(stream, msg)
  File "/usr/local/lib/python3.5/dist-packages/ipykernel/kernelbase.py", line 233, in dispatch_shell
    handler(stream, idents, msg)
  File "/usr/local/lib/python3.5/dist-packages/ipykernel/kernelbase.py", line 399, in execute_request
    user_expressions, allow_stdin)
  File "/usr/local/lib/python3.5/dist-packages/ipykernel/ipkernel.py", line 208, in do_execute
    res = shell.run_cell(code, store_history=store_history, silent=silent)
  File "/usr/local/lib/python3.5/dist-packages/ipykernel/zmqshell.py", line 537, in run_cell
    return super(ZMQInteractiveShell, self).run_cell(*args, **kwargs)
  File "/usr/local/lib/python3.5/dist-packages/IPython/core/interactiveshell.py", line 2662, in run_cell
    raw_cell, store_history, silent, shell_futures)
  File "/usr/local/lib/python3.5/dist-packages/IPython/core/interactiveshell.py", line 2785, in _run_cell
    interactivity=interactivity, compiler=compiler, result=result)
  File "/usr/local/lib/python3.5/dist-packages/IPython/core/interactiveshell.py", line 2903, in run_ast_nodes
    if self.run_code(code, result):
  File "/usr/local/lib/python3.5/dist-packages/IPython/core/interactiveshell.py", line 2963, in run_code
    exec(code_obj, self.user_global_ns, self.user_ns)
  File "<ipython-input-9-6f0432446d27>", line 6, in <module>
    nlp_only_parsing.add_pipe(BeneparComponent("benepar_en"))
  File "/home/users/shlohod/.local/lib/python3.5/site-packages/benepar/spacy_plugin.py", line 73, in __init__
    super(BeneparComponent, self).__init__(filename, batch_size)
  File "/home/users/shlohod/.local/lib/python3.5/site-packages/benepar/base_parser.py", line 163, in __init__
    tf.import_graph_def(graph_def, name='')
  File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/util/deprecation.py", line 432, in new_func
    return func(*args, **kwargs)
  File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/framework/importer.py", line 513, in import_graph_def
    _ProcessNewOps(graph)
  File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/framework/importer.py", line 303, in _ProcessNewOps
    for new_op in graph._add_new_tf_operations(compute_devices=False):  # pylint: disable=protected-access
  File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/framework/ops.py", line 3540, in _add_new_tf_operations
    for c_op in c_api_util.new_tf_operations(self)
  File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/framework/ops.py", line 3540, in <listcomp>
    for c_op in c_api_util.new_tf_operations(self)
  File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/framework/ops.py", line 3428, in _create_op_from_tf_operation
    ret = Operation(c_op, self)
  File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/framework/ops.py", line 1718, in __init__
    self._traceback = self._graph._extract_stack()  # pylint: disable=protected-access

InvalidArgumentError (see above for traceback): indices[2590] = 29134 is not in [0, 19200)
	 [[Node: GatherV2_1 = GatherV2[Taxis=DT_INT32, Tindices=DT_INT32, Tparams=DT_FLOAT, _device="/job:localhost/replica:0/task:0/device:CPU:0"](Tile, ToInt32, GatherV2_8/axis)]]

GPU Error
---------------------------------------------------------------------------
ResourceExhaustedError                    Traceback (most recent call last)
/usr/local/lib/python3.5/dist-packages/tensorflow/python/client/session.py in _do_call(self, fn, *args)
   1321     try:
-> 1322       return fn(*args)
   1323     except errors.OpError as e:

/usr/local/lib/python3.5/dist-packages/tensorflow/python/client/session.py in _run_fn(feed_dict, fetch_list, target_list, options, run_metadata)
   1306       return self._call_tf_sessionrun(
-> 1307           options, feed_dict, fetch_list, target_list, run_metadata)
   1308

/usr/local/lib/python3.5/dist-packages/tensorflow/python/client/session.py in _call_tf_sessionrun(self, options, feed_dict, fetch_list, target_list, run_metadata)
   1408           self._session, options, feed_dict, fetch_list, target_list,
-> 1409           run_metadata)
   1410     else:

ResourceExhaustedError: OOM when allocating tensor of shape [1024,16384] and type float
	 [[Node: ConstantFolding/bilm/RNN_0/RNN/MultiRNNCell/Cell1/rnn/lstm_cell/kernel_enter = Const[dtype=DT_FLOAT, value=Tensor<type: float shape: [1024,16384] values: [0.0838829875 0.0388401747 0.173968613]...>, _device="/job:localhost/replica:0/task:0/device:GPU:0"](^bilm/RNN_0/RNN/MultiRNNCell/Cell1/rnn/while/lstm_cell/MatMul/Enter)]]

During handling of the above exception, another exception occurred:

ResourceExhaustedError                    Traceback (most recent call last)
<ipython-input-3-8f26748b155f> in <module>()
      5 nlp.add_pipe(BeneparComponent("benepar_en"))
      6
----> 7 nlp(american)

~/.local/lib/python3.5/site-packages/spacy/language.py in __call__(self, text, disable)
    350             if not hasattr(proc, '__call__'):
    351                 raise ValueError(Errors.E003.format(component=type(proc), name=name))
--> 352             doc = proc(doc)
    353             if doc is None:
    354                 raise ValueError(Errors.E005.format(name=name))

~/.local/lib/python3.5/site-packages/benepar/spacy_plugin.py in __call__(self, doc)
     75     def __call__(self, doc):
     76         constituent_data = PartialConstituentData()
---> 77         for parse_raw, sent in self._batched_parsed_raw(self._process_doc(doc)):
     78             # The optimized cython decoder implementation doesn't actually
     79             # generate trees, only scores and span indices. Indices follow a

~/.local/lib/python3.5/site-packages/benepar/base_parser.py in _batched_parsed_raw(self, sentence_data_pairs)
    220             batch_data.append(datum)
    221             if len(batch_sentences) >= self.batch_size:
--> 222                 for chart_np, datum in zip(self._make_charts(batch_sentences), batch_data):
    223                     yield chart_decoder.decode(chart_np), datum
    224                 batch_sentences = []

~/.local/lib/python3.5/site-packages/benepar/base_parser.py in _make_charts(self, sentences)
    203     def _make_charts(self, sentences):
    204         inp_val = self._charify(sentences)
--> 205         out_val = self._sess.run(self._charts, {self._chars: inp_val})
    206         for snum, sentence in enumerate(sentences):
    207             chart_size = len(sentence) + 1

/usr/local/lib/python3.5/dist-packages/tensorflow/python/client/session.py in run(self, fetches, feed_dict, options, run_metadata)
    898     try:
    899       result = self._run(None, fetches, feed_dict, options_ptr,
--> 900                          run_metadata_ptr)
    901       if run_metadata:
    902         proto_data = tf_session.TF_GetBuffer(run_metadata_ptr)

/usr/local/lib/python3.5/dist-packages/tensorflow/python/client/session.py in _run(self, handle, fetches, feed_dict, options, run_metadata)
   1133     if final_fetches or final_targets or (handle and feed_dict_tensor):
   1134       results = self._do_run(handle, final_targets, final_fetches,
-> 1135                              feed_dict_tensor, options, run_metadata)
   1136     else:
   1137       results = []

/usr/local/lib/python3.5/dist-packages/tensorflow/python/client/session.py in _do_run(self, handle, target_list, fetch_list, feed_dict, options, run_metadata)
   1314     if handle is None:
   1315       return self._do_call(_run_fn, feeds, fetches, targets, options,
-> 1316                            run_metadata)
   1317     else:
   1318       return self._do_call(_prun_fn, handle, feeds, fetches)

/usr/local/lib/python3.5/dist-packages/tensorflow/python/client/session.py in _do_call(self, fn, *args)
   1333         except KeyError:
   1334           pass
-> 1335       raise type(e)(node_def, op, message)
   1336
   1337   def _extend_graph(self):

ResourceExhaustedError: OOM when allocating tensor of shape [1024,16384] and type float
	 [[Node: ConstantFolding/bilm/RNN_0/RNN/MultiRNNCell/Cell1/rnn/lstm_cell/kernel_enter = Const[dtype=DT_FLOAT, value=Tensor<type: float shape: [1024,16384] values: [0.0838829875 0.0388401747 0.173968613]...>, _device="/job:localhost/replica:0/task:0/device:GPU:0"](^bilm/RNN_0/RNN/MultiRNNCell/Cell1/rnn/while/lstm_cell/MatMul/Enter)]]

Thanks for reporting!
The issue here is due to Section 8, which is a single (very long) sentence. The parser was not trained on sentences of this length, and there is a hard-coded limit of 300 words per sentence.
I'll work on updating the code to throw a more understandable error in this situation.
Unfortunately I don't see a straightforward way to relax the length restriction. The training sentences are much shorter (most are less than 40 words long), and the way word positions are represented in the parser has theoretical issues with generalizing to longer lengths. Moreover, the memory used by decoding algorithm scales as the square of the sentence length, which is why you are seeing OOM (out-of-memory) errors on GPU.
I'll think about what to do in these situations, but for now my recommendation would be to modify the text in some way to omit super-long sentences. For example, you can take turns deleting some of the "To ...;" lines and parsing the rest, and then combine everything to build a parse tree.

Thanks!

Just as an addition: it's always a good idea to set some limits on sentence lengths - often with a minimum as well as maximum length. (e.g. 3 - 150)


attr: syntax doesn't work in server-side rendering

Describe the bug
Solid's attr: syntax broken is broken in astro:
https://stackblitz.com/edit/github-vunq7y?file=src%2Fcomponents%2FSolidComponent.tsx
The funny thing is that locally after triggering HMR by updating a file it does work. It just doesn't work on first render.
It works outside of astro:
https://playground.solidjs.com/anonymous/3fc352bc-7d8d-4031-b510-4ae5ceca35c0
@ryansolid already identified this as a general bug in the server-side rendering of solid.
Just opening an issue here to keep track, so it doesn't get lost in the middle of all the 2.0 work.

Initially opened it on astro's side, but that one is already closed.
https://github.com/withastro/astro/issues/11792

Thank you so much for spending time on this. From the commit history it looks like this landed in 1.8.22?
Unfortunately it still doesn't seem to work: https://stackblitz.com/edit/github-vunq7y?file=package.json

Make sure that the babel plugin is the latest version. Like is babel-preset-solid also 1.8.22. This is a compiler bug I believe. It appears in that project you like you have 1.8.19 installed. Blow out your lockfile, remove and re-install node modules.

You're right :) With an override it works:
package.json
{
  ...
  "overrides": {
    "babel-preset-solid": "1.8.22"
  },
  ...
}


404 on loading webthreads.js

GET http://localhost:8000/genie.jl/master/assets/js/itllhykhbznmdrytqcbbvolcmvmiivbv/webthreads.js net::ERR_ABORTED 404 (Not Found)
MWE is from README with one change:
-: model = Stipple.init(Name(), transport = Genie.WebThreads)
+:model = Stipple.init(Name, transport=Genie.WebThreads)

using Genie.Renderer.Html, Stipple

Genie.config.log_requests = false

@reactive mutable struct Name <: ReactiveModel
    name::R{String} = "World!"
end

function ui(model)
    page(model, class="container",
        [
        h1([
            "Hello "
            span("", @text(:name))
        ]) p([
            "What is your name? "
            input("", placeholder="Type your name", @bind(:name))
        ])
    ]
    )
end

route("/") do
    model = Stipple.init(Name, transport=Genie.WebThreads)
    html(ui(model), context=@__MODULE__)
end

isrunning(:webserver) || up()

Edit: put code qutation marks
@hhaensel any idea how get that fixed or work around? It blocks my work on Gitpod, can't use websockets there.

duplicate of https://github.com/GenieFramework/Genie.jl/issues/547


Booting a bare metal solution

Hello,
is it possible to boot a bare metal solution instead of booting the Linux on the IOT2050 GP?
Where the entry point of this solution has to be located?

You can easily boot everything that U-Boot is capable of booting. U-Boot is set up to use distro boot by default, but you can reconfigure its environment to load you own binaries according to their needs.
Note, though, that baremetal will mean you have first of all zero support for the SOC - unless you find a runtime or RTOS which is enabled for it. And then comes the specifics of the IOT2050, basically what we encoded in the device trees.
What is your use case?

We have all the stuff we need running well in a bare metal approach on the TMDX654IDKEVM (booting directly from the SD-Card). Only the internal memory of the AM65xx is used, not the DDR.
The next step is to get it run on the IOT2050. So if we rename the binary as requested in the IOT2050 namespace this should be enough? Are there any restrictions regarding locating the entry point or the used memory space beside the common restrictions of the AM65xx?

How is the boot process on the EVM? Is your binary acting as first-stage bootloader as well, or is there also U-Boot, TF-A etc. in the loop?
The former case would not be officially supported. It would not be possible on the advanced due to secure boot. It would be theoretically possible on the basic but it might be an enormous effort to get things working, given potential differences between the EVM and our hardware.

No, the binary is not acting as a first stage bootloader. For this we are using the tiboot3.bin and sysfw.bin coming with the SDK. The binary I talk about is "only" the application including a bare metal runtime environment using a minimum of the hardware (Ethernet MACs, UART, digital IO). Secure Boot should be no issue because we're using the IOT2050 GP.

tiboot3.bin should be loading tispl.bin for the next stage. On the IOT2050, this is located on the SPI flash, see also https://github.com/siemens/u-boot/blob/jan/iot2050/arch/arm/dts/k3-am65-iot2050-boot-image.dtsi. You could try to replace that, but that only makes sense if you have a flash programmer as well, so that you can recover the likely initially bricked device.
Maybe you can also load your binary from U-Boot. That would allow using an easier reprogrammable medium.Try digging into that first.

Is it possible to get the *.pinmux file of the IOT2050 GP?


JSdoc style for prop types

Want feedback on this type of comment for documentation

An argument for using the JSDoc style is that VSCode recognizes those type definitions and renders them pretty. But we should also think about how ugly our prop types are (see StoryData, StoryObject).

Merged into noauth


Script for validating the efficiency of duplicate objects

This PR includes a validation script to print info on the duplication of matching in the sim track, TC, pT5, pT3 and T5 collections.

Closing this PR to open a new one with clean history.


SqlStorage ignores statements separated by semicolon

Hi guys!
I have some issues with SqlStorage.
Multiple statements in one query
I want to execute a huge amount of INSERT statements at once (~30k of data) like a bulk. Therefore I created a huge string (multiple INSERT statements) which includes all of these data and execute it in only one query (because if I run query for each row, it will never be finished. When I try to execute the SQL statement, it executes successfully, but it inserts only first row and ignores the others.
Separate statements in query with semicolon ";"
I would like to use multiple SQL statements in one query or to use some transactions or something.
Steps to reproduce:

Just execute two INSERT statements like this: "INSERT INTO table (col1, col2) VALUES (1, 5); INSERT INTO table (col1, col2) VALUES (6, 7);"

Which Ionic Version? 1.x or 2.x
2
Run ionic info from terminal/cmd prompt: (paste output below)
Your system information:
Cordova CLI: 6.1.1
Gulp version:  CLI version 1.2.1
Gulp local:   Local version 3.9.1
Ionic Version: 2.0.0-beta.9
Ionic CLI Version: 2.0.0-beta.23
Ionic App Lib Version: 2.0.0-beta.13
OS: Distributor ID:	LinuxMint Description:	Linux Mint 17.3 Rosa
Node Version: v4.4.2
Thank you very much!

Hello! Thanks for opening an issue with us! As this seems like more of a support question of how to do something i will urge that you ask this question on our forum (forum.ionicframework.com). Thanks for using Ionic!


[9.1.x] Encoding backport

Backport of encoding related issues from master
https://issues.jboss.org/browse/ISPN-8004
https://issues.jboss.org/browse/ISPN-8349
https://issues.jboss.org/browse/ISPN-8350
https://issues.jboss.org/browse/ISPN-8368

The failures are not related (elastic search failure happened on master), triggering another build

Could you rebase this please? Btw, CI crashed again.

rebased

Build is fine apparently, it crashed in the osgi fork:
Unable to load category: stress
Is this something fixed on master @danberindei ?

@gustavonalle yes, Tristan fixed it on master with https://github.com/infinispan/infinispan/pull/5472/files, cherry-picking to 9.1.x

@gustavonalle please rebase

@danberindei there's nothing to rebase

@anistor actually since all the other modules seem fine I think it can be integrated as is, unless you have more comments.

This is merged in 9.1.x. Thanks @gustavonalle and @danberindei !

@anistor Is it integrated? Can't see the commits https://github.com/infinispan/infinispan/commits/9.1.x

I think I forgot to push it :) It's in now!


feat: implementation of useWatchContractEvent for Vue

Closes #4245 / #4246
Highly naive implementation -- it doesn't seem to work fully, testing is kinda horrible at the moment.
It does seem to periodically poll (testing with https://etherscan.io/token/0xa0b86991c6218b36c1d19d4a2e9eb0ce3606eb48 ) but there doesn't seem to be proper response(s).
Request (sends out every 5 seconds or so):

Response (no result, incrementing id each time):

Closing in favor of https://github.com/wevm/wagmi/pull/4252


hub breaks git when GIT_TRACE is used

[eschwartz@arch ~/git/projectname]$ /usr/bin/git config --get alias.new
log --pretty=fuller -p @{1}..@{0}
[eschwartz@arch ~/git/projectname]$ GIT_TRACE=1 HUB_VERBOSE=1 hub new >/dev/null
$ git config alias.new
$ git help --no-verbose -a
$ git 18:48:21.913636 git.c:419 trace: built-in: git config alias.new
18:48:21.924560 git.c:670               trace: exec: git-18:48:21.913636 git.c:419 trace: built-in: git config alias.new
18:48:21.924676 run-command.c:643       trace: run_command: git-18:48:21.913636 git.c:419 trace: built-in: git config alias.new
git: '18:48:21.913636' is not a git command. See 'git --help'.

The heuristic parsing which hub is doing, has grabbed git's internal trace messages and inserted it into the attempted command, causing everything to become invalid.

Note that this only seems to affect alias expansion, not builtin commands.


Hello Max,

Hello Max I Need Your Permission to Use your Plugin In Mine

Look at the license, you are allowed to edit and redistribute the plugin. However, poggit won’t let you publish it unless you make significant changes. Contact me on discord at @maxjk if you want to discuss making another plugin, this is not the place for that.