Missing port route for external LB ?

After the fresh installation via Azure Portal I'm able to connect to Kibana, but not for Elastc instance (getting timeout on port 9200 for external load balancer IP).
I was able to get response on Kibana instance from <IP_ADDRESS>:9200 (internal elastic LB) but not from <IP_ADDRESS>:9201. How to check if everything is configured properly ?

It sounds like the port forwarding rules on the Elasticsearch nodes may not have been applied successfully.
The external load balancer sends traffic to the backend pool on port 9201 which is re-routed to 9200 on the VMs to process, then re-routed back out on 9201 back to the external load balancer.
If you ssh into one of the elasticsearch nodes via kibana e.g. data-0, and run
cat /etc/iptables/rules.v4
cat /etc/iptables/rules.v6

What do you see?

@russcam thank you for the fast response :)
I miss the fact that internal load balancer has no rules for port 9201 so it's ok that I get nothing.
Connecting from kibana directly to data-1 (<IP_ADDRESS>) via port 9201 works good, I see also at arm logs that port forwarding was initialized.
combat@el-data-1:~$ cat /etc/iptables/rules.v4
cat: /etc/iptables/rules.v4: Permission denied
combat@el-data-1:~$ sudo cat /etc/iptables/rules.v4
# Generated by iptables-save v1.6.0 on Mon May 15 19:39:43 2017
*nat
:PREROUTING ACCEPT [3:152]
:INPUT ACCEPT [6:304]
:OUTPUT ACCEPT [8:539]
:POSTROUTING ACCEPT [8:539]
-A PREROUTING -p tcp -m tcp --dport 9201 -j REDIRECT --to-ports 9200
-A OUTPUT -o lo -p tcp -m tcp --dport 9201 -j REDIRECT --to-ports 9200
COMMIT
# Completed on Mon May 15 19:39:43 2017
# Generated by iptables-save v1.6.0 on Mon May 15 19:39:43 2017
*filter
:INPUT ACCEPT [502551:730816844]
:FORWARD ACCEPT [0:0]
:OUTPUT ACCEPT [183042:9809793]
-A INPUT -p udp -m udp --dport 68 -j ACCEPT
COMMIT
# Completed on Mon May 15 19:39:43 2017

Seems ok, right?
But as I see at the Azure, external-lb-ip is <IP_ADDRESS> (associated with external-lb) but still getting timeout opening http://<IP_ADDRESS>:9200 , any idea what can I verify?

Looks ok to me.
If you can make a request to all nodes in the cluster from kibana on port 9201 then it sounds like something has gone wrong with the external LB deployment/configuration. Is there anything in its audit logs?
If you don't have any data in the cluster yet, could you try redeploying again?

I have figured out that this issue is not related to LB or the data instance.
Probably wrong elasticsearch configuration which is not allowing to access from the outside?
root@el-data-0:/home/combat# cat /etc/elasticsearch/elasticsearch.yml
cluster.name: production-urstyle-elastic
node.name: el-data-0
path.data: /datadisks/disk1/elasticsearch/data
discovery.zen.ping.unicast.hosts: ["el-master-0:9300","el-master-1:9300","el-master-2:9300"]
node.master: false
node.data: true
discovery.zen.minimum_master_nodes: 2
network.host: [_site_, _local_]
node.max_local_storage_nodes: 1

netstat -l
tcp6       0      0 <IP_ADDRESS>:9200          [::]:*                  LISTEN
tcp6       0      0 localhost:9200          [::]:*                  LISTEN
tcp6       0      0 ip6-localhost:9200      [::]:*                  LISTEN
tcp6       0      0 <IP_ADDRESS>:9300          [::]:*                  LISTEN
tcp6       0      0 localhost:9300          [::]:*                  LISTEN
tcp6       0      0 ip6-localhost:9300      [::]:*                  LISTEN

Idk, but shouldn't be a <IP_ADDRESS> instead of localhost? @russcam

New fresh installation - same issue, 9200 is not accessible for external IP

@CombatCode I just deployed a cluster from the portal with an external load balancer and all is working as expected.
Would you be able to share your deployment parameters (redact any sensitive ones)?

@russcam Can I extract somehow this parameters from azure?
This is a basic installation with all default options selected except the LB type (external instead of internal)... and data instance type (I'm using Standard DS1 (1 core, 3.5 GB memory) instead of default DS1_V2 because of quota exceeded)

There's no nice way to be able to extract the parameters post deployment as far as I know, but you can download them from the portal before deploying with

and selecting the parameters tab

Have you been able to look at this further, @CombatCode?

@russcam I will back to this in a few days and let u know

@russcam Fresh installation, still the same issue,
there you have may installation parameters:
{
    "$schema": "https://schema.management.azure.com/schemas/2015-01-01/deploymentParameters.json#",
    "contentVersion": "<IP_ADDRESS>",
    "parameters": {
        "esVersion": {
            "value": "5.4.0"
        },
        "esClusterName": {
            "value": "elastic"
        },
        "azureCloudPlugin": {
            "value": "No"
        },
        "azureCloudStorageAccountName": {
            "value": ""
        },
        "azureCloudStorageAccountKey": {
            "value": null
        },
        "xpackPlugins": {
            "value": "Yes"
        },
        "esAdditionalPlugins": {
            "value": ""
        },
        "loadBalancerType": {
            "value": "external"
        },
        "vNetNewOrExisting": {
            "value": "existing"
        },
        "vNetName": {
            "value": "network"
        },
        "vNetClusterSubnetName": {
            "value": "network"
        },
        "vNetLoadBalancerIp": {
            "value": "<IP_ADDRESS>"
        },
        "vNetExistingResourceGroup": {
            "value": "production-urstyle-db"
        },
        "vNetNewClusterSubnetAddressPrefix": {
            "value": "<IP_ADDRESS>/24"
        },
        "vNetAppGatewaySubnetName": {
            "value": "es-gateway-subnet"
        },
        "vNetNewAppGatewaySubnetAddressPrefix": {
            "value": "<IP_ADDRESS>/28"
        },
        "kibana": {
            "value": "Yes"
        },
        "vmSizeKibana": {
            "value": "Standard_D1"
        },
        "kibanaKeyBlob": {
            "value": null
        },
        "kibanaCertBlob": {
            "value": ""
        },
        "kibanaKeyPassphrase": {
            "value": null
        },
        "jumpbox": {
            "value": "No"
        },
        "vmSizeDataNodes": {
            "value": "Standard_DS1_v2"
        },
        "vmDataDiskCount": {
            "value": 40
        },
        "vmDataDiskSize": {
            "value": "Large"
        },
        "vmDataNodeCount": {
            "value": 3
        },
        "storageAccountType": {
            "value": "Default"
        },
        "dataNodesAreMasterEligible": {
            "value": "No"
        },
        "vmHostNamePrefix": {
            "value": "els"
        },
        "vmSizeMasterNodes": {
            "value": "Standard_D1"
        },
        "vmClientNodeCount": {
            "value": 0
        },
        "adminUsername": {
            "value": "combat"
        },
        "authenticationType": {
            "value": "sshPublicKey"
        },
        "sshPublicKey": {
            "value": null
        },
        "securityAdminPassword": {
            "value": null
        },
        "securityReadPassword": {
            "value": null
        },
        "securityKibanaPassword": {
            "value": null
        },
        "appGatewayTier": {
            "value": "Standard"
        },
        "appGatewaySku": {
            "value": "Small"
        },
        "appGatewayCount": {
            "value": 1
        },
        "appGatewayCertBlob": {
            "value": ""
        },
        "appGatewayCertPassword": {
            "value": null
        },
        "appGatewayWafStatus": {
            "value": "Disabled"
        },
        "appGatewayWafMode": {
            "value": "Detection"
        },
        "location": {
            "value": "westeurope"
        },
        "userCompany": {
            "value": "BiznesIT"
        },
        "userEmail": {
            "value"<EMAIL_ADDRESS>        },
        "userFirstName": {
            "value": "Damian"
        },
        "userLastName": {
            "value": "Gądziak"
        },
        "userJobTitle": {
            "value": "IT Executive (CIO, CTO, VP Engineering, etc.)"
        },
        "userCountry": {
            "value": "Poland"
        }
    }
}

External load balancer informations:
production-urstyle-elastic
IP address
<IP_ADDRESS>
Location
West Europe
DNS name
lb-5gbpqwzulmes2.westeurope.cloudapp.azure.com
Subscription name
(change)
BizSpark
Associated to
es-external-lb
as you can see, http://<IP_ADDRESS>:9200 is not working 👎

Thanks for the parameters @CombatCode, looking at this now

I can't replicate what you're experiencing @CombatCode. Here's the steps I took to replicate:
Using the following parameters file based on the one provided (null values need to be replaced with "" - a quirk of exporting the template where values are secure strings):
{
    "$schema": "https://schema.management.azure.com/schemas/2015-01-01/deploymentParameters.json#",
    "contentVersion": "<IP_ADDRESS>",
    "parameters": {
        "esVersion": {
            "value": "5.4.0"
        },
        "esClusterName": {
            "value": "elastic"
        },
        "azureCloudPlugin": {
            "value": "No"
        },
        "azureCloudStorageAccountName": {
            "value": ""
        },
        "azureCloudStorageAccountKey": {
            "value": ""
        },
        "xpackPlugins": {
            "value": "Yes"
        },
        "esAdditionalPlugins": {
            "value": ""
        },
        "loadBalancerType": {
            "value": "external"
        },
        "vNetNewOrExisting": {
            "value": "existing"
        },
        "vNetName": {
            "value": "network"
        },
        "vNetClusterSubnetName": {
            "value": "network"
        },
        "vNetLoadBalancerIp": {
            "value": "<IP_ADDRESS>"
        },
        "vNetExistingResourceGroup": {
            "value": "production-urstyle-db"
        },
        "vNetNewClusterSubnetAddressPrefix": {
            "value": "<IP_ADDRESS>/24"
        },
        "vNetAppGatewaySubnetName": {
            "value": "es-gateway-subnet"
        },
        "vNetNewAppGatewaySubnetAddressPrefix": {
            "value": "<IP_ADDRESS>/28"
        },
        "kibana": {
            "value": "Yes"
        },
        "vmSizeKibana": {
            "value": "Standard_D1"
        },
        "kibanaKeyBlob": {
            "value": ""
        },
        "kibanaCertBlob": {
            "value": ""
        },
        "kibanaKeyPassphrase": {
            "value": ""
        },
        "jumpbox": {
            "value": "No"
        },
        "vmSizeDataNodes": {
            "value": "Standard_DS1_v2"
        },
        "vmDataDiskCount": {
            "value": 40
        },
        "vmDataDiskSize": {
            "value": "Large"
        },
        "vmDataNodeCount": {
            "value": 3
        },
        "storageAccountType": {
            "value": "Default"
        },
        "dataNodesAreMasterEligible": {
            "value": "No"
        },
        "vmHostNamePrefix": {
            "value": "els"
        },
        "vmSizeMasterNodes": {
            "value": "Standard_D1"
        },
        "vmClientNodeCount": {
            "value": 0
        },
        "adminUsername": {
            "value": "russ"
        },
        "authenticationType": {
            "value": "sshPublicKey"
        },
        "sshPublicKey": {
            "value": "<redacted>"
        },
        "securityAdminPassword": {
            "value": "<redacted>"
        },
        "securityReadPassword": {
            "value": "<redacted>"
        },
        "securityKibanaPassword": {
            "value": "<redacted>"
        },
        "appGatewayTier": {
            "value": "Standard"
        },
        "appGatewaySku": {
            "value": "Small"
        },
        "appGatewayCount": {
            "value": 1
        },
        "appGatewayCertBlob": {
            "value": ""
        },
        "appGatewayCertPassword": {
            "value": ""
        },
        "appGatewayWafStatus": {
            "value": "Disabled"
        },
        "appGatewayWafMode": {
            "value": "Detection"
        },
        "location": {
            "value": "westeurope"
        },
        "userCompany": {
            "value": "Elastic"
        },
        "userEmail": {
            "value": "<redacted>"
        },
        "userFirstName": {
            "value": "Russ"
        },
        "userLastName": {
            "value": "Cam"
        },
        "userJobTitle": {
            "value": "IT Executive (CIO, CTO, VP Engineering, etc.)"
        },
        "userCountry": {
            "value": "Australia"
        }
    }
}

First, I set up the existing virtual network in another resource group in the same location:

logged into azure CLI:
azure login

switched to arm mode
azure config mode arm

created the resource group for the deployment
azure group create russ-cluster westeurope

deployed from the master branch to the created resource group, using the template parameters above
azure group deployment create --template-uri https://raw.githubusercontent.com/elastic/azure-marketplace/master/src/mainTemplate.json --parameters-file parameters/ssh.parameters.json -g russ-cluster

output from successful deployment
data:    DeploymentName     : mainTemplate
data:    ResourceGroupName  : russ-cluster
data:    ProvisioningState  : Succeeded
data:    Timestamp          : Mon Jun 26 2017 10:51:21 GMT+1000 (AUS Eastern Standard Time)
data:    Mode               : Incremental
data:    CorrelationId      : <redacted>
data:    TemplateLink       : https://raw.githubusercontent.com/elastic/azure-marketplace/master/src/mainTemplate.json data:    ContentVersion     : <IP_ADDRESS>
data:    DeploymentParameters :
data:    Name                                  Type          Value

data:    ------------------------------------  ------------  ----------------------------------------------------------------------
data:    artifactsBaseUrl                      String        https://raw.githubusercontent.com/elastic/azure-marketplace/master/src
data:    elasticTags                           Object        [object Object]

data:    esVersion                             String        5.4.0

data:    esClusterName                         String        elastic

data:    loadBalancerType                      String        external

data:    azureCloudPlugin                      String        No

data:    azureCloudStorageAccountName          String

data:    azureCloudStorageAccountKey           SecureString  undefined

data:    xpackPlugins                          String        Yes

data:    esAdditionalPlugins                   String

data:    kibana                                String        Yes

data:    vmSizeKibana                          String        Standard_D1

data:    kibanaCertBlob                        String

data:    kibanaKeyBlob                         SecureString  undefined

data:    kibanaKeyPassphrase                   SecureString  undefined

data:    jumpbox                               String        No

data:    vmHostNamePrefix                      String        els

data:    vmSizeDataNodes                       String        Standard_DS1_v2

data:    vmDataDiskCount                       Int           40

data:    vmDataDiskSize                        String        Large

data:    vmDataNodeCount                       Int           3

data:    storageAccountType                    String        Default

data:    dataNodesAreMasterEligible            String        No

data:    vmSizeMasterNodes                     String        Standard_D1

data:    vmClientNodeCount                     Int           0

data:    vmSizeClientNodes                     String        Standard_D1

data:    adminUsername                         String        russ

data:    authenticationType                    String        sshPublicKey

data:    adminPassword                         SecureString  undefined

data:    sshPublicKey                          SecureString  undefined

data:    securityAdminPassword                 SecureString  undefined

data:    securityReadPassword                  SecureString  undefined

data:    securityKibanaPassword                SecureString  undefined

data:    location                              String        westeurope

data:    vNetNewOrExisting                     String        existing

data:    vNetName                              String        network

data:    vNetExistingResourceGroup             String        production-urstyle-db

data:    vNetNewAddressPrefix                  String        <IP_ADDRESS>/24

data:    vNetLoadBalancerIp                    String        <IP_ADDRESS>

data:    vNetClusterSubnetName                 String        network

data:    vNetNewClusterSubnetAddressPrefix     String        <IP_ADDRESS>/24

data:    vNetAppGatewaySubnetName              String        es-gateway-subnet

data:    vNetNewAppGatewaySubnetAddressPrefix  String        <IP_ADDRESS>/28

data:    appGatewayTier                        String        Standard

data:    appGatewaySku                         String        Small

data:    appGatewayCount                       Int           1

data:    appGatewayCertBlob                    String

data:    appGatewayCertPassword                SecureString  undefined

data:    appGatewayWafStatus                   String        Disabled

data:    appGatewayWafMode                     String        Detection

data:    userCompany                           String        Elastic

data:    userEmail                             String        <redacted>

data:    userFirstName                         String        Russ

data:    userLastName                          String        Cam

data:    userJobTitle                          String        IT Executive (CIO, CTO, VP Engineering, etc.)

data:    userCountry                           String        Australia

data:    Outputs            :
data:    Name          Type    Value
data:    ------------  ------  ----------------------------------------------------------
data:    loadbalancer  String  http://lb-23nxasf2nsmtm.westeurope.cloudapp.azure.com:9200
data:    kibana        String  http://kb-23nxasf2nsmtm.westeurope.cloudapp.azure.com:5601
data:    jumpboxssh    String  N/A
info:    group deployment create command OK

navigating to http://lb-23nxasf2nsmtm.westeurope.cloudapp.azure.com:9200 and after logging in with elastic and password supplied in template for securityAdminPassword, I can successfully access the cluster externally:

Further questions:

Does the deployment succeed?
Do you have any network security rules in place that may be preventing you from accessing the external LB public IP?

Have you had a chance to look at this again @CombatCode?

@CombatCode I'm closing this issue as I've been unable to reproduce after many attempts. Feel free to reopen if additional details come to light 👍


Implement check constraint in drizzle-kit

What is the status of check constraints? I'm trying to implement exclusive subtypes. Any recommendations as to how to approach this would be greatly appreciated. Thanks!
Exclusive subtypes

Hey @dankochetov! I am wondering if someone can update the documentation for CHECK if it has already been implemented on the ORM side? Thanks!

There's probably a lot of devs that have worked with SQL and never used CHECK, because it's almost never supported by ORMs.
I'm currently using them with drizzle to model polymorphic relationship, which works great in Postgres :
ALTER TABLE "Like"
  ADD CONSTRAINT check_like_polymorphism
  CHECK (num_nonnulls("pictureId", "videoId", "songId") = 1);

This would enforce that only one of these 3 columns have a value while the other 2 must be null.
Would be nice to document this pattern once kit support is in.

There's probably a lot of devs that have worked with SQL and never used CHECK, because it's almost never supported by ORMs. I'm currently using them with drizzle to model polymorphic relationship, which works great in Postgres :
ALTER TABLE "Like"
  ADD CONSTRAINT check_like_polymorphism
  CHECK (num_nonnulls("pictureId", "videoId", "songId") = 1);

This would enforce that only one of these 3 columns have a value while the other 2 must be null. Would be nice to document this pattern once kit support is in.

@Hebilicious, Did you declare this constraint on the schema? I tried to add a RAW SQL like this, but when I ran the generate command, the schema was generated without constraint.

There's probably a lot of devs that have worked with SQL and never used CHECK, because it's almost never supported by ORMs. I'm currently using them with drizzle to model polymorphic relationship, which works great in Postgres :
ALTER TABLE "Like"
  ADD CONSTRAINT check_like_polymorphism
  CHECK (num_nonnulls("pictureId", "videoId", "songId") = 1);

This would enforce that only one of these 3 columns have a value while the other 2 must be null. Would be nice to document this pattern once kit support is in.

@Hebilicious, Did you declare this constraint on the schema? I tried to add a RAW SQL like this, but when I ran the generate command, the schema was generated without constraint.

You must run the raw SQL manually, which can be done by editing a drizzle kit migration or creating a custom one. There's nothing in the drizzle schema though, so I add a comment in the table definition saying the check exists for now.

I just realized it is really simple to achieve that. I already wrote a seeder class that executes operations through transactions. To add RAW SQL into the database, I can use the same approach, which is a dedicated class to run RAW SQLs.

 (table) => ({
    ageCheck: check('age_check', sql`${table.age} >= 0`)
  }),

Does the API look like so?

Available in<EMAIL_ADDRESS>and<EMAIL_ADDRESS>


MINOR: Require final variables in Streams

Streams code style requires the final modifier when applicable. Rather than leaning on the reviewers to notice and nitpitck this issue, we can use checkstyle to enforce it.
Committer Checklist (excluded from commit message)

[ ] Verify design and implementation
[ ] Verify test coverage and CI build status
[ ] Verify documentation (including upgrade notes)

@mjsax I've fixed those formatting blemishes, and restricted the suppression to the whole package, as you suggested.
I also figured out that all I needed to add to the check was PARAMETER_DEF, and I didn't have to change any other lines, so I went ahead and snuck it in.

@guozhangwang @mjsax rebased

@mjsax Should we merge it into 2.0 as well, for easing any other cherry-picks in the future?

I tried to cherry-pick this PR to 2.0 but there are too many conflicts already.. I guess we will have to wait and see if it introduce all many pains for cherry-picking other PRs from 2.0, and if not we would not do it in 2.0 then.

Thanks @mjsax !
@guozhangwang , I'll just implement it for 2.0, it won't take very long, since I can automatically fix the final problems with IDEA.

@mjsax @guozhangwang @bbejeck , Now that this is merged, you might want to configure IDEA to warn you about missing final declarations to cut down on testing round-trip time.


Toggle Scheduled Transactions always on

Name of Defective Feature
Toggle Scheduled Transactions
System Settings (Required)
ToolKit Version: 1.1.0
Operating System (Mac/Windows/Etc):Chrome OS and Windows 7
Browser (Chrome/Firefox/Safari):Chrome
Browser Version: 59.0.3074
Other Extensions: ABP, LastPass, Privacy Badger
Export of Toolkit Settings (Bottom Left of Settings Page)
[{"key":"AccountsDisplayDensity","value":"2"},{"key":"AccountsEmphasizedOutflows","value":false},{"key":"AccountsStripedRows","value":true},{"key":"AdditionalColumns","value":true},{"key":"AdjustableColumnWidths","value":false},{"key":"AutoCloseReconcile","value":true},{"key":"ChangeEnterBehavior","value":true},{"key":"CheckNumbers","value":false},{"key":"ColourBlindMode","value":false},{"key":"CustomFlagNames","value":false},{"key":"DisplayTargetGoalAmount","value":"0"},{"key":"GoalWarningColor","value":true},{"key":"HideAgeOfMoney","value":false},{"key":"HideReferralBanner","value":false},{"key":"PrintingImprovements","value":true},{"key":"RemovePositiveHighlight","value":false},{"key":"RowHeight","value":"2"},{"key":"RunningBalance","value":false},{"key":"ShowCategoryBalance","value":false},{"key":"SquareNegativeMode","value":false},{"key":"StealingFromFuture","value":true},{"key":"TargetBalanceWarning","value":false},{"key":"accountsClearSelection","value":false},{"key":"activityTransactionLink","value":true},{"key":"betterScrollbars","value":"0"},{"key":"budgetBalanceToZero","value":true},{"key":"budgetProgressBars","value":"pacing"},{"key":"budgetQuickSwitch","value":true},{"key":"budgetRowsHeight","value":"3"},{"key":"calendarFirstDay","value":"0"},{"key":"categoryActivityPopupWidth","value":"0"},{"key":"checkCreditBalances","value":true},{"key":"collapseExpandBudgetGroups","value":true},{"key":"collapseSideMenu","value":true},{"key":"compactIncomeVsExpense","value":true},{"key":"currentMonthIndicator","value":true},{"key":"daysOfBuffering","value":true},{"key":"daysOfBufferingHistoryLookup","value":"0"},{"key":"editButtonPosition","value":"2"},{"key":"enableRetroCalculator","value":false},{"key":"enlargeCategoriesDropdown","value":true},{"key":"goalIndicator","value":true},{"key":"googleFontsSelector","value":"0"},{"key":"hideAccountBalancesType","value":"0"},{"key":"hideHelp","value":false},{"key":"highlightNegativesNegative","value":false},{"key":"importNotification","value":"2"},{"key":"incomeFromLastMonth","value":"0"},{"key":"l10n","value":"0"},{"key":"largerClickableIcons","value":false},{"key":"monthlyNotesPopupWidth","value":"0"},{"key":"navDisplayDensity","value":"2"},{"key":"pacing","value":"0"},{"key":"popupCalculator","value":true},{"key":"privacyMode","value":"0"},{"key":"reconciledTextColor","value":"1"},{"key":"removeZeroCategories","value":false},{"key":"reports","value":true},{"key":"resizeInspector","value":true},{"key":"rightClickToEdit","value":true},{"key":"seamlessBudgetHeader","value":true},{"key":"showIntercom","value":true},{"key":"spareChange","value":false},{"key":"splitKeyboardShortcut","value":true},{"key":"splitTransactionAutoAdjust","value":true},{"key":"swapClearedFlagged","value":false},{"key":"toBeBudgetedWarning","value":false},{"key":"toggleSplits","value":true},{"key":"toggleTransactionFilters","value":"1"},{"key":"warnOnQuickBudget","value":true}]

Steps to Reproduce the Behavior
Please write down the steps necessary to reproduce the behavior you're seeing. Please be as thorough as possible.

Open Chrome
Open YNAB
Click on account (any account; all start with Scheduled Transactions icon toggled on)

Expected Behavior
What did you expect would happen after completing the steps?
Account opens with both toggles off
Actual Behavior
What actually happened after you completed the steps.
Scheduled Transactions toggle is always on for each account after starting new instance of Chrome
Uninstalled, reinstalled, rebooted, restarted Chrome, no change.

@casner are you still seeing this issue? I can't reproduce it.

Every time I open YNAB and click on an account. I uninstalled and reinstalled toolkit, and it is still there. Toolkit 1.2.0, whatever version is most current in YNAB.
Bruce
From: Josh Madewell<EMAIL_ADDRESS>Sent: Monday, September 18, 2017 23:21
To: toolkit-for-ynab/toolkit-for-ynab<EMAIL_ADDRESS>Cc: Bruce Casner<EMAIL_ADDRESS>Mention<EMAIL_ADDRESS>Subject: Re: [toolkit-for-ynab/toolkit-for-ynab] Toggle Scheduled Transactions always on (#891)
@casnerhttps://github.com/casner are you still seeing this issue? I can't reproduce it.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHubhttps://github.com/toolkit-for-ynab/toolkit-for-ynab/issues/891#issuecomment-330425073, or mute the threadhttps://github.com/notifications/unsubscribe-auth/AAqMOz_T9dbg7YiGeHhLN4orsXd3uGp6ks5sj0EmgaJpZM4PFPcZ.

This message (including any attachments) is intended for the sole use of the intended recipient/s and may contain material that is CONFIDENTIAL AND PRIVATE COMPANY INFORMATION. If you are not the intended recipient of this message, you are hereby notified that you must delete the message without disseminating, copying or taking any action in reliance upon it. If you have received this message in error, please notify the sender via return e-mail. Thank you.

It even happens with Toolkit uninstalled, so I will raise the issue with YNAB support.
Bruce
From: Josh Madewell<EMAIL_ADDRESS>Sent: Monday, September 18, 2017 23:21
To: toolkit-for-ynab/toolkit-for-ynab<EMAIL_ADDRESS>Cc: Bruce Casner<EMAIL_ADDRESS>Mention<EMAIL_ADDRESS>Subject: Re: [toolkit-for-ynab/toolkit-for-ynab] Toggle Scheduled Transactions always on (#891)
@casnerhttps://github.com/casner are you still seeing this issue? I can't reproduce it.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHubhttps://github.com/toolkit-for-ynab/toolkit-for-ynab/issues/891#issuecomment-330425073, or mute the threadhttps://github.com/notifications/unsubscribe-auth/AAqMOz_T9dbg7YiGeHhLN4orsXd3uGp6ks5sj0EmgaJpZM4PFPcZ.

This message (including any attachments) is intended for the sole use of the intended recipient/s and may contain material that is CONFIDENTIAL AND PRIVATE COMPANY INFORMATION. If you are not the intended recipient of this message, you are hereby notified that you must delete the message without disseminating, copying or taking any action in reliance upon it. If you have received this message in error, please notify the sender via return e-mail. Thank you.

Closing as not a Toolkit issue.


Covid19 CT images.

Is your feature request related to a problem? Please describe.

I will like to generate a model to predict the Covid19 using  CT images.

Describe the solution you'd like

CT scans give more imaging features in predicting Covid19 and moreover if in future a flask route can be created for testing covid report using both x-rays and CT scans :).

@barnamensch056 please provide link to the dataset.

https://www.kaggle.com/luisblanche/covidct  here is the link.

@barnamensch056 Assigning it to you.

Thsnks @utkarsh0702 👍


Massive scons refactoring!

Lots of exciting changes here.  I still have more extraction to do - eventually SConstruct will be tiny - but this is enough for now.
Looking for Windows testers with patience for this one.

How do I build the beast "hello world" using this new SConstruct?

You can't directly do it yet.  By the end of all this there will be nothing at all in the main SConstruct and it'll be near trivial to do.

I think we should close this until the work is done and we have a "hello world" compiling.

also, vcxproj is out of date


Remove broken downloads badge

See https://github.com/badges/shields/issues/716.

Thank you for contributing to openstack-dev/pbr!
openstack-dev/pbr uses Gerrit for code review.
If you have never contributed to OpenStack before make sure you have read the
getting started documentation:
http://docs.openstack.org/infra/manual/developers.html#getting-started
Otherwise please visit
http://docs.openstack.org/infra/manual/developers.html#development-workflow
and follow the instructions there to upload your change to Gerrit.


Fix msvc compilation

Commit 21b207fcca9e09a46928dbea51351c7140eba569 fixes compilation on MSVC 19.41.34120 (Visual Studio 17.11.2)
Commit 38de8cdcb2d0f1362a176295bfa26c4dd13343c6 fixes compilation on GCC 14.1.0 + Ubuntu 22.0.1 where it seems clearValues[0].color = {vk::ClearColorValue(0.0f, 0.0f, 0.0f, 1.0f)}; would not automatically interpret (0.0f, 0.0f, 0.0f, 1.0f) as an std::array<float, 4>

Thanks! I needed to change
std::chrono::time_point<std::chrono::steady_clock> m_time = std::chrono::high_resolution_clock::now();
to
std::chrono::time_point<std::chrono::high_resolution_clock> m_time = std::chrono::high_resolution_clock::now();
to compile with GCC. I've committed the changes to the main branch.


[docs] Add error boundary to demos

An alternative to #16746 that let our developers fill the issue template, no assistance is provided. It saves us work.
Closes #16209
Closes #16746

Given the infrequency of demo errors, this seems like a good tradeoff.

I haven’t merged this so @eps1lon has a chance to see it

What do you think of removing the issue template complexity for a direct link to mui-org/material-ui/issues/new/choose? I don't think that it will be used very often.

So let me get this right: You think the user will discard a filled out template with all the information we need and fill this information out themselves? And we shouldn't assist him in anyway because?
From my experience about 10% of the issues are filled to a degree that's workable. I don't share this experience at all most of them are fine as is.
Can you be specific why a filled out template is strictly bad that we remove it while at the same time asking if we should set up sentry which is exactly doing that just in a more sophisticated way?

I do think that an already filled template is better from an effectiveness perspective. I don't think that we should spend time on it from an efficiency perspective. It's about doing the minimum of work we can get away with.

I don't think that we should spend time on it from an efficiency perspective.

Time is already spent. Now you're spending time making the spent time useless.

Does it take into account the time of maintaining the logic?

Does it take into account the time of maintaining the logic?

Should I remind you of that every time we tweak the issue template? Since it's not worth our time why not leave it blank since this is all not worth our time.

It don't fully follow. The issue templates are filled 50 times? a week. How many time would this one be used?

How many time would this one be used?

We don't know. The idea is to assume it's rare and to get a chance to have people use the link. We can learn from that usage. If we see that a prefilled template would save us time, then we can consider it.
I have looked at the "expand" event analytics, the least used demo is pages/system/basics/JSS.js, people expand it 2 times a day. The median used demo is expended 20 times a day. It makes me believe that we have strong test coverage, running every day.

If you don't think it's worth spending time why start a discussion about more sophisticated tools?

I'm interested in the discussion because my current point of view might be wrong? I believe that Sentry takes 10 minutes to set up and will give a full overview of the situation. I have been wondering about it for months. So far, the reasoning for not adding it was: 1. It's better to let our users filter the noise, if somebody takes the time to report something, it's probably because it's important for him. 2. We wouldn't have the time to handle the messages. 3. It would slow down the pages.

Again why do you reject an already implemented pre-filled issue template? You have given no reason other than: there are other ways or: it might not be used to which I say: then it doesnt matter if we merge it

why do you reject an already implemented

Having something already implemented shouldn't change the outcome. This advantage fades away in the long term projection.
Any logic has a maintenance overhead. It makes changes harder. I think that we reject people new feature pull request for the same reason. The bet is that there is a relatively high chance that it won't be necessary. The logic is not lost. We should be able to use it, in the future, if we need it :).


GH-44828: [Java][Release] Remove Java from release scripts

Rationale for this change
Java has been moved to its own repo.
What changes are included in this PR?
Remove Java/Maven from dev/release.
Are these changes tested?
N/A
Are there any user-facing changes?
No

GitHub Issue: #44828

@github-actions crossbow submit -g verify-rc-source

I think 18.1.0 is out - are we good to go here? If so I'll rebase

Yes! Let's merge this!


Update URL name to "Visual Studio Installer Projects Extension and .NET 6.0"

Update URL name to "Visual Studio Installer Projects Extension and .NET 6.0".
It seems that when the page titles were updated, the table of contents and other modifications were left out.

@ychikazawa : Thanks for your contribution! The author(s) have been notified to review your proposed change.

#sign-off Thanks!


Make compatible with CommonJS and Browserify

Ran into some trouble when trying to use this library in a Browserify build, so here's a patch. Hope you accept the changes. Cheers!

export the main Tone object on module, if it exists
fix incorrect main path in package.json

thanks for the fix! I've added the CommonJS line of code to grunt/fragments/after.frag and it will appear in the next build.
Please make future PRs on the dev branch.


add require_auth to referendum::voter

This PR add require_auth(voter) to the referendum::vote ACTION.

Task linked: DEMZNE-1292 Fix referendum permissions


Revert "Require continuation char to be last char in a line"

This reverts commit 105bc63295a7126798d3722a0e205c5ead4e2b1c (https://github.com/docker/docker/pull/27146),
which (although correct), resulted in a backward incompatible
change.
We can re-implement this in future, after this changes goes
through a deprecation cycle
fixes https://github.com/docker/docker/issues/29170
version for 1.13.x can be found here; https://github.com/docker/docker/pull/30009

@thaJeztah one weird thing though, is that it seemed to work fine with rc4 :S I know it makes no sense.

Are you sure your editor didn't remove trailing whitespace?
Trying on 1.13.0-rc4;
docker build -t repro-29170 -<<EOF
FROM alpine
RUN mkdir -p /foobar/ \
 && echo "hello"
EOF

Sending build context to Docker daemon 2.048 kB
Error response from daemon: Unknown instruction: &&

We should add a warning when we re-implement it.

this was also opened against the 1.13.x branch in https://github.com/docker/docker/issues/30009, so I'll set the "cherry-picked" label


Feature request: add checkbox for whether save preview related to work area

after consideration, I think this feature is no longer preview anymore.
To hack it, just pre-composite the layers you want to save, and then cut the layer to work area using ctrl+[ and ctrl+]

close it.


scipy 1.0.0rc1 doesn't build under fink build system as fink-bld user

The scipy-1.0.0rc1 release fails to build under the fink packaging system as the fink-bld user...
creating build/src.macosx-10.13-x86_64-3.6/scipy/_lib
customize Gnu95FCompiler
Found executable /sw/lib/gcc6/bin/gfortran
Traceback (most recent call last):
  File "setup.py", line 418, in <module>
    setup_package()
  File "setup.py", line 414, in setup_package
    setup(**metadata)
  File "/sw/lib/python3.6/site-packages/numpy/distutils/core.py", line 169, in setup
    return old_setup(**new_attr)
  File "/sw/lib/python3.6/distutils/core.py", line 148, in setup
    dist.run_commands()
  File "/sw/lib/python3.6/distutils/dist.py", line 955, in run_commands
    self.run_command(cmd)
  File "/sw/lib/python3.6/distutils/dist.py", line 974, in run_command
    cmd_obj.run()
  File "/sw/lib/python3.6/site-packages/numpy/distutils/command/build.py", line 47, in run
    old_build.run(self)
  File "/sw/lib/python3.6/distutils/command/build.py", line 135, in run
    self.run_command(cmd_name)
  File "/sw/lib/python3.6/distutils/cmd.py", line 313, in run_command
    self.distribution.run_command(command)
  File "/sw/lib/python3.6/distutils/dist.py", line 974, in run_command
    cmd_obj.run()
  File "/sw/lib/python3.6/site-packages/numpy/distutils/command/build_src.py", line 148, in run
    self.build_sources()
  File "/sw/lib/python3.6/site-packages/numpy/distutils/command/build_src.py", line 165, in build_sources
    self.build_extension_sources(ext)
  File "/sw/lib/python3.6/site-packages/numpy/distutils/command/build_src.py", line 324, in build_extension_sources
    sources = self.generate_sources(sources, ext)
  File "/sw/lib/python3.6/site-packages/numpy/distutils/command/build_src.py", line 377, in generate_sources
    source = func(extension, build_dir)
  File "scipy/_lib/setup.py", line 32, in get_messagestream_config
    if config_cmd.check_func('open_memstream', decl=True, call=True):
  File "/sw/lib/python3.6/site-packages/numpy/distutils/command/config.py", line 312, in check_func
    self._check_compiler()
  File "/sw/lib/python3.6/site-packages/numpy/distutils/command/config.py", line 83, in _check_compiler
    self.fcompiler.customize(self.distribution)
  File "/sw/lib/python3.6/site-packages/numpy/distutils/fcompiler/__init__.py", line 502, in customize
    get_flags('opt', oflags)
  File "/sw/lib/python3.6/site-packages/numpy/distutils/fcompiler/__init__.py", line 493, in get_flags
    flags.extend(getattr(self.flag_vars, tag))
  File "/sw/lib/python3.6/site-packages/numpy/distutils/environment.py", line 39, in __getattr__
    return self._get_var(name, conf_desc)
  File "/sw/lib/python3.6/site-packages/numpy/distutils/environment.py", line 53, in _get_var
    var = self._hook_handler(name, hook)
  File "/sw/lib/python3.6/site-packages/numpy/distutils/fcompiler/__init__.py", line 700, in _environment_hook
    return hook()
  File "/sw/lib/python3.6/site-packages/numpy/distutils/fcompiler/gnu.py", line 364, in get_flags_opt
    return GnuFCompiler.get_flags_opt(self)
  File "/sw/lib/python3.6/site-packages/numpy/distutils/fcompiler/gnu.py", line 212, in get_flags_opt
    v = self.get_version()
  File "/sw/lib/python3.6/site-packages/numpy/distutils/fcompiler/__init__.py", line 434, in get_version
    raise CompilerNotFound()
numpy.distutils.fcompiler.CompilerNotFound
### execution of /tmp/fink.i4sZ8 failed, exit code 1
### execution of /tmp/fink.n22cf failed, exit code 1

Reproducing code example:
The current fink scipy-py.info packaging file can be used to reproduce the issue with the change...

Index: scipy-py.info
===================================================================
RCS file: /cvsroot/fink/dists/10.9-libcxx/stable/main/finkinfo/sci/scipy-py.info,v
retrieving revision 1.12
diff -u -r1.12 scipy-py.info
--- scipy-py.info	23 Jun 2017 20:34:52 -0000	1.12
+++ scipy-py.info	5 Oct 2017 11:10:00 -0000
@@ -1,9 +1,10 @@
 Info2: <<
 Package: scipy-py%type_pkg[python]
-Version: 0.19.1
+Version: 1.0.0rc1
 Epoch: 1
 Revision: 1
 Maintainer: None<EMAIL_ADDRESS>+BuildAsNobody: true
 Type: python (2.7 3.4 3.5 3.6), gcc (6)
 Depends: <<
 	cython-py%type_pkg[python],
@@ -23,7 +24,7 @@
 <<
 #Source: mirror:sourceforge:scipy/scipy-%v.tar.gz
 Source: http://github.com/scipy/scipy/releases/download/v%v/scipy-%v.tar.xz
-Source-MD5: cad6bac0638b176f72c00fe81ed54d19
+Source-MD5: ed1da4d65cc16706665aa5f8fdc97b1b
 PatchScript: <<
 #!/bin/bash -ev
   cat <<EOF > site.cfg
@@ -81,7 +82,7 @@
  fi
 <<
 InfoTest: <<
-TestDepends: nose-py%type_pkg[python]
+TestDepends: nose-py%type_pkg[python], pytest-py%type_pkg[python]
 TestScript: touch %b/INSTALL_MAKE_CHECK
 <<
 DocFiles: INSTALL.rst.txt LICENSE.txt

Error message:
numpy.distutils.fcompiler.CompilerNotFound

Scipy/Numpy/Python version information:
scipy 1.0.0rc1, numpy 1.13.3 and python 3.6.2

Building the sci-py 1.0.0rc1 package as root instead of the fink-bld user eliminates the build failure. This is done in the fink scipy-py.info packaging file by changing...
BuildAsNobody: true
to
BuildAsNobody: false

A similar issue was introduced in the numpy 1.13.x release series which fails to build in the fink build system as the fink-bld user with the error...
customize PGroupFCompiler
Could not locate executable pgfortran
don't know how to compile Fortran code on platform 'posix'
C compiler: gcc -Wno-unused-result -Wsign-compare -Wunreachable-code -DNDEBUG -g -fwrapv -fwrapv -O3 -Wall -Wstrict-prototypes -I/sw/include

compile options: '-Inumpy/core/src/private -Inumpy/core/src -Inumpy/core -Inumpy/core/src/npymath -Inumpy/core/src/multiarray -Inumpy/core/src/umath -Inumpy/core/src/npysort -I/sw/include/python3.6m -c'
gcc: _configtest.c

failure.
removing: _configtest.c _configtest.o
Traceback (most recent call last):
  File "setup.py", line 392, in <module>
    setup_package()
  File "setup.py", line 384, in setup_package
    setup(**metadata)
  File "/sw/src/fink.build/numpy-py36-1.13.3-1/numpy-1.13.3/numpy/distutils/core.py", line 169, in setup
    return old_setup(**new_attr)
  File "/sw/lib/python3.6/distutils/core.py", line 148, in setup
    dist.run_commands()
  File "/sw/lib/python3.6/distutils/dist.py", line 955, in run_commands
    self.run_command(cmd)
  File "/sw/lib/python3.6/distutils/dist.py", line 974, in run_command
    cmd_obj.run()
  File "/sw/src/fink.build/numpy-py36-1.13.3-1/numpy-1.13.3/numpy/distutils/command/build.py", line 47, in run
    old_build.run(self)
  File "/sw/lib/python3.6/distutils/command/build.py", line 135, in run
    self.run_command(cmd_name)
  File "/sw/lib/python3.6/distutils/cmd.py", line 313, in run_command
    self.distribution.run_command(command)
  File "/sw/lib/python3.6/distutils/dist.py", line 974, in run_command
    cmd_obj.run()
  File "/sw/src/fink.build/numpy-py36-1.13.3-1/numpy-1.13.3/numpy/distutils/command/build_src.py", line 148, in run
    self.build_sources()
  File "/sw/src/fink.build/numpy-py36-1.13.3-1/numpy-1.13.3/numpy/distutils/command/build_src.py", line 159, in build_sources
    self.build_library_sources(*libname_info)
  File "/sw/src/fink.build/numpy-py36-1.13.3-1/numpy-1.13.3/numpy/distutils/command/build_src.py", line 294, in build_library_sources
    sources = self.generate_sources(sources, (lib_name, build_info))
  File "/sw/src/fink.build/numpy-py36-1.13.3-1/numpy-1.13.3/numpy/distutils/command/build_src.py", line 377, in generate_sources
    source = func(extension, build_dir)
  File "numpy/core/setup.py", line 674, in get_mathlib_info
    raise RuntimeError("Broken toolchain: cannot link a simple C program")
RuntimeError: Broken toolchain: cannot link a simple C program
### execution of ATLAS=None failed, exit code 1
### execution of /tmp/fink.akp9X failed, exit code 1

It appears the problem its that the build is attempted to write the  _configtest.c file into a directory that the fink-bld user doesn't have write permission for but I have been unable to get python to spew the details of where exactly the source and compiled files during the configuration tests are being placed.

Likewise, for the numpy 1.13.x series, building as root instead of as the normal fink-bld user is the only workaround to avoid the build failures under the fink packaging system.

FYI, the fink packaging system is available at http://www.finkproject.org.

Can we write _configtest.c to a temporary directory instead?

Not an issue in scipy. This is a numpy.distutils or python distutils
issue issue, and probably ultimately an issue in the configuration of
the specific build environment.
Note in particular that buildbots of Linux distributions, or standard
OSX or Linux builds do not require root access.

@matthew-brett: afaik the location of the file is decided by Python
distutils and not controlled by us. I think it just puts it to the
current working directory.

The actual problem has been pinpointed to be that the fink-bld user account created for the fink packaging system doesn't define a shell. By passing 'SHELL=/bin/sh' when python is being executed, the build failures are eliminated in both numpy 1.13.3 and scipy 1.0.0.
https://marc.info/?l=fink-devel&m=150993626715362&w=2

Thanks for following up @jwhowarth.

Just beat me to it! In numpy/distutils/exec_command.py:_exec_command()
    if os.name == 'posix' and use_shell:
        # On POSIX, subprocess always uses /bin/sh, override
        sh = os.environ.get('SHELL', '/bin/sh')
        if is_sequence(command):
            command = [sh, '-c', ' '.join(command)]
        else:
            command = [sh, '-c', command]
        use_shell = False

The actual problem is the environment variable being defined, but SHELL=/usr/bin/false for this non-privileged account. Instead of setting it to a working shell, unsetting it also solves the problem. Question is perhaps, does POSIX mandate SHELL to be set to a functional shell? Otherwise one could add a check here (but /usr/bin/false is  even executable, so that might not be that easy to catch). Anyway re-defining or unsetting SHELL should work for the Fink build environment.


Add attribute generator for animations

Animations should not be tied to views and state as tightly as they are now.
Ideally, it should look like CSS animations - you trigger some boolean variable and some animation starts. You change it back - another animation happens reverting the existing one.

My current proposal (which I'm using in some of my Anvil apps) includes two anim() functions.
One is a wrapper over ObjectAnimator, but with proper chaining API:
v(MyView.class,
  anim(shown).of("alpha", 1f).of("scaleX", 1f).duration(100),
  anim(!shown).of("alpha", 0f).of("scaleX", 0f).duration(100))

Another is a wrapper for existing Animator implementations (e.g. defined in XMLs, or created somewhere in code):
v(MyView.class,
  anim(shown, viewShowAnimator),
  anim(!shown, viewHideAnimator));

If such API looks acceptable - I will include the implementation into Anvil as a separate module devoted to animation utils.
No support for API level 1+ animations is planned.

Added the proposed animations implementation in 0.0.2 version


Updated README.markdown links for Git/GitGUI, typo fixes

Updated links for Git and GUI software (if Windows users want to run it), and some typos/grammatical fixes.

Description of the change:
Reason for the change:
Link to original source:

Closes #
@ksigler7

 Thank you for your submission, we really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

Hello @music-mind,Thanks again for the PR! We want to show our appreciation by sending                                              you some swag. Could you please fill out                                              this form so we can send it to you? Thanks!                                             Team SendGrid DX


Removed quotation marks from app_build argument to steamcmd (#6)

All edits were made manually; recompiling may be necessary

moving to #8


installing AWS SDK for C++

downloaded the zip from git and unzipped to location
ran command "C:\program files\cmake\bin\cmake.exe" c:\code\aws-sdk-cpp-main -G "Visual Studio 16 2019" -A x64 -DCMAKE_BUILD_TYPE=Debug
but getting errors

fatal error C1083: Cannot open include file: 'unistd.h'
error C2065: 'umask': undeclared identifier [C:\code\aws_build\CMakeFiles\CMakeTmp\cmTC_9cf0f.vcxproj]

the second im pretty sure is a symptom of the first
any thoughts? I straight unzipped the sdk from git and ran cmake with above command... not sure if the unistd.h file is just missing from the download or what

Hi @versacex ,
Since version 1.9 the SDK has been using submodules to consume it's dependencies, this has had the side effect of making building from the zip file very compicated, and so at the moment we don't really recommend it, see #1648 .
If possible, I'd suggest using git clone --recurse-submodules https://github.com/aws/aws-sdk-cpp to get the sdk.
If that's not an option, we do have a script to make it work but it is meant for linux based systems. look here.


Update new layout for mission pool

Update new layout mission pool list item
Add status to disable join now button

@Quangdm-cdm disable mission pool on browser to finish this issue

@Quangdm-cdm Please update list dApp recommended on Browser

Version test: PR #1297 16:06 03/01/2023
Device test: IP 11, S20 FE 5G
Validation passed.


git could use subdirectory paramiter.

By example:
# https://github.com/MaikKlein/ash/tree/master/ash
[patch.crates-io]
ash = { git = 'https://github.com/MaikKlein/ash.git/ash' }

dir = 'ash' OR subdir = 'ash'
Should fetch git and then extract/use content from a subfolder.  I also noted that using a URL of a zip or tar file isn't supported, not that this would help here as github won't generate zip downloads for subfolders either.

Thanks for the request! This has been brought up a few times before.  I'm going to close this as a duplicate of #6822, which seems to be the most similar.  Perhaps you can leave a comment on that issue detailing why you want to narrow the search to a path; what issues it would solve for you.

I don't think that's a duplicate or at least there's a different use case that I hit just now:
serde consists of two libraries: serde and serde_derive. serde_derive is a subdirectory of serde, which has a valid Cargo.toml. If I want to patch serde_derive, I now have to clone it separately and use path instead of git. This feature would avoid cloning.

Reason for specifying the path to a file?  You mean cargo has a feature were it'll look at 3 git subfolders that are all at the same depth each with a Cargo.toml and there doesn't need to be an option to specify which is meant to be used?  I think I would rather like to specify what folder to use if for no other reason than to stay well clear of ever trying to run that codepath looking for favorable results.

@cheako I don't understand your comment, could you reword it please?

Automation is good...  Sometimes.  If the choices are to use automation or blow up, ppl will complain when the automation blows up AND when not using the automation it blows up ppl will also complain.
If ppl don't care about hearing users endlessly complain, then fine don't ever offer an override on git sub-path automatic detection.  If ppl'd prefer silence than it's important to have well documented overrides on every piece of automation.
So yes, having an option to specify what path within a git tree is the path that should be used would seam important...  Even if it's only ever used as a response to issues like this, as an optional feature that would be the point.

Yeah, I agree.

I now have to clone it separately and use path instead of git. This feature would avoid cloning.

@Kixunil can you clarify why the patch doesn't work for you?  Something like the following should patch just serde_derive:
[patch.crates-io]
serde_derive = { git = "https://github.com/serde-rs/serde.git" }

@ehuss sorry, forgot to clarify that I got confused and the appearance of the crate being ignored was caused by something different. But I believe that's also an argument for allowing explicit parameter - less moving parts.


Inconsistent syntax highlighting

Describe the bug
Syntax highlighting is not consistent among type names.
To Reproduce
Steps to reproduce the behavior:

Go to any .cto model, with the VSCode extension enabled.

Expected behavior
All type names should have consistent highlighting.
Screenshots

PaymentRequest is highlighted, but PayOut isn't.
Desktop (please complete the following information):

OS: Windows 10
Browser N/A
Version N/A

This looks like a bug to me. My general intuition is that the syntax highlighting should use colors based on the category of tokens in the grammar: one color for all keywords, one color for all type names, etc.

That sounds right, I will try to see if I can fix it.

@jeromesimeon I am unable to understand the exact solution approach after exploring a bit. What i found was that PaymentRequest is getting captured as a support object either as "support.variable.dom.js" or as "support.class.dom.js" , in the concerto.tmLanguage.json file. (Image -  https://imgur.com/a/MWIuYEp).
So, should PaymentRequest -

have the same color highlighting as PayOut and its other capturing group is overriden when used with a class definition before its declaration
remain as it is (not have the same color), but should throw error because it has already been captured and been declared as another type.


Hass ONVIF?

In the instructions it says
Hass > Settings > Integrations > Add Integration > [ONVIF](https://my.home-assistant.io/redirect/config_flow_start/?domain=onvif) > Host: <IP_ADDRESS>, Port: 1984
But when I point the onvif integration at my Go2RTC instance on port 1984 it returns an error.  Does this only work if you have an Onvif camera?

This instruction works. You need to provide more info about problem

I followed the instructions...
Went to add the onvif, and pointed it to the go2rtc API/web port and it just says no onvif server found at that port.  It's there something in go2rtc I need to enable?  Otherwise the web interface works fine.

Go2rtc Web interface is available at that IP and port. It's running inside of frigate

Maybe you using outdated go2rtc version

It's the one built into frigate...  which as it turns out it's 1.2... so it's fairy old.  I think I'm going to run in another docker and just do it separately.


Subscriptions: Add transfer data field

This just adds the ability to pass the transfer data field as defined
here: https://stripe.com/docs/connect/subscriptions#transfer
A subscription using destination charges should allow for transfer_data
to exists.

I wasn't sure if I needed specs for it, I browsed the spec and couldn't find something that I could copy. Let me know if you want me to add spec!

@pier-oliviert I will spend some time on maintaining this gem and will review this PR soon. Would you be so kind to do a rebase to resolve the conflicts?

I believe another PR(#800) added this attribute and was merged.

Ah, awesome, I didn't see that. Thanks anyways!


new feature: Adding command aliases

It would be great to be able to define aliases for certain recurring commands, like "alias atr = ]%%[read:33" for smartcards or something like that.
Aliases could be loaded from the MMC in the form of a text file associating a command name to be substituted with a character string. This would be loaded when entering a mode, for example smartcard.aliases loaded when entering smartcard mode.
I'm thinking of something like what I use with my pcscapdu or nfcapdu tools but without being able to use Glib and readline for that (and with much less RAM).

To be checked/discussed how to add it either in https://github.com/hydrabus/tokenline (maybe the best) or directly in hydrafw ...


Arduino

your local files are very old and there has been many changes to the master branch. You always need to pull before pushing.


DOC: JsonOutputParser does not mention that input is not validated against schema.

Checklist

[X] I added a very descriptive title to this issue.
[X] I included a link to the documentation page I am referring to (if applicable).

Issue with current documentation:
The documentation at https://python.langchain.com/docs/modules/model_io/output_parsers/types/json/
seems to imply that the generated output is validated against the Pydantic schema and only JSON objects that conform to the schema are returned.
However, as I understand the source code, this does not seem to be the case.
Please consider adding a note to the JSON parser documentation that one should use PydanticOutputParser, if validation against the schema is desired.
Idea or request for content:
No response

Refer to https://python.langchain.com/docs/modules/model_io/output_parsers/types/pydantic/


Indentation fixed and blank spaces removed

Just minor fixes on indentation and blank spaces that I've found while trying out your gem. By the way, nice work :+1:

Very cool - Thanks!


Docs on rendering pipeline

Hi there,
Many thanks for making this engine available, it looks very interesting!
Do you perhaps have some minimal docs on the rendering pipeline? I wonder whether it might be possible to integrate rmlui lib into your engine ( a low level ui library). It is rendered directly on a window context (see e.g. https://github.com/mikke89/RmlUi/tree/master/Backends). Do you perhaps have any advice which would be the preferred place to inject this into supernova? Perhaps in subsystem/renderer?
Thanks for your great work!

I don't know how RmlUi is built, but I have some experience with ImGui and I think they might be similar. I think you have two ways to do this integration. The first one is the best but far more complicated and the second is easier but platform dependent.

Creating a RmlUi backend, renderer and platform for Supernova API:
Basically, you need to create a backend using engine/core/render classes and integrate system events. This method you maybe need to extend two classes: Rml::RenderInterface and Rml::SystemInterface. So your files could be:

RmlUi_Platform_Supernova.cpp
RmlUi_Renderer_Supernova.cpp
RmlUi_Backend_Supernova.cpp

Doing like this you can use RmlUi in all supported platforms that is allready (and could be supported in future) by Supernova.

Rendering Supernova scene to a texture and using it in RmlUi:
I have done something like this in editor project https://github.com/eduardodoria/supernova-editor using (Dear ImGui). It is a very early project and that is why it is not yet integrated into the main repo. This uses features that are only in main branch yet.
You create an external Framebuffer and uses it to draw entire engine. Something like this:
 Framebuffer framebuffer;

 Scene scene;
 Polygon triangle(&scene);

 triangle.addVertex(0, -100);
 triangle.addVertex(-50, 50);
 triangle.addVertex(50, 50);

 triangle.setPosition(Vector3(300,300,0));
 triangle.setColor(0.6, 0.2, 0.6, 1);

 Engine::setScene(&scene);
 Engine::setFramebuffer(&framebuffer);

So, in your RmlUi project you can use the texture generated by this framebuffer depending of your backend:
 framebuffer.getColorTexture().getGLHandler() // for GL backends
 framebuffer.getColorTexture().getMetalHandler() // for Metal backends
 framebuffer.getColorTexture().getD3D11Handler() // for DX11 backends

Look also that when render ImGui at my project here, I need to call render.startRenderPass(display_w, display_h) before, to clear some stufs leaved by last framebuffer pass (witch is the Supernova scene) and make sure that ImGui will be rendered at default framebuffer.

Thank you very much for your detailed answer! I might give this a try although I am not sure anymore whether it is a good idea overall. What makes your engine so interesting is that it is very lean. Adding rmlui would probably add some notable overhead. Perhaps it might be better to add more ui components directly.
if anything useable emerges from my tries I will report back! Thanks again for your fast and kind reply.

I know we do not have many UI components this moment, but the ones that exist are already enough to make simple UI like the many of games.
I have two UI samples that you can see here:

https://samples.supernovaengine.org/user-interface/
https://samples.supernovaengine.org/user-interface-3d/


allow screencapture?

I now that this is not the objective of this plugin but let me explain
I want to use prismatik (ambilight diy) and it need screen capure that i could solve running edge in sandboxie
The audio quality keeps, but the video breaks, i think that edge do a validation if the browser is inside of a sandbox, its the only idea i have

edge with netflix 4k ddplus

Sandboxied Edge with netflix 4k ddplus

Firefox natively support screen capture because:

Firefox for desktop supports the Google Widevine CDM for playing DRM-controlled content. Firefox downloads and enables the Google Widevine CDM by default to give users a smooth experience on sites that require DRM. The CDM runs in a separate container called a sandbox and you will be notified when a CDM is in use.
You can also disable a CDM and opt out of future updates by following the steps below. Once you disable a CDM, however, sites using this type of DRM may not operate properly.

can't


Cgroup paths containing ":" are not supported

Considering https://github.com/prometheus/procfs/blob/bc932d6aaa40fc66d46db859e9e03d954dc622c1/proc_cgroup.go#L52 it is clear that if the path contains additional ":" characters, the path will be truncated.
Colons may be inserted, for example when running kubernetes with containerd using a systemd cgroup-driver.
See:

https://github.com/containerd/containerd/blob/c35b4cfed520bf4827737f294f9292ffa73bdf8b/pkg/cri/server/helpers_linux.go#L67

And how containerd parses the file: https://github.com/containerd/cgroups/blob/8a68de567b68b30602948417a7a8e99ccf00ee9b/utils.go#L305
Changing:
	fields := strings.Split(cgroupStr, ":")

to
	fields := strings.SplitN(cgroupStr, ":", 3)

should address this.

Good catch, yeah this seems to be a bug. Can you submit a PR to change the lines as suggested?

Good catch, yeah this seems to be a bug. Can you submit a PR to change the lines as suggested?

I see that #260 added an explicit check and a test that would have to be modified.
The name on the test is:

"extra fields (such as those added by later kernel versions)"

Before I go and change this -- which I'm happy to do -- it may be good to get @hamiltont (who authored the PR) and @pgier who reviewed it to weigh in here.

I see that #260 added an explicit check and a test that would have to be modified.
The name on the test is:

"extra fields (such as those added by later kernel versions)"

Before I go and change this -- which I'm happy to do -- it may be good to get @hamiltont (who authored the PR) and @pgier who reviewed it to weigh in here.

Nice bug report. Here is a screengrab of the relevant bit of conversation from the linked PR. It was buried deep it the thread as an outdated discussion, but luckily Github preserved it for us :) Seems to me you could continue addressing this concern when using SplitN (I'm no expert at golang, so this may have just been my lack of knowledge that caused me to use Split). Feel free to update the documentation on that one test case if you'd like to make it more clear to the next person the reason the test case exists is to ensure we don't start failing/crashing if someone is running on a future version of the kernel with more params

Nice bug report. Here is a screengrab of the relevant bit of conversation from the linked PR. It was buried deep it the thread as an outdated discussion, but luckily Github preserved it for us :) Seems to me you could continue addressing this concern when using SplitN (I'm no expert at golang, so this may have just been my lack of knowledge that caused me to use Split). Feel free to update the documentation on that one test case if you'd like to make it more clear to the next person the reason the test case exists is to ensure we don't start failing/crashing if someone is running on a future version of the kernel with more params

Yes, I saw the discussion you posted, but it does not really answer my question. This functionality seems to cover hypothetical future situations, but currently breaks in at least one real-world use case (containerd under kubernetes uses : to separate path components when systemd is used as a cgroup driver).
My proposal would be to only handle the first two : characters and assume that everything following the second is the cgroup path. Note that the spec for the file does not state that the path cannot contain colons.

Yes, I saw the discussion you posted, but it does not really answer my question. This functionality seems to cover hypothetical future situations, but currently breaks in at least one real-world use case (containerd under kubernetes uses : to separate path components when systemd is used as a cgroup driver).
My proposal would be to only handle the first two : characters and assume that everything following the second is the cgroup path. Note that the spec for the file does not state that the path cannot contain colons.

Yeah, I was under the impression that : is a reserved separator. Looks like that's not the case, so the kernel can't introduce new fields and there is no need to worry about it.
So agreed that we should change:
fields := strings.Split(cgroupStr, ":")

to
fields := strings.SplitN(cgroupStr, ":", 3)

as @elezar suggested

Yeah, I was under the impression that : is a reserved separator. Looks like that's not the case, so the kernel can't introduce new fields and there is no need to worry about it.
So agreed that we should change:
fields := strings.Split(cgroupStr, ":")

to
fields := strings.SplitN(cgroupStr, ":", 3)

as @elezar suggested

Thanks @discordianfish
With regards to:

Yeah, I was under the impression that : is a reserved separator. Looks like that's not the case, so the kernel can't introduce new fields and there is no need to worry about it.

Just for my information / education: where would one check / confirm this?

Thanks @discordianfish
With regards to:

Yeah, I was under the impression that : is a reserved separator. Looks like that's not the case, so the kernel can't introduce new fields and there is no need to worry about it.

Just for my information / education: where would one check / confirm this?

Just for my information / education: where would one check / confirm this?

If you find out, let me know :D I think the kernel source is the only way to verify. There doesn't seem to be much standards around these kind of things.

Just for my information / education: where would one check / confirm this?

If you find out, let me know :D I think the kernel source is the only way to verify. There doesn't seem to be much standards around these kind of things.

I will do some digging when I get a chance, but for the time being I have created #354

I will do some digging when I get a chance, but for the time being I have created #354


feat: expose pool permit wait times

First off, big show of appreciation to the authors for this library - it must be a lot of work, but it's great 🎉
We (@influxdata / IOx) have been making use of sqlx to interact with our database catalog, a fundamental building block that maintains metadata state for the system (the store used to back the equivalent of INFORMATION_SCHEMA views in other databases). This can be a frequently hit resource.
While we're careful to minimise requests to the catalog, in some situations we have been saturating the available connections in the connection pool, leading to long waits to acquire a connection (and at times timeouts being hit waiting for this to complete).
We would love a way to measure this saturation, so this PR proposes capturing a cumulative sum of pool permit wait times and exposing them on through a Pool::pool_wait_duration() call.
We have tried to tackle this without an invasive change to sqlx, but this either leads to inaccurate measurements (decorating the Acquire trait conflates pool wait time with connection dial time, for example. Or perhaps polling Pool::num_idle()  and building a histogram of values, but this polling is expensive and the low sampling rate relative to high connection churn rate makes this practically useless).
Hopefully it is a helpful metric for others too 🎉

feat: expose pool permit wait times (bdaea311)
This commit adds a new pool_wait_duration() method to the Pool, returning the
total duration of time this Pool instance has spent waiting to acquire a
permit from the pool semaphore (rounded to the nearest millisecond).

This allows users to quantify the saturation of the connection pool
(USE-style metrics) and identify when the workload exceeds the available pool
capacity.

Both measuring the pool permit wait duration, and retrieving the measured
value are cheap operations.

test: assert pool wait upper bound (226539d7)
An upper bound of the pool wait time can be calculated in the
pool_wait_duration_counter_increases() test to further assert correctness.

Sorry for the delay. Got busy with work stuff.
I like the idea of adding a way to get metrics out of Pool, although I think the API here is a bit simplistic and would be difficult to glean useful information from.
If you're sampling .pool_wait_duration() at a fixed rate, say, every minute, and you see it increase by 2 seconds, that could mean a single acquire had to wait 2 seconds, or maybe 2000 acquires had to wait 1 millisecond, or somewhere in between or beyond.
Something like an exponential moving average might be more useful, but I think I'd like to see an API where the pool provides a way to set a callback to get these timings as they're generated.
One option I'm thinking is to have a trait that the user can implement for the timings they care about:
// bikeshedding
pub trait PoolMetricsObserver<DB: Database> {
    /// Receives the time a [`Pool::acquire()`] call waited for a connection permit.
    ///
    /// If this value is spiking, it may indicate the pool is reaching saturation.
    fn permit_wait_time(&self, pool: &Pool<DB>, time: std::time::Duration) {}
}

All the methods would have default implementations so the user can implement only what they care about, and then this would be settable on PoolOptions. We could then provide some types implementing things like a simple exponential moving average/max/min.
The other option is using the tracing and tracing-timing crates. I've just started using tracing for a work project and I really like the potential. tracing-timing filtering trace logs for sqlx_core::pool with spans set properly should be able to track and report timing for various operations within the pool, and also extend out into user code. It'd probably be the most flexible option, but it's a rather arcane way of collecting application metrics and I'd expect the discoverability to be poor. Still, might be an avenue worth exploring.

I'm happy to implement this +1

@domodwyer did you want to pivot this PR to that implementation or open a new one? I could also take a shot at if you're busy.

I have actually implemented the observer changes already, just need to tidy it up - I'll try and push it over the line today.
I plan on opening a new PR to keep things clean :+1:


Ant closures are broken with Gradle 7.6

I have various Gradle build files that use the "ant" task in conjunction with a closure which contains a set of ant tasks. Running the build files with Gradle 7.6, the build fails. Using the previous version 7.5.1, the build succeeds.
Here is a simple test that fails:
task test {
  doLast
  {
    ant
    {
      echo (message: 'hello world!')
    }
  }
}

Expected Behavior
expected the output of
[ant:echo] hello world!

Current Behavior
Execution failed for task ':test'.
> Problem: failed to create task or type call
  Cause: The name is undefined.
  Action: Check the spelling.
  Action: Check that any custom tasks/types have been declared.
  Action: Check that any <presetdef>/<macrodef> declarations have taken place.

Context
The given test case works with 7.5.1, but not with 7.6.
As I was unsure whether it is a bug or intended behavior, I asked in the Gradle forum about it (see here). I was told that this is likely not intended and may relate to the pull request 21242.
Steps to Reproduce
place the example in a "build.gradle" file, add an empty "settings.gradle". Run "gradle test" with the respective versions of Gradle.
Your Environment
Linux, Java 8 (Java HotSpot(TM) 64-Bit Server VM (build 25.271-b09, mixed mode))

Thank you for providing a valid reproducer.
The issue is in the backlog of the relevant team and prioritized by them.


Automate build and release

This should really build manylinux automatically with each release, and the windows build could be automated too.

A draft implementation of this is now active in .github/workflows. There are still a few hoops to jump through though:

[ ] Build 32-bit wheels on Linux
[ ] Remove the duplication
[ ] Work out a sensible set of events which should trigger various tasks
[ ] Implement caching, especially as numpy on mac and Pillow on Linux need to be built from source each time


Error in assemble

When I try make assemble (atlas assemble ../config.yaml), I'm having the follow error:
5 of 31 steps (16%) done
Error in rule normalize_coverage_across_kmers:
    jobid: 30
    output: testeverificar/sequence_quality_control/testeverificar_04_pe.fastq.gz
    log: testeverificar/logs/testeverificar_normalization.log

RuleException:
CalledProcessError in line 213 of /home/lricardo/miniconda3/lib/python3.5/site-packages/pnnl_atlas-1.0.15-py3.5.egg/atlas/rules/assemble.snakefile:
Command ' bbnorm.sh in=testeverificar/sequence_quality_control/testeverificar_03_pe.fastq.gz out=testeverificar/sequence_quality_control/testeverificar_04_pe.fastq.gz k=21 t=100                interleaved=t minkmers=15 prefilter=t                threads=40 2> testeverificar/logs/testeverificar_normalization.log' returned non-zero exit status 137
  File "/home/lricardo/miniconda3/lib/python3.5/site-packages/pnnl_atlas-1.0.15-py3.5.egg/atlas/rules/assemble.snakefile", line 213, in __rule_normalize_coverage_across_kmers
  File "/home/lricardo/miniconda3/lib/python3.5/concurrent/futures/thread.py", line 55, in run
Will exit after finishing currently running jobs.
Exiting because a job execution failed. Look above for error message
Complete log: .snakemake/log/2017-10-02T14:03:40.202404.snakemake.log
Traceback (most recent call last):
  File "/home/lricardo/miniconda3/bin/atlas", line 11, in <module>
    load_entry_point('pnnl-atlas==1.0.15', 'console_scripts', 'atlas')()
  File "/home/lricardo/miniconda3/lib/python3.5/site-packages/click/core.py", line 722, in __call__
    return self.main(*args, **kwargs)
  File "/home/lricardo/miniconda3/lib/python3.5/site-packages/click/core.py", line 697, in main
    rv = self.invoke(ctx)
  File "/home/lricardo/miniconda3/lib/python3.5/site-packages/click/core.py", line 1066, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/home/lricardo/miniconda3/lib/python3.5/site-packages/click/core.py", line 895, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/home/lricardo/miniconda3/lib/python3.5/site-packages/click/core.py", line 535, in invoke
    return callback(*args, **kwargs)
  File "/home/lricardo/miniconda3/lib/python3.5/site-packages/pnnl_atlas-1.0.15-py3.5.egg/atlas/atlas.py", line 218, in run_assemble
    assemble(os.path.realpath(config), jobs, out_dir, no_conda, dryrun, snakemake_args)
  File "/home/lricardo/miniconda3/lib/python3.5/site-packages/pnnl_atlas-1.0.15-py3.5.egg/atlas/workflows.py", line 47, in assemble
    check_call(cmd, shell=True)
  File "/home/lricardo/miniconda3/lib/python3.5/subprocess.py", line 271, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command 'snakemake -s /home/lricardo/miniconda3/lib/python3.5/site-packages/pnnl_atlas-1.0.15-py3.5.egg/atlas/Snakefile -d /home/lricardo/resultados_testecerto -p -j 80 --rerun-incomplete --configfile '/home/lricardo/config.yaml' --nolock --use-conda --config workflow=complete  --' returned non-zero exit status 1

What's in testeverificar/logs/testeverificar_normalization.log?

java -ea -Xmx210275m -Xms210275m -cp /home/lricardo/resultados_testecerto/.snakemake/conda/1a775d97/opt/bbmap-37.17/current/ jgi.KmerNormalize bits=32 in=testeverificar/sequence_quality_control/testeverificar_03_pe.fastq.gz out=testeverificar/sequence_quality_control/testeverificar_04_pe.fastq.gz k=21 t=100 interleaved=t minkmers=15 prefilter=t threads=40
Executing jgi.KmerNormalize [bits=32, in=testeverificar/sequence_quality_control/testeverificar_03_pe.fastq.gz, out=testeverificar/sequence_quality_control/testeverificar_04_pe.fastq.gz, k=21, t=100, interleaved=t, minkmers=15, prefilter=t, threads=40]
BBNorm version 37.17
Set threads to 100
Set INTERLEAVED to true
Set threads to 40
***********   Pass 1   **********
Settings:
threads:          	40
k:                	21
deterministic:    	true
toss error reads: 	false
passes:           	1
bits per cell:    	16
cells:            	50.11B
hashes:           	3
prefilter bits:   	2
prefilter cells:  	215.85B
prefilter hashes: 	2
base min quality: 	5
kmer min prob:    	0.5
target depth:     	400
min depth:        	3
max depth:        	500
min good kmers:   	15
depth percentile: 	64.8
ignore dupe kmers:	true
fix spikes:       	false
Made prefilter:   	hashes = 2   	 mem = 50.21 GB   	cells = 215.66B   	used = 0.150%
/home/lricardo/resultados_testecerto/.snakemake/conda/1a775d97/bin/bbnorm.sh: linha 169: 39886 Morto                   java -ea -Xmx210275m -Xms210275m -cp /home/lricardo/resultados_testecerto/.snakemake/conda/1a775d97/opt/bbmap-37.17/current/ jgi.KmerNormalize bits=32 in=testeverificar/sequence_quality_control/testeverificar_03_pe.fastq.gz out=testeverificar/sequence_quality_control/testeverificar_04_pe.fastq.gz k=21 t=100 interleaved=t minkmers=15 prefilter=t threads=40

openjdk version "1.8.0_121"
OpenJDK Runtime Environment (Zulu <IP_ADDRESS>-linux64) (build 1.8.0_121-b15)
OpenJDK 64-Bit Server VM (Zulu <IP_ADDRESS>-linux64) (build 25.121-b15, mixed mode)

From your results directory (or update the file paths), can you try:
/home/lricardo/resultados_testecerto/.snakemake/conda/1a775d97/bin/java \
  -ea -Xmx210275m -Xms210275m \
  -cp /home/lricardo/resultados_testecerto/.snakemake/conda/1a775d97/opt/bbmap-37.17/current/ jgi.KmerNormalize \
  bits=32 \
  in=testeverificar/sequence_quality_control/testeverificar_03_pe.fastq.gz \
  out=testeverificar/sequence_quality_control/testeverificar_04_pe.fastq.gz \
  k=21 t=100 interleaved=t minkmers=15 prefilter=t threads=40

I'm curious what the output of this is.

Executing jgi.KmerNormalize [bits=32, in=testeverificar/sequence_quality_control/testeverificar_03_pe.fastq.gz, out=testeverificar/sequence_quality_control/testeverificar_04_pe.fastq.gz, k=21, t=100, interleaved=t, minkmers=15, prefilter=t, threads=40]
BBNorm version 37.17
Set threads to 100
Set INTERLEAVED to true
Set threads to 40
***********   Pass 1   **********
Settings:
threads:                40
k:                      21
deterministic:          true
toss error reads:       false
passes:                 1
bits per cell:          16
cells:                  50.11B
hashes:                 3
prefilter bits:         2
prefilter cells:        215.85B
prefilter hashes:       2
base min quality:       5
kmer min prob:          0.5
target depth:           400
min depth:              3
max depth:              500
min good kmers:         15
depth percentile:       64.8
ignore dupe kmers:      true
fix spikes:             false
Made prefilter:         hashes = 2       mem = 50.21 GB         cells = 215.66B         used = 0.150%
Morto

Unsure. I like how it just says "dead" at the end.
How big is testeverificar/sequence_quality_control/testeverificar_03_pe.fastq.gz and could you make it available to me if it's of reasonable size to upload?

testeverificar_03_pe.fastq.gz has 225.242Kb
There is another way to send this to you?

email would work for a file that size, but it may get caught as spam. If you upload to google drive or dropbox or something similar, you can post the share link here.
This issue highlights the lack of working test data. I should get some added to the repository so we can isolate issues related to input files.

I upload to dropbox.
https://www.dropbox.com/s/2p4i7gi212ob6di/testeverificar_03_pe.fastq.gz?dl=0

I see this is SRR2053281, so I pulled that record (fastq-dump -M 200 --gzip SRR2053281) and I'm testing the workflow.

I test the workflow with another sample (of my work) and I'm having the same error.
I'll try to install in another computer, sometimes is something wrong on my server.

It looks like bbduk2.sh is not properly processing interleaved reads. It may depend on sequence identifiers ending with their index (/1 and /2) like:
@HWI-ST1035:121:C11C7ACXX:7:1101:18160:2566/1 1:N:0:AGTTCC
ATCCGAGTGCTTCGTTGCATCCGAGGGTTACGTGCGGGGGCCACCCGCACGTAACACTCCGATGGCGTGGCGCTCGACCCGACCGACCCCGCCG
+
BCCFFFFDHGHHHJJJJIJJJIJJJIIDEHGIGICHIGFDBDBBBDDD8B@A?B@CCDCDDDDDDDD0;>-55@DD-<BDB@BD>9@@@BBB@B
@HWI-ST1035:121:C11C7ACXX:7:1101:18160:2566/2 2:N:0:AGTTCC
CGTGCGGCGACCCGTCGGCCCGAAGCGTCGTCAGCGTCGCCAGGTGCCGGTCGGTCACGAAGGCCAGCACGGCGGGG
+
HHHHHJIJJIJJJJHHHFDDDDBDDDDDDDDDDDDDDDDDDBBDCCDCBBBDD@7@BDDDDDDDDB???AB7>BB>B

As opposed to how reads are formatted in SRAs:
@SRR2053281.8468 8468 length=202
AACAAAAAAGCATGGACATTGAATCGTTAAAAGCTTTTAGGACGCGCTTTGATTTACCAGTAAGCGACAAAGAGGTCGAGAGCCTATCATTCTACAAACCACATTTGAAAATGCGCTTAATGCCGGAATTTTTAACGACGTAGTTTTTCTGCGACGTGCTGGTAAGAAACCACCCAGCTCTTTTCTTCGTTCCATCATGTAT
+SRR2053281.8468 8468 length=202
BBBFFFFFFFFFFIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIFFFFFFFFFFFBBFFFFFFFFFFFFFFBFFFFFFFFFFFFFFFFFFFFFFFBBBBFFFFFFFFFFIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFF
@SRR2053281.8470 8470 length=202
AACAAAAAAGGGCTTGGCGGCTCTCTGTTCGGCGTGTCCCGGCTTTGTCCGTCCTTGGCTTACCACCCGTGAGGGCTGTGCTTCGGACTGCCGTGAGTTGCCGAGCCAGATACTCGCAAGCGGAAAGACGCTCTGTAAGTCAGCAAGACCGCCAAGCACGAACTTGGTGGCTCTCTGAAACGCTCCCGCCTCACGGCGGTTC
+SRR2053281.8470 8470 length=202
BBBFFFFFFFFFFIIIIIIIIFIFFFIFIFFIIIFFFFFFBFBFBFFFFFFFF

But I try run another sample:
@MG00HS14:536:C69PWACXX:4:1101:1716:2037 1:N:0:GATCAG
NCCAAACTTTCATATATGTTGCGATTAGCTCTGGGATGTTTAATGTTGTGTTTGTCCAGATACCGTTATTCTTAATAACCAAGTTATCGTTTTCATCTTTT
+
#1=DDFFFHHHHHJJIJJJJJJJJIJIJJIJJJJJJIJCHIIJJIHIJEIIJJJIJJGGIJJJJIGHIEHGH>AE@DEEFFDECEEEDBDDDDDDEEDDDD
@MG00HS14:536:C69PWACXX:4:1101:1720:2098 1:N:0:GATCAG
TTCGTTGGGAGAGAGAATAACGGTGGCGACTTCTGGAATTACTCCAGCTTGGAGACTTTGATAATCGCTAACACCAGCATCGAGGAAAACTACGGTAGCGG
+
CCCFFFFFHFHHHJJJIJJJIJI?FEIIJIJIJJJIGIGIGIIJHGGHGHJFCGAEHHHGEFBDFDDCDCDDDDD?ABDDDBDDDDDDDD@CD@>989>@B
@MG00HS14:536:C69PWACXX:4:1101:1584:2166 1:N:0:GATCAG
CTTCAGAGAGGTGTAACCGACGTTCGAGCCGTGCAGGTTCTGCGCGGCATAGAGTTCGATGGCCTTGTCCCAACTGCCCGCCGTGCGCAGCGCTCGCGCCT
that looks like your first example.
Using this sample I have the follow error:
5 of 31 steps (16%) done
rule normalize_coverage_across_kmers:
input: TIETE25-R3/sequence_quality_control/TIETE25-R3_03_pe.fastq.gz
output: TIETE25-R3/sequence_quality_control/TIETE25-R3_04_pe.fastq.gz
log: TIETE25-R3/logs/TIETE25-R3_normalization.log
jobid: 29
benchmark: logs/benchmarks/normalization/TIETE25-R3.txt
wildcards: sample=TIETE25-R3
threads: 40
bbnorm.sh in=TIETE25-R3/sequence_quality_control/TIETE25-R3_03_pe.fastq.gz out=TIETE25-R3/sequence_quality_control/TIETE25-R3_04_pe.fastq.gz k=21 t=100                interleaved=t minkmers=15 prefilter=t                threads=40 2> TIETE25-R3/logs/TIETE25-R3_normalization.log
Activating conda environment /home/lricardo/resultados_tiete/.snakemake/conda/8cbb0d89.
Error in rule normalize_coverage_across_kmers:
jobid: 29
output: TIETE25-R3/sequence_quality_control/TIETE25-R3_04_pe.fastq.gz
log: TIETE25-R3/logs/TIETE25-R3_normalization.log
RuleException:
CalledProcessError in line 213 of /home/lricardo/miniconda3/lib/python3.5/site-packages/pnnl_atlas-1.0.15-py3.5.egg/atlas/rules/assemble.snakefile:
Command ' bbnorm.sh in=TIETE25-R3/sequence_quality_control/TIETE25-R3_03_pe.fastq.gz out=TIETE25-R3/sequence_quality_control/TIETE25-R3_04_pe.fastq.gz k=21 t=100                interleaved=t minkmers=15 prefilter=t                threads=40 2> TIETE25-R3/logs/TIETE25-R3_normalization.log' returned non-zero exit status 137
File "/home/lricardo/miniconda3/lib/python3.5/site-packages/pnnl_atlas-1.0.15-py3.5.egg/atlas/rules/assemble.snakefile", line 213, in __rule_normalize_coverage_across_kmers
File "/home/lricardo/miniconda3/lib/python3.5/concurrent/futures/thread.py", line 55, in run
Will exit after finishing currently running jobs.
Exiting because a job execution failed. Look above for error message
Complete log: .snakemake/log/2017-10-03T12:25:19.256711.snakemake.log
Traceback (most recent call last):
File "/home/lricardo/miniconda3/bin/atlas", line 11, in
load_entry_point('pnnl-atlas==1.0.15', 'console_scripts', 'atlas')()
File "/home/lricardo/miniconda3/lib/python3.5/site-packages/click/core.py", line 722, in call
return self.main(*args, **kwargs)
File "/home/lricardo/miniconda3/lib/python3.5/site-packages/click/core.py", line 697, in main
rv = self.invoke(ctx)
File "/home/lricardo/miniconda3/lib/python3.5/site-packages/click/core.py", line 1066, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
File "/home/lricardo/miniconda3/lib/python3.5/site-packages/click/core.py", line 895, in invoke
return ctx.invoke(self.callback, **ctx.params)
File "/home/lricardo/miniconda3/lib/python3.5/site-packages/click/core.py", line 535, in invoke
return callback(*args, **kwargs)
File "/home/lricardo/miniconda3/lib/python3.5/site-packages/pnnl_atlas-1.0.15-py3.5.egg/atlas/atlas.py", line 218, in run_assemble
assemble(os.path.realpath(config), jobs, out_dir, no_conda, dryrun, snakemake_args)
File "/home/lricardo/miniconda3/lib/python3.5/site-packages/pnnl_atlas-1.0.15-py3.5.egg/atlas/workflows.py", line 47, in assemble
check_call(cmd, shell=True)
File "/home/lricardo/miniconda3/lib/python3.5/subprocess.py", line 271, in check_call
raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command 'snakemake -s /home/lricardo/miniconda3/lib/python3.5/site-packages/pnnl_atlas-1.0.15-py3.5.egg/atlas/Snakefile -d /home/lricardo/resultados_tiete -p -j 80 --rerun-incomplete --configfile '/home/lricardo/config_tiete.yaml' --nolock --use-conda --config workflow=complete  --' returned non-zero exit status 1

Are you running both indexes for this particular sample? If you're processing this as a single-end sample, you will need to specify that. See https://pnnl-atlas.readthedocs.io/en/latest/assembly/samples.html#single-end-input


Don't show right sidebar when there is only one definition

For the screenshot below I did a quick on a function for which there is only a single definition.
If there is only a single defintion, then right sidebar adds no value and it should not be shown.

This feature request will not be considered in the next 6-12 months roadmap and as such will be closed to keep the number of issues we have to maintain actionable. Thanks for understanding and happy coding!


disable single-user mode boot in grub2 for centos7

#98978368
Signed-off-by: Hua Zhang<EMAIL_ADDRESS>

Changes Unknown when pulling 208c974efc7312ff108407f9d0c6fa5fcc9b8d8c on zhang-hua:stig-V-38586 into ** on cloudfoundry:develop**.

Thanks, @coveralls?


EdgeTPU compiler creates a model with different behaviour

Please make sure that this is a bug. As per our
GitHub Policy,
we only address code/doc bugs, performance issues, feature requests and
build/installation issues on GitHub. tag:bug_template
System information

Have I written custom code (as opposed to using a stock example script provided in TensorFlow): YES
OS Platform and Distribution (e.g., Linux Ubuntu 16.04): Ubuntu 18.04.1
Mobile device (e.g. iPhone 8, Pixel 2, Samsung Galaxy) if the issue happens on mobile device: -
TensorFlow installed from (source or binary): Docker image latest-gpu-py3-jupyter
TensorFlow version (use command below): 2.1.0
Python version: 3.6
Bazel version (if compiling from source): -
GCC/Compiler version (if compiling from source): -
CUDA/cuDNN version: 10.1
GPU model and memory: Nvidia RTX 2080TI / 12 GB

You can collect some of this information using our environment capture
script
You can also obtain the TensorFlow version with:

TF 1.0: python -c "import tensorflow as tf; print(tf.GIT_VERSION, tf.VERSION)"
TF 2.0: python -c "import tensorflow as tf; print(tf.version.GIT_VERSION, tf.version.VERSION)"

Describe the current behavior
When I try to compile fot edgeTPU a full-quatized and fully working model it just shows a different not expected output
Describe the expected behavior
Same output for same input in both models: full quantized and compiled for EdgeTPU from the previous full quantized.
Standalone code to reproduce the issue
You can see the problem here
https://gist.github.com/ianholing/cbda145cfeb03124d6a286c619302aa6
And here there are anything you need to reproduce the notebook:
https://drive.google.com/open?id=1u9fH3PVmfmR4xXIJnXOPlx789eyKhVOS
Other info / logs Include any logs or source code that would be helpful to
diagnose the problem. If including tracebacks, please include the full
traceback. Large logs and files should be attached.

This should due to currently the input & output is float32 for full-quantization for tf.compat.v2.lite.TFLiteConverter in TF 2.1 even setting:
converter.inference_input_type = tf.uint8
converter.inference_output_type = tf.uint8

TFLite team will add this feature soon.
The current workaround is to modify the type of input & output here

I tried in some TF versions even nightly and always same error, I don't know where this package is:
ModuleNotFoundError: No module named 'tensorflow.lite.tools'

@ianholing It looks like you are using an older Version of Tensorflow . Many bugs have been fixed in the latest version. Could you please execute your code using Latest Version 2.4.1 or 2.5 and let us know if the issue still persists? Thanks!

Hi @sushreebarsa, you can close this issue if you want, this was more than one year ago.. at that time i tried all the latest versions but nowadays I don't keep the code to try again sorry.


[Bug Report] AutoSmelt ability applied with all ores.

Describe the bug
A clear and concise description of what the bug is.
Versions (please complete the following information):

Minecraft Server Version: [1.15.2]
Plugin Version: [1.8-Dev-Build-v8.1-SNAPSHOT-Build#142]

*Do NOT say Latest use /version crazyenchantments in the console.
Issue
I think AutoSmelt applies at only iron ore and gold ore, but this enchant applies at all ores.

AutoSmelt gives metal as much as AutoSmelt levels(this is I said why Autosmelt applied with all ores). I think is bug.
When with Telepathy, It gives 1 more.

same at v143

almost fixed in v149, but with Telepathy makes fortune off.

sorry, my mistake. this is not an bug.


Possible Memory Leak in WatchBackend

Over the last few weeks we've been noticing that memory usage for our instances continues to grow.  I performed a pprof and found that about 1/3 of the used memory at the time was for main.WatchBackend.   In our environment, we use the manual overrides to control when services are introduced to be load balanced as well as allow us to disable load balancing while allowing the service to be healthy.  Because of that we have a pretty large number of overrides (currently ~3700, and we are  pretty much constantly adding and removing manual overrides.

I'm still digging into this issue.  I've been unsuccessful in recreating the behavior in a lab environment.  I'm gathering some more pprofs from devices to try and narrow down what's happening.  It's possible that our solution to address #611 will resolve this behavior as well.

We made some good progress on this yesterday.  From what we can tell, the memory leak has something to do with "next" being a string.  We have switched it to be a bytes.Buffer and changed the Parse function in parse_new.go to use a bufio.NewScanner.  With these changes we are no longer seeing the rapid increase in memory utilization.  We're going to do some additional cleanup and also look at whether using strings.builder works as well.  We should be able to have a PR and some really good performance comparisons that we can share soon.

@murphymj25 that sounds great, thanks debugging and resolving that. Looking forward to the PR!

I have created pull request #629 and added some detail on memory performance comparing the pull request to the current 1.5.11 release.


[question] Secure Inclusion is successful but Secure shows No?

I'm trying to use Secure Inclusion to add some Z-Wave devices to my network.
It appears to be successful because the devices are added but on the control panel under the Secure column they are listed as "No".
Am I misunderstanding the Secure column?
For example, one device is a GE Outdoor Smart Switch.  It supports S2 Encryption and I believe when I added this using other Z-Wave hubs I needed to enter a number listed on a sticker inside the box?
However I'm also having the same issue with other devices such as Zooz ZEN27 light switches which also support S2.

Some devices require a different setup in order to enable secure/non secure inclusion. For example in my aeotec wall plug I had to press the button two times instead of just one in order to secure include it (even if you start a secure inclusion from the UI side). I suggest you to better check the device manual

Also S2 isn't supported by zwave-js yet

I've seen the comment that Zwavejs doesn't support S2 yet, but when I added my Zooz ZST10 controller at the beginning of June it said "Yes" under the Secure column. I added my two Yale Assure door locks and Aeotec Gen7 Recessed Door Sensor using the "Secure Inclusion" option, and I got error messages in the controller that said something like ...secure inclusion failed... However, they all said "Yes" under the Secure column. Today I had to recover from a snapshot I took yesterday before upgrading Home Assistant from 2021.6.5 to 2021.6.6, but now my controller says "No" and the locks and door sensor say "Unknown" under the Secure column. Now my automations are broken and I can no longer remotely lock and unlock the door locks.

I have Auto Update turned on for the add-on, so I'm not sure if this was caused by an update or what. Does anyone know what's going on before I open a standalone issue for this?

Try to re-interview affected nodes first

Try to re-interview affected nodes first

Already re-interviewed the nodes three different times, including once after restarting Home Assistant and once after rebooting the host. I also tried "healing" the network. None of these options worked.
I also noticed that the advanced configuration options for my door locks and sensor have disappeared. I reviewed their feature list, and it said those advanced configuration options were only available when the device was securely included to the Z-Wave network. I thought that there was a chance these devices were never securely included because of the error I initially got when I first included them, but now I'm second guessing that because I did have access to the "secure" features on those devices for almost a month.
As much as I would prefer to dive down the rabbit hole to figure out the exact cause of this issue, I'm afraid I'm running out of time and I might need to factory reset and build this network again from scratch because these locks control the main points of ingress and egress to my house (a.k.a. the rest of the family is yelling at me).
Does anyone know if this might be an issue with zwave-js 7.7.4 or zwavejs2mqtt 5.0.2?

Could someone add zwavejs logs please? Moving this to zwave-js repo but cannot do so much without logs


Document how to build dynamic aggregations

This showed up on StackOverflow today:
http://stackoverflow.com/questions/25027546/usage-of-aggregationcontainer-in-elasticsearch-nest
Would be nice to be able to link to a page that explains this.

Closing this as per #942


Customizability issue

Could you make it possible to add/remove the default selected items, a lot of people disable this plugin due to it warning for items they don't care if they lose such as the standard ava's etc then end up losing the items they do care for, as they forget to turn it back on.
Would be a perfect plugin if it wasn't for this slight issue.
Cheers

Hey, I've implemented this, and requested the change to runelite. Expect it to come out in a few days time. You will be able to remove items through item name or id in a comma seperated list. Please see the readme if you want more info.
Thanks for the suggestion 👍