Making all things Modules

https://laravelmodules.com/docs/v11/introduction
using this great library I am moving core structure into modules others can import and then plug into.

Functions (Tagging, Search, Email, Voice)
Integrations (Email, Brave Search API etc, Google Calendar)

Going well making TaggingFunction as a module to see how it works.

need to move LlmDriver as it's own module


data "aws_vpc_endpoint_service" is not following the AWS API specification

Description
The data source "aws_vpc_endpoint_service" is insisting on service_name to be a mandatory input parameter. Based on official documentation (https://registry.terraform.io/providers/hashicorp/aws/latest/docs/data-sources/vpc_endpoint_service): " The given filters must match exactly one VPC endpoint service whose data will be exported as attributes." If it is not defined the terraform end up with the error message "Error: multiple VPC Endpoint Services matched; use additional constraints to reduce matches to a single VPC Endpoint Service".
Well, and this is not aligned with AWS API specification for this data source "aws_vpc_endpoint_service" where you can query multiple or all VPC endpoints in one query and hence the get list of supported endpoints within particular region.
It is very handful to have such a full list of currently supported VPC endpoints within region, even more for regions which are not enabled by default and support for certain VPC endpoints is usually delivered with delay against default regions.
Reference, e.g. to boto3 implementation of "describe_vpc_endpoint_services" api can be found here https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/ec2.html#EC2.Client.describe_vpc_endpoint_services.
So, in python easy:
QUERY:
response = client.describe_vpc_endpoint_services(
    DryRun=False,
    Filters=[
        {
            'Name': 'service-type',
            'Values': [
                'Interface',
            ]
        },
    ]
)

print(json.dumps(response['ServiceNames']))

RESPONSE:
["aws.sagemaker.af-south-1.notebook", "aws.sagemaker.af-south-1.studio", "com.amazonaws.af-south-1.acm-pca", "com.amazonaws.af-south-1.application-autoscaling", "com.amazonaws.af-south-1.appmesh-envoy-management", "com.amazonaws.af-south-1.athena", "com.amazonaws.af-south-1.autoscaling", "com.amazonaws.af-south-1.cloudformation", "com.amazonaws.af-south-1.cloudhsmv2", "com.amazonaws.af-south-1.codebuild", "com.amazonaws.af-south-1.codedeploy-commands-secure", "com.amazonaws.af-south-1.config", "com.amazonaws.af-south-1.datasync", "com.amazonaws.af-south-1.dms", "com.amazonaws.af-south-1.ebs", "com.amazonaws.af-south-1.ec2", "com.amazonaws.af-south-1.ec2messages", "com.amazonaws.af-south-1.ecs", "com.amazonaws.af-south-1.ecs-agent", "com.amazonaws.af-south-1.ecs-telemetry", "com.amazonaws.af-south-1.elasticbeanstalk", "com.amazonaws.af-south-1.elasticbeanstalk-health", "com.amazonaws.af-south-1.elasticfilesystem", "com.amazonaws.af-south-1.elasticfilesystem-fips", "com.amazonaws.af-south-1.elasticloadbalancing", "com.amazonaws.af-south-1.events", "com.amazonaws.af-south-1.execute-api", "com.amazonaws.af-south-1.fis",
"com.amazonaws.af-south-1.glue", "com.amazonaws.af-south-1.imagebuilder", "com.amazonaws.af-south-1.kinesis-firehose", "com.amazonaws.af-south-1.kinesis-streams", "com.amazonaws.af-south-1.kms", "com.amazonaws.af-south-1.lambda", "com.amazonaws.af-south-1.logs", "com.amazonaws.af-south-1.macie2", "com.amazonaws.af-south-1.monitoring", "com.amazonaws.af-south-1.rds", "com.amazonaws.af-south-1.redshift-data", "com.amazonaws.af-south-1.s3", "com.amazonaws.af-south-1.sagemaker.api", "com.amazonaws.af-south-1.sagemaker.featurestore-runtime", "com.amazonaws.af-south-1.secretsmanager", "com.amazonaws.af-south-1.servicecatalog", "com.amazonaws.af-south-1.sns", "com.amazonaws.af-south-1.sqs", "com.amazonaws.af-south-1.ssm", "com.amazonaws.af-south-1.ssmmessages", "com.amazonaws.af-south-1.storagegateway", "com.amazonaws.af-south-1.sts"]

And I got what I need - full list of VPC endpoints supported within provided region.
Current implementation of data source "aws_vpc_endpoint_service" is not according the AWS API spec. And that is causing the workarounds and hacks e.g. keeping the supported vpc endpoints within the static file, or using null_resource, etc... Instead of having it in comfort nice terraformish way.
Versions

Terraform:
Terraform v0.14.7
Provider(s):
aws 3.36.0
Module:
Data Source: aws_vpc_endpoint_service

Reproduction

Steps to reproduce the behavior are very easy:
run plan or apply over:
data "aws_vpc_endpoint_service" "list_all_supported_endpoints_in_region" {
service_type = "Interface"
}
Code Snippet to Reproduce
data "aws_vpc_endpoint_service" "list_all_supported_endpoints_in_region" {
service_type = "Interface"
}
Expected behavior
The expected behavior is as described in AWS API spec and it should return the list of all supported VPC endpoints within the particular region. And not throws the error - "Error: multiple VPC Endpoint Services matched; use additional constraints to reduce matches to a single VPC Endpoint Service".
Actual behavior
The error is thrown "Error: multiple VPC Endpoint Services matched; use additional constraints to reduce matches to a single VPC Endpoint Service".

sorry. opened under wrong repository.


fixed syntax error

:+1:

@chirimoya removed the aligning of phpdocs from the styleci config file.

looks good @danrot


Clear time/random slot scheduling definition if program is manually updated

There is currently no way to remove time/random slot scheduling definitions from a channel. If the user makes a manual edit to a channel (and saves it) we should consider clearing out the schedule defintion.

Just tested this out and it actually happens already today. Closing.


return datatype of db()?

Hi there!
Sprinkled throughout the docs is that the datatype of 'row' is not for the faint of heart - it's never mentioned.
The question I'd like to ask if it is possible use a create a iterable collection rows in as an auto.  A simple example, say I have a function that takes an optional PK as an argument.  When the arg is provided, a select where id = {arg} is done, otherwise I'm selecting all.
COHORTS mySQLRepository::GetCohorts(OBJECT_ID_CONST id = 0 );
Without knowing the datatype of a db(select...) return, I have to do some really inelegant cut and paste programming to handle the optional argument
if ( id == 0 )
{
  for (const auto& row : db(sqlpp::select(all_of(cohort)).from(cohort).unconditionally()) )
  {
    < do stuff with rows >
  }
}
else
{
  for (const auto& row : db(sqlpp::select(all_of(cohort)).from(cohort).where( cohort.id == id)) )
  {
    < do exact same stuff with rows >
  }
}

Is there not a way to be able to have a single set of table rows as an auto that would allow me to have a single loop to process the rows?
The docs mention that the rows collection data type is pretty hairy.  Could there not be a helper #define generated with the .h files that would allow the rows collection to be an auto variable?
Love the work of this project - really a big plus!
C.

Hi,
The type of the result row depends on the selected columns. Since they are the same in both cases, the following should work (minus typos):
auto rows = id
   ? db(sqlpp::select(all_of(cohort)).from(cohort).where( cohort.id == id))
   :  db(sqlpp::select(all_of(cohort)).from(cohort).unconditionally());
for (const auto& row : rows)
{
   // ...
}

If you have more of these optional conditions, you might want to look into either dynamic_select with dynamic_where or boolean_expression.
Best,
Roland


General OCP 4.6 Lab Content Updates

A smattering of updates to the content that should be agnostic of lab delivery method (e.g. ROKS).  These changes were generated from IBM OpenLabs testing.  For more details on changes, see individual commit messages for all changes.
For rendered version of the changes, see here (github pages of my forked repo)

@blues-man changes we discussed have now been added to this pull request.  These include:

https when referring to parksmap routes
Putting database grouping in tip
no more %CLUSTER_SUBDOMAIN% mapped to attribute

I also made a small change to contributing.adoc where I used markdown notation instead of adoc


fix: temp and manual fix const reassign

As discussed in #5 this is a temporary manual fix in the bundled version for the Cannot assign to "size" because it is a constant runtime error by manually changing const to let.

:tada: This PR is included in version 1.3.1 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release

Your semantic-release bot :package::rocket:


Bitwise operator replacement

Invert bitwise operators.

From
To

&
|

|
&

^
&

&^
&

»
«

«
»

INVERT_BITWISE
Disabled by default

@k3rn31 If you don't mind I'd like to take this.
How do we want to handle the bitwise ops assignments?

Do we want to add them under the INVERT_ASSIGNMENTS mutator?
Or do we want to create a more specific mutator like INVERT_BITWISE_ASSIGNMENTS?

AND_ASSIGN:     "&=",
OR_ASSIGN:      "|=",
XOR_ASSIGN:     "^=",
SHL_ASSIGN:     "<<=",
SHR_ASSIGN:     ">>=",
AND_NOT_ASSIGN: "&^=",

Hello,
please, go ahead!
What do you think of calling it INVERT_BITWISE?
Let's keep it disabled by default.

@k3rn31 great. I've opened #169 to track the bitwise assignments 😄

This has been completed but for some reason it wasn't closed with the merge.


Jmatio reads large file exceptions

jmatio-1.0
Exception in thread "main" java.lang.IllegalArgumentException: Negative size
at sun.nio.ch.FileChannelImpl.map(FileChannelImpl.java:865)
at com.jmatio.io.MatFileReader.read(MatFileReader.java:287)
at com.jmatio.io.MatFileReader.(MatFileReader.java:154)
at com.jmatio.io.MatFileReader.(MatFileReader.java:102)
at com.hw.parse.prob.tocassandra.Test.main(Test.java:23)

prob_20200913_12.mat file size is 3.11GB
How can I solve this problem? Thank you

History: JMatIO was forked as MatFileRW, which fixed a lot of bugs, and has the same API as JMatIO.  Then https://github.com/HebiRobotics/MFL came along, which is a new API, but much better.
My guess is that switching to MatFileRW is easy, and might fix your problem, but probably not.  Switching to MFL will almost definitely fix your problem, but it will take some work.


http://localhost:8080/userinfo 500 (Internal Server Error)

Expected behavior and actual behavior:
Recover without error given /userlogin returns 500
Steps to reproduce the problem:
Run px-app-nav in demo mode (grunt devmode)
Environment (component version number, Browser (including version), operating system, hardware, etc):
px-app-nav version v1.6.1
https://github.com/PredixDev/px-app-nav
Screenshots (optional, but very helpful):

We need to extract server-side component from px-login ui component

A refactor is in progress by Henry @gedesigntech


Implement fix for UI bug regarding addRole command

Altered the listener on the UI component for the list of roles tagged to a company to refresh the list of roles whenever there is a change to the list.

Just tried the fix but there seems to be an issue. The UI updates for when the company initially has a populated role list since the start of the application, but does not update otherwise. This issue can be recreated by calling addRole with a company that has an empty role list from the start.

Thanks for the find!

Codecov Report

Merging #93 (66656af) into master (669221e) will decrease coverage by 0.13%.
The diff coverage is 0.00%.

@@             Coverage Diff              @@
##             master      #93      +/-   ##
============================================
- Coverage     68.95%   68.82%   -0.14%
  Complexity      484      484
============================================
  Files            84       84
  Lines          1572     1575       +3
  Branches        169      169
============================================
  Hits           1084     1084
- Misses          448      451       +3
  Partials         40       40

Impacted Files
Coverage Δ

src/main/java/seedu/address/ui/CompanyCard.java
0.00% <0.00%> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 669221e...66656af. Read the comment docs.

LGTM 👍 nice use of SLAP too.


fix: added reset password section to auth page

Resolves appsmithorg/appsmith-docs#16042.

@spark-c - the reset password section doesn't fit in the authentication landing page. Do you think we can add it to some other page? The issue talks about email page. Also, could you please add a screenshot for the reset password link?

@jnikhila Sure, I'll move it to the email page as the ticket mentioned; I had initially put it in the Auth page since it's related to user sign-in methods, and email is just a prerequisite but not as related topically. I'll put a screenshot in as well

@jnikhila Sure, I'll move it to the email page as the ticket mentioned; I had initially put it in the Auth page since it's related to user sign-in methods, and email is just a prerequisite but not as related topically. I'll put a screenshot in as well

Let's discuss this in standup, before you make any changes.

@jnikhila Sure, I'll move it to the email page as the ticket mentioned; I had initially put it in the Auth page since it's related to user sign-in methods, and email is just a prerequisite but not as related topically. I'll put a screenshot in as well.

Let's discuss this in standup before you make any changes. Update: As discussed, let's add it to the Troubleshooting Guide - Application Errors - Reset Password Section.

I think this should be under Authentication -> Email under a subheading called - Reset email password

@jnikhila Sure, I'll move it to the email page as the ticket mentioned; I had initially put it in the Auth page since it's related to user sign-in methods, and email is just a prerequisite but not as related topically. I'll put a screenshot in as well.

Let's discuss this in standup before you make any changes. Update: As discussed, let's add it to the Troubleshooting Guide - Application Errors - Reset Password Section.

I think this should be under Authentication -> Email under a subheading called - Reset password

@danciaclara - Authentication doesn't have a sub-page Email. Are you referring to Instance Configuration -> Email.

Note after discussion:

Add callout on Email page to let Admins know to set up email in case users need to reset passwords in the future
In the future, may add a cross-reference on another page to this content on the Troubleshooting page.

Note: linter fixes for the Email page are contained in a different PR that was raised to fix a formatting issue on the page.

@danciaclara - Shouldn't the guide follow the cause/error and solution format? Also, the file has conflicts that would need to be fixed.


:loaded PseudoClass for initial transitions

Is your feature request related to a problem? Please describe.
I have a control that I want to fade in once my control loads:
<Border x:Name="Root" Opacity="0">
    <Border.Transitions>
        <Transitions>
            <DoubleTransition Property="Opacity" Duration="0:0:0.15" />
        </Transitions>
    </Border.Transitions>
    <!-- ... -->
</Border>

Using the base style selector like so does not do anything:
<Style Selector="^ /template/ Border#Root">
    <Setter Property="Opacity" Value="1" />
</Style>

Describe the solution you'd like
To me it would seem intuitive to have a built-in :loaded pseudoclass, and use that to set Opacity to 1.  For my own TemplatedControls, I add my own :loaded pseudoclass and trigger it on the loaded event. This works as expected like so:
<Style Selector="^:loaded /template/ Border#Root">
    <Setter Property="Opacity" Value="1" />
</Style>

Describe alternatives you've considered
I could use an animation with the base selector like so:
<Style Selector="^ /template/ Border#Root">
    <Style.Animations>
        <Animation Duration="0:0:0.15" FillMode="Forward">
            <KeyFrame Cue="100%">
                <Setter Property="Opacity" Value="1"/>
            </KeyFrame>
        </Animation>
    </Style.Animations>
</Style>

However this is not only cumbersome, but would interfere with my :disabled style:
<Style Selector="^:disabled /template/ Border#Root">
    <Setter Property="Opacity" Value="0.7" />
</Style>

I could make that use an animation too, but that would be even more cumbersome for a seemingly very basic task.

Possibly should be extended to other control lifecycle events, too, but would require more design work.

It's pretty easy to just add a new pseudoclass on loaded event and remove on unloaded. In fact, developers can do the same in their apps too.
But to be part of the framework, we should refactor pseudoclasses support to only be calculated when there are actual styles using them on a control.


Add WassersteinDistanceEvaluator

Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 100.00%. Comparing base (dfab9d6) to head (95427f9).
Report is 1 commits behind head on main.

Additional details and impacted files
@@            Coverage Diff            @@
##              main      #529   +/-   ##
=========================================
  Coverage   100.00%   100.00%
=========================================
  Files          128       129    +1
  Lines         3531      3559   +28
  Branches       182       182
=========================================
+ Hits          3531      3559   +28

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


Improve Offline-Functionality

At the moment c:geo is mainly designed for "live-caching", loading nearby caches over the internet. In the last days a lot of people asked me if we could improve the offline-functionality of c:geo.

Better performance, up to 4000 and more caches in database (issue #11)
Search in offline caches (name, GC-code, owner...)
GPX-export

Just adding to this list the ability for "Caches around" to work offline.  See issue 734.
It's useful for planning a sequence of caches without having to 'be there'.


add 3DTopia-XL as library

Library name 3dtopia-xl has been added in the repo 3DTopia-XL for 3D generation https://huggingface.co/FrozenBurning/3DTopia-XL
This PR will allow automatic download stats on *.pt files in the repo together with code snippets on how to use them.

Updated! Thanks @Vaibhavs10 !


Enhanced initialization for FLAnimatedImage & FLAnimatedImageView

Overall it allows more efficient, and easier, loading of GIF or still images and loading them into an animated image view.

Much of this functionality could be easily implemented outside of FLAnimatedImage, and building as a framework has been working since 1.0.10. I'm going to close this PR.

The framework parts weren't supposed to be in here. My mistake for not using a proper branch for the PR.  The init methods, although yes they can be implemented outside (as most things can), are fairly useful for using the library. Would you consider it if I commit without the framework commit?

I don't think the changes are necessary.

Weird considering it implements something that has been noted in the code as basically a TODO.
https://github.com/Flipboard/FLAnimatedImage/blob/master/FLAnimatedImage/FLAnimatedImage.m#L196
Necessary? no...  convenient? yes

@timonus By the way... you cannot initialize an FLAnimatedImage from a CGImageSource without these changes. So, actually, no you cannot really implement this outside.  In our code we carry around CGImageSource's in a few different places.  I suppose you're suggesting I just turn those into NSData only to have FLAnimatedImage turn them back into a CGImageSource? I don't see the downsides of this code as it only expands the usefulness of the class and ensures there is no needless transcoding between CGImageSource and NSData.

Ah, yes, you're right. I've wanted to have an initializer that allows you to pass in an image source, I'll pull your changes that add that functionality out of this diff.


3.0.8 s3 fix

The problem here seems to be that I failed to backport a cleanup of this code where the return type of get_s3_key changed. But I did backport a change that relied on that previous cleanup.

Since the problem seems to be return values this might not be applicable but I'll ask anyway - would there be a log for certificate failure even if cache exists? This is to avoid the silent failure scenario.
Also, how can we find out which ca certificate file the requests library is using when running under pyinstaller?

Yeah, before I merge, I think I'll add that. It should really have been generating an error before this.


Error: Element type is invalid when attempting to use YouTube component

I'm relatively new to React, so this might be an error on my behalf, but I'm at my wits end trying to figure out what is wrong here.
I installed using npm install --save react-youtube
My super super simple file is below:
import React from 'react';
import YouTube from 'react-youtube';

class YouTubeVideo extends React.Component {

    constructor(props) {
        super(props);
        this._onReady = this._onReady.bind(this)
    }

    render() {
        const opts = {
            height: '390',
            width: '640'
        }
        return(
            <YouTube videoId={this.props.youtube_video_id} opts={opts} onReady={this._onReady}/>
        )
    }

    _onReady(event) {
        if (this.props.startAt) event.target.seekTo(this.props.startAt, true)
        if (this.props.mute) event.target.mute()
        event.target.playVideo()
    }
}

export default YouTubeVideo;

Alas -- I receive this error:
bundle.js:66730 Error: Element type is invalid: expected a string (for built-in components) or a class/function (for composite components) but got: object. Check the render method of 'YouTubeVideo'.
Any idea what gives?
The only thing I can think of causing this issue is the imports, but everything looks like it is being imported correctly! I've been staring at this for hours and I have no idea what could be happening.

Try logging YouTube to the console to see what this object is...
(in the constructor add console.log(YouTube))

Hi @tjallingt -- thanks for the response.
I am able to log the object, which prints off the following in Chrome's console:
const webpack = require('webpack')

module.exports = {
	devtools: 'eval-source-map',
	entry: [
		// For hot style updates
		'webpack/hot/dev-server',
		'webpack-hot-middleware/client',
		 './src/index'
	],
	output: {
		path: path.join(__dirname, 'public'),
		filename: 'bundle.js',
		publicPath: '/public/',
		historyApiFallback: {
			index: '/public/'
		}
	},
	devServer: {
		historyApiFallback: true
	},
	plugins:[
		new webpack.NoErrorsPlugin(),
		new webpack.optimize.OccurrenceOrderPlugin(),
		new webpack.HotModuleReplacementPlugin()
	],
	module: {
		loaders: [
			{
				test:/\.js$/,
				include: [
					path.join(__dirname, 'src')
				],
				loaders: ['react-hot', 'babel']
			},
			{
			  test: /\.css$/,
			  loader: 'style-loader'
			}, {
			  test: /\.css$/,
			  loader: 'css-loader',
			  query: {
			    modules: true,
			    localIdentName: '[name]__[local]___[hash:base64:5]'
			  }
			}
		]
	},
	resolve: {
		extensions: ['.js']
	}
}

Furthermore, in VS Code, my text editor/IDE, I am able to see that the component is being properly linked, as I can "jump" into it. The typically "check" of removing the import statement causes the component to be "undeclared", and changing the import syntax to use {} also yields no improvements. I can see that YouTube is exported as a default class, so the curly brace import syntax shouldn't be required.
The app is build with webpack, and it uses babel. For completeness I've added my webpack config file below.
const path = require('path')
const webpack = require('webpack')

module.exports = {
	devtools: 'eval-source-map',
	entry: [
		// For hot style updates
		'webpack/hot/dev-server',
		'webpack-hot-middleware/client',
		 './src/index'
	],
	output: {
		path: path.join(__dirname, 'public'),
		filename: 'bundle.js',
		publicPath: '/public/',
		historyApiFallback: {
			index: '/public/'
		}
	},
	devServer: {
		historyApiFallback: true
	},
	plugins:[
		new webpack.NoErrorsPlugin(),
		new webpack.optimize.OccurrenceOrderPlugin(),
		new webpack.HotModuleReplacementPlugin()
	],
	module: {
		loaders: [
			{
				test:/\.js$/,
				include: [
					path.join(__dirname, 'src')
				],
				loaders: ['react-hot', 'babel']
			},
			{
			  test: /\.css$/,
			  loader: 'style-loader'
			}, {
			  test: /\.css$/,
			  loader: 'css-loader',
			  query: {
			    modules: true,
			    localIdentName: '[name]__[local]___[hash:base64:5]'
			  }
			}
		]
	},
	resolve: {
		extensions: ['.js']
	}
}

@Kamil1 It looks like you've accidentally pasted your webpack config twice instead of the result of console.log(YouTube).
Your webpack config looks good, I don't think it's causing the problem. Can you share your babel config as well?

@goto-bus-stop Whoops, yes you are correct. Let me try logging the object again and update my original post. Regardless, I do believe I'm importing the code correctly as well.
My .babelrc file is below:
{
  "presets": [
    "es2015",
    "react",
    "stage-0"
  ],
  "env": {
    "development": {
      "plugins": [["react-transform", {
        "transforms": [{
          "transform": "react-transform-hmr",
          "imports": ["react"],
          "locals": ["module"]
        }]
      }]],
	  "presets": [
        "react-hmre"
      ]
    }
  }
}

Thanks! I'm not familiar with react-transform myself, but it looks like the react-hmre preset already configures that plugin here: https://github.com/danmartinez101/babel-preset-react-hmre/blob/master/index.js So it's added twice. I don't know if that could be related but it might be worth a shot to remove the react-transform part:
{
  "presets": [
    "es2015",
    "react",
    "stage-0"
  ],
  "env": {
    "development": {
      "presets": [
        "react-hmre"
      ]
    }
  }
}

@goto-bus-stop Thanks for the suggestion!
I replaced my .babelrc file the one you've attached above, and unfortunately I'm encountering the same error 😞
A screenshot of the logging + error message is below.

I am able to successfully import and use dependencies from places (such as axios for requests), which makes this issue even more difficult for me to figure out.
Could it be that my npm run build script is wrong?
"build": "cross-env NODE_ENV=development webpack --config ./webpack.dev.config.js --progress --colors"

Hello @Kamil1 I'm sorry for the delay in getting back to you.
Are you still experiencing this issue?
If so could you share the code that is generating the error? so I'd like to see the code in bundle.js where the error is triggered (which should be the render method of your YouTubeVideo class).


TlsCredentials: add cancel_check_peer() for the security connector

This PR aims to add a cancel_check_peer() function for the security connector, and implement a no-op for all its successors.
The main usage for this is the custom verifier in TlsCredentials, where users can do asynchronous operations and need a way to clean up their resource when the handshaker is shutdown.

Yeah, we did have some internal implementations of the security connector. I will schedule a cherry-pick earlier next week then. BTW, can I know who would be the importer next week?

I'll be the importer next week.  Just let me know when the cherry-pick is ready, and we can coordinate.  Thanks!


DocumentId doesn't always convert down to String and back

While digging on a flaky test (#104), I resolved that issue only to find that in some cases a DocumentId() generated and converted to a String (DocumentId().id) doesn't 100% of the time convert back to a valid DocumentId().
The code underneath is using BS58 encoding (Base58.base58CheckEncode(data.bytes) for data generated by UUID(). The reverse uses Base58.base58CheckDecode(stringValue) - so you'd think that would be 100%, but apparently not.
An iteration test going through 1000 of these, converting to string and trying to get back, shows a loss of 1 or 2 in 1000 (0.1 to 0.2% failure). Need to figure out why, and in the mean time I have some definite examples:

1YNk8bmh2xxuNqeAjsuPy4JjnwF
1Tf5GWML5KA18TJqUN9qKarxbhm
1ZEbwfpSJxXascTx7sstBecFLky
12mS52BJoU16LAzKmMdwgGW4tQQ
1kVFyeTJ6WjUmMT8pGCEesQDVxa

XCTAssertNotNil failed - id: 1ezULPhgshBPYi4H2MTBoMKwc3S [00cf851bc4f4441d86d127c26774145e] doesn't back convert (try #71)

XCTAssertNotNil failed - id: 1Ui7LyCmx1vxgvdu2md5t8mcFsC [00975afb316a438ba1b5d9d54d80f113] doesn't back convert (try #293)

Well, that's disappointing. It's a known issue in the upstream project (https://github.com/keefertaylor/Base58Swift/issues/23, https://github.com/keefertaylor/Base58Swift/issues/25), with a PR open to fix it (https://github.com/keefertaylor/Base58Swift/pull/21)


Observed failures in the execution of two scripts

I have observed errors in the execution of two scripts, these are not saved in the log, and I cannot determine what is causing them, so I pass you two screenshots in case they are useful.
Script error 1:

This may have to do with the tutorial not running correctly, but I'll open an issue about it.
Script error 2:

Regards

The first script error is easy to reproduce, but the second one... how can I reproduce it ?

The second error has only given me once and I do not know how to reproduce it again, perhaps it is a point error.
The fact is, I was driving actor Ray or Reyes, where the body was in the Bridge room, when that bug came out. I know I tried many options or else with the body, poster, light ... I don't know, since when I realized it, it had come out. Perhaps I would have blocked the console window to capture the first failure and then this one came out ... or it was for any other reason, since I have not been able to reproduce it again in new tests that I have carried out.
So at the moment I can not be of help in the face of this failure, if in the future I see it again, I will comment here.

I have seen that with this commit:
Fix findScreenPosition called with an object as argument https://github.com/scemino/engge/commit/ffcfb38020fc855ca05464c7f1cc949881772732
This error has occurred:

What I said in the previous post, is resolved in this commit, although many other failures arise, such as, One actor cannot give an object to another, the height of the texts that the actors say is now incorrect, it has also been generated new layer errors. For example:

Now willie if he snores, you see the text and you hear him snore, although his head blinks and he continues to see the text "snore" even if Boris advances to the right and stops seeing Willie.
I guess maybe part of these bugs you already know, so I'll wait for new commits, before opening new issues

If you agree, I can close this issue, the first script error has been fixed (and the regression) and I can't reproduce the second script error.
If it happens again, just open a new issue.

Yes, I think it is the right thing to do. If this error appears again, it will reopen an issue


Cannot subscribe by email

Using ghost:4.20.4, visitors are not able to subscribe by email, as the step that sends a magic link seems to fail. Note that mailing works well when I publish articles, so my Mailgun API key seems to be properly setup. Only subscribing using public form seems to be broken.

(I have replaced the email address with a placeholder)
the modal shows the following error after 60 seconds

in the dev console, the endpoint https://xxx.xxx/members/api/send-magic-link/ has a status 504 Gateway time out.
In the log, it says 200:

Note that when I use another email (namely, foo@bar.com), the error is different. The endpoint receives a 500 internal server error status and the logs show

Therefore it seems Ghost and Mailgun do not communicate well anymore. The operations above do not create log lines in the Mailgun dashboard, where I only see logs related to recent publications.

Is it working using 4.20.3 or 4.19.x ?

It is not working with 4.20.3, with identical symptoms. I am a bit hesitant to test with 4.19.x, I fear downgrading could break the DB. But before submitting the ticket, I have updated from 4.16.0 and it was the same.
FWIW, I'm using EU Mailgun servers.

It feel like you should go to Ghost forums. It's unlikely an issue with the container.

Will do! Thanks for your support

Follow up: I did not realize that Mailgun transactional and bulk email settings are defined at different places. Transactional seems to be setup in config.production.json (see doc) while bulk email API setup is done in the settings within ghost interface.
I did not properly configure the json. Now that I have done it, subscription works as intended. To do so, I have edited my docker command in the following way to have a proper json within the image.
sudo docker run -d --name blog-v4 -e url=https://my.domain.fr -p 3001:2368 \
  -v /var/lib/ghost/content:/var/lib/ghost/content \
  -v /var/lib/ghost/config.production.json:/var/lib/ghost/config.production.json ghost:4

If this help, I wrote a tutorial about these settings.


DirectoryScanner.removeDefaultExclude() doesn't work with Gradle Distribution plugin

Current Behavior
Execution failed for task ':module:installDist'.
> Cannot change default excludes during the build. They were changed from [**/#*#, **/%*%, **/*~, **/.#*, **/.DS_Store, **/._*, **/.bzr, **/.bzr/**, **/.bzrignore, **/.cvsignore, **/.git, **/.git/**, **/.gitattributes, **/.gitignore, **/.gitmodules, **/.hg, **/.hg/**, **/.hgignore, **/.hgsub, **/.hgsubstate, **/.hgtags, **/.svn, **/.svn/**, **/CVS, **/CVS/**, **/SCCS, **/SCCS/**, **/vssver.scc] to [**/#*#, **/%*%, **/*~, **/.#*, **/.DS_Store, **/._*, **/.bzr, **/.bzr/**, **/.bzrignore, **/.cvsignore, **/.git, **/.git/**, **/.gitmodules, **/.hg, **/.hg/**, **/.hgignore, **/.hgsub, **/.hgsubstate, **/.hgtags, **/.svn, **/.svn/**, **/CVS, **/CVS/**, **/SCCS, **/SCCS/**, **/vssver.scc]. Configure default excludes in the settings script instead.

Expected Behavior
No error
Context (optional)
No response
Steps to Reproduce
In <root>/settings.gradle.kts
import org.apache.tools.ant.DirectoryScanner

DirectoryScanner.removeDefaultExclude("**/.gitattributes")
DirectoryScanner.removeDefaultExclude("**/.gitignore")

In <root>/module/build.gradle.kts
plugins {
    distribution
}

distributions {
    main {
        contents {
            duplicatesStrategy = DuplicatesStrategy.EXCLUDE
            from(fileTree("template")) {
                into("template/_default")
            }
        }
    }
}

Gradle version
8.3
Build scan URL (optional)
No response
Your Environment (optional)
No response

Sorry that you're having trouble with Gradle!
We appreciate the effort that went into filing this issue, but we must ask for more information.
As stated in our issue template, a minimal reproducible example is a must for us to be able to track down and fix your problem efficiently. Our available resources are severely limited, and we must be sure we are looking at the exact problem you are facing.
If we have a reproducer, we may be able also to suggest workarounds or ways to avoid the problem.
The ideal way to provide a reproducer is to leverage our reproducer template. You can also use Gradle Project Replicator to reproduce the structure of your project.
This issue will be closed after 7 days unless you provide more information.

I can't reproduce your issue with the information provided.  See my reproducer

Hello @ov7a , seems it is no longer reproduced on my project. I think it may related to Gradle Build Cache or Gradle Daemon.
Here is my gradle.properties
org.gradle.caching=true
org.gradle.jvmargs=-Xmx2048m -Dfile.encoding=UTF-8 -XX:+UseParallelGC
org.gradle.kotlin.dsl.allWarningsAsErrors=true
org.gradle.parallel=true

Otherwise, you are free to close this issue. I apologize for the incomplete information I provided before. I will use the reproducer template when I have an issue next time.

Thanks, @Omico!
While I agree that this issue can be caused by caching, I doubt anyone would investigate this without a reproducible scenario. So I'm closing this for now.


Spyder freezes when uninstalling

Spyder launched via anaconda it freezes when I am trying to uninstall a package through its console
I am using this method:
pip uninstall sos

Hi @msh855 thank you for the feedback! Did you install sos using pip? Seems like you are using a conda env. Also, I would recommend to try to install/uninstall your package through the terminal first and then launch Spyder.
Let us know if something of the above helps

with conda it worked but with pip doesn't. This is not specific to this package but whenever I am trying to uninstall any package

Is there any reason for you to use pip instead of conda to uninstall conda packages?

Sadly, cannot remember the reason. I think something was not working with conda because I was using Jupyter notebook and then I fixed this with pip install.

When checking this seems like running pip uninstall ... or conda uninstall ...  directly in the console can take a long time for the client to show output. The client shows that is doing an execution but not freezing Spyder (the red stop execution button gets enable) at least on Windows.
Not totally sure if there is something we can do about this @msh855 , maybe @ccordoba12 or @impact27 have any suggestion?
The only thing I would suggest as I say is to first setup you env packages through a terminal and then launch Spyder

Thanks. But I think is a freeze, because as I show in the snapshot I am asked to proceed with Y/n and does nothing when I press Y ( neither stops when I press n)

Not totally sure if there is something we can do about this @msh855 , maybe @ccordoba12 or @impact27 have any suggestion?

Nop, unfortunately there isn't. Our IPython console is not a real terminal (i.e. like cmd.exe or xterm) although it looks like one. So it's unable to deal with keyboard interaction like in this case, and that's something we can't fix, sorry.
Therefore, your options are:

As @dalthviz said

first setup you env packages through a terminal and then launch Spyder

In other words, do package installation using a terminal.

Run pip uninstall -y to avoid pip asking for confirmation. However, be aware that we will soon remove support for installing packages in the IPython console using pip or conda because that's not the right way to do it (it can lead to additional errors). So it's better that you start using a terminal to install packages.


gopls vscode no symbols found

What version of Go are you using (go version)?

$ go version
go version go1.12.4 windows/amd64

Does this issue reproduce with the latest release?
yes
What operating system and processor architecture are you using (go env)?
go env Output
$ go env
set GOARCH=amd64
set GOBIN=
set GOCACHE=C:\Users\hw\AppData\Local\go-build
set GOEXE=.exe
set GOFLAGS=
set GOHOSTARCH=amd64
set GOHOSTOS=windows
set GOOS=windows
set GOPATH=C:\Users\hw\go
set GOPROXY=
set GORACE=
set GOROOT=C:\Go
set GOTMPDIR=
set GOTOOLDIR=C:\Go\pkg\tool\windows_amd64
set GCCGO=gccgo
set CC=gcc
set CXX=g++
set CGO_ENABLED=1
set GOMOD=
set CGO_CFLAGS=-g -O2
set CGO_CPPFLAGS=
set CGO_CXXFLAGS=-g -O2
set CGO_FFLAGS=-g -O2
set CGO_LDFLAGS=-g -O2
set PKG_CONFIG=pkg-config
set GOGCCFLAGS=-m64 -mthreads -fno-caret-diagnostics -Qunused-arguments -fmessage-length=0 -fdebug-prefix-map=C:\Users\hw\AppData\Local\Temp\go-build951410218=/tmp/go-build -gno-record-gcc-switches

What did you do?
vscode version 1.33.1
vscode-go version 0.9.2
settings.json

"go.useLanguageServer": true,
"go.alternateTools": {
"go-langserver": "gopls"
},
"go.languageServerExperimentalFeatures": {
"format": true,
"autoComplete": true,
"diagnostics": true,
"goToDefinition": true,
"hover": true,
"signatureHelp": true,
"goToTypeDefinition": true,
"documentSymbols": true,
"findReferences": true
},
"editor.codeActionsOnSave": {
"source.organizeImports": true
},
"go.buildOnSave": "off",
"go.vetOnSave": "off"

What did you see instead?
everything going well ,but the outline Explorer Tab shows

No symbols found in document

use shortcut Ctrl + Shift + o to Go to Symbol in File shows

No symbols found

when I set "go.useLanguageServer": false and reload , it goes well
thanks for help

I believe this is not a gopls problem, there was a bug in the vscode-go extension that prevented symbols from working.
It was fixed on tip a while ago, but is not yet in the released build I think.
You can try out the beta version as described here
If you try that and it does not work, please re-open this bug.

thanks ~ it works


(Deploy): CustomResource not authorized to perform: lambda:InvokeFunction on CRCRLambda3E918D98

Describe the bug
When deploying the main stack, the creation of CRCRLambda3E918D98 failed due to lack of Lambda:Invoke permission.
This is an occasional problem and does not always occur.
Expected Behavior
CRCRLambda3E918D98 should be CREATE_COMPLETE.
Current Behavior
Received response status [FAILED] from custom resource. Message returned: User: arn:aws:sts::123456789012:assumed-role/clo-AWS679f53fac002430cb0da5b87ServiceRoleC-6M7fFaBGK31r/clo-AWS679f53fac002430cb0da5b87ServiceRoleC-JX13hYB6jKYj is not authorized to perform: lambda:InvokeFunction on resource: arn:aws:lambda:eu-west-2:123456789012:function:clo-CRInitConfig61C535DA-PzPMT99ySWPM because no identity-based policy allows the lambda:InvokeFunction action (RequestId: c104f983-ce4a-44a4-96c4-fbe6003bbd76)
Reproduction Steps
Deploy the main stack with CloudFormation.
Possible Solution
No response
Additional Information/Context
No response
Solution Version
v2.0.0
AWS Region. e.g., us-east-1
eu-west-2
Other information
No response

The cause of the problem may be that the role's permissions have not yet taken effect, causing the Custom Resource to fail to invoke CRCRLambda3E918D98.
You can solve this problem in the following ways.

Deploy the main stack with CloudFormation.
In the Configure stack options page where Stack is created, select Stack failure options -> Preserve successfully provisioned resources.
If the stack creation fails, click Retry to complete the stack creation.

Unable to reproduce the issue in latest version


Crash if World Mode is "Canvas" with "2D-No sampling" Viewport in scene

Godot version:

3.0 Stable
OS/device including version:

Linux x64 Fedora 27
Linux 4.14.14-300.fc27.x86_64
GeForce GTX 1050 (mobile) 384.111
Issue description:

When a World with Mode set to "Canvas" is being used, but a viewport in the scene is set to 2D-No sampling a crash occurs.
Either the game crashes on startup or the editor depending on the order.
Even if the failure might be ok (canvas requires sampling?) IMHO it should not crash, especially not the editor.
The failure happens on accessing the [] at:
https://github.com/godotengine/godot/blob/master/drivers/gles3/rasterizer_scene_gles3.cpp#L4193
Steps to reproduce:
In demo project:

Make sure the sub-viewport is set to "2D No sampling"
In the world node set mode to "Canvas"
The game will crash
(if the steps are being done 2. & 1. the editor will crash)

Minimal reproduction project:

issue_world_crash.zip
EDIT:
I can even replicate it even without a viewport in my main game. Simple "Mode: Canvas" causes a crash here, so it might be related to something else.
EDIT2:
Good news, I had the project settings allocation set to "2D No sampling". Setting it to 2D works, so the initial report is correct.

On master c3023e8 editor still crash with GLES 3 with this backtrace
Dumping the backtrace. Please include this when reporting the bug on https://github.com/godotengine/godot/issues
[1] /lib/x86_64-linux-gnu/libc.so.6(+0x3ef20) [0x7fe2e5866f20] (??:0)
[2] CowData<RasterizerStorageGLES3::RenderTarget::Effects::MipMaps::Size>::get(int) const (/home/rafal/Pulpit/Godot/./core/cowdata.h:149 (discriminator 7))
[3] Vector<RasterizerStorageGLES3::RenderTarget::Effects::MipMaps::Size>::operator[](int) const (/home/rafal/Pulpit/Godot/./core/vector.h:89)
[4] RasterizerSceneGLES3::render_scene(Transform const&, CameraMatrix const&, bool, RasterizerScene::InstanceBase**, int, RID*, int, RID*, int, RID, RID, RID, RID, int) (/home/rafal/Pulpit/Godot/drivers/gles3/rasterizer_scene_gles3.cpp:4236)
[5] VisualServerScene::render_empty_scene(RID, RID) (/home/rafal/Pulpit/Godot/servers/visual/visual_server_scene.cpp:2135)
[6] VisualServerViewport::_draw_viewport(VisualServerViewport::Viewport*, ARVRInterface::Eyes) (/home/rafal/Pulpit/Godot/servers/visual/visual_server_viewport.cpp:216)
[7] VisualServerViewport::draw_viewports() (/home/rafal/Pulpit/Godot/servers/visual/visual_server_viewport.cpp:308)
[8] VisualServerRaster::draw(bool, double) (/home/rafal/Pulpit/Godot/servers/visual/visual_server_raster.cpp:107 (discriminator 2))
[9] VisualServerWrapMT::draw(bool, double) (/home/rafal/Pulpit/Godot/servers/visual/visual_server_wrap_mt.cpp:104)
[10] Main::iteration() (/home/rafal/Pulpit/Godot/main/main.cpp:1867)
[11] OS_X11::run() (/home/rafal/Pulpit/Godot/platform/x11/os_x11.cpp:2821)
[12] /home/rafal/Pulpit/Godot/bin/godot.x11.tools.64(main+0xdc) [0x1133d33] (/home/rafal/Pulpit/Godot/platform/x11/godot_x11.cpp:56)
[13] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xe7) [0x7fe2e5849b97] (??:0)
[14] /home/rafal/Pulpit/Godot/bin/godot.x11.tools.64(_start+0x2a) [0x1133b9a] (??:?)
-- END OF BACKTRACE --

GLES 2 seems to work fine

FYI: this is still reproducible in Godot 3.1.1 Stable.

Just some notes on this.
Looks like when using Canvas BG mode, the renderer will draw an empty scene when in 2D mode. However, the 3D buffers are not allocated when sampling is set to 2D-no sampling, resulting in the crash. https://github.com/godotengine/godot/blob/3c7327da332c6bf56f8c2a8e601a13fa718ede05/servers/visual/visual_server_viewport.cpp#L244-L248
Proper fix will either replace the render_empty_scene call in visual server viewport. Or just ensure that nothing is drawn when the viewport is configured not to draw.


\mathit not auto-selected

This should print ä:
\documentclass{article}
\usepackage{unicode-math}
\begin{document}
  $ \mathit{ä} $
\end{document}

\documentclass{article}
\usepackage{unicode-math}
\setmathfontshape\mathit{Latin Modern Roman}
\begin{document}
  $ \mathit{ä} $
\end{document}

results in:

Shouldn't it be italic?

No -- the clue is the term "font face" in the name. The command doesn't load the family and select italic, it just uses the exact font requested. So you need to specify something like "Latin Modern Italic" or whatever.
I haven't looked at the code yet, but I'm not sure why this isn't being picked up from the default font setup. I hope to fix it up soon.

The Font 'Latin Modern Roman' has different faces. Italics, upright, small caps. But it's the same font. How am I supposed to tell it the family?

The most reliable way is to load by filename: lmroman10-italic.otf. You might need to use the SizeFeatures command to get optical sizing working properly though.

All this makes it much harder to use it, where just using amsmath \text simply works.
Redeclaring \renewcommand*#1\mathit{\text{\textit{#1}}} seems much easier then getting \setmathfontface right and working for all sizes.
What's the point of it then? Sorry if i'm sounding annoying, but at the moment I just see that things are much harder to get right for the end user than before.

It depends what you're using it for :-)
The \mathzz commands differ from \textzz in that they don't leave maths mode, so while for most purposes you are correct, there are some differences at the TeX level.
I'm restricted in what I can do with these commands in that I have to retain compatibility with traditional LaTeX. Note that once the code is fixed up, \mathit should "just work" to match the default "roman italic" font. (Hopefully the other shapes such as \mathbf are already working but I'll check.) The commands are provided in case you need to change from the default.

It works as expected if one explicitly load the font after unicode-math (it does not work if the \setmainfont is used before): \mathbf is similar.
\documentclass{article}
\usepackage{unicode-math}
\setmainfont{Latin Modern Roman}
\begin{document}
$ \mathit{aä} $
\end{document}


Visual error with steam n rails mod.

It is fixed with the /flywheel backend off command, but this completely loses the importance of this mod.This entity is constantly teleport to me.When you place a track from steam n rails mod it should appear.
version=1.20.1
Forge=47.2.0
Windows=10
Edit=I realized that "the factory must grow" addon may also be causing this problem

Could you please provide the game version, mod version, and a list of all the mods you are currently using? With these details, I'll be able to help you more effectively. 😊
Additionally, I noticed that you are not using shaderpacks. This mod will not function properly unless shaderpacks are enabled. If you prefer not to use shaderpacks, you may consider removing this mod.


Why just "RESET ALL" is used to reset the state of a pooled connection?

Hi all,
While looking at how connection pool is implemented I got surprised about the current implementation uses just RESET ALL [1] statement to do the job. According PostgreSQL documentation [2] it will reset just run-time parameters.
Sorry about my very newbie question about the project. I just got curious about how advanced things we can do with PHP nowadays (used PHP for long time in the past) and nowadays I help PostgreSQL development.
So if the real intention here is to restore connection to it initial state in PostgreSQL it should use DISCARD ALL [3] instead, because can exist other temp resource we can left behind without doing it that can lead us to leak resources, for example:

cached plans and sequences
prepared statements
temporary tables
advisory locks

Another example is pgbouncer [1] the most known connection pool for PostgreSQL that uses DISCARD ALL as the default of server_reset_query.
[1] https://github.com/amphp/postgres/blob/master/src/Pool.php#L82
[2] https://www.postgresql.org/docs/current/sql-reset.html
[3] https://www.postgresql.org/docs/current/sql-discard.html
[4] http://www.pgbouncer.org/config.html#connection-sanity-checks-timeouts

Hi!
Thanks for bringing this to my attention. The intention was restoring the connection to the initial state. I was not aware of DISCARD ALL and thought RESET ALL was the correct statement. I'll update the code and tag a release.


Tree structure. New parser extension API

TODO:

[x] Redesign parser extension plugin API

[x] enable tests (currently marked xfail)
[x] update docs

[x] Tidy up
[x] Consider an alternative solution once more?

[x] Rebase https://github.com/executablebooks/mdformat/pull/85 on this branch and ensure that this actually helps there

[x] Write changelog

mdformat.renderer.MARKERS removed
parser extension plugin API changed

Removed mdformat.plugins.ParserExtensionInterface.render_token
Added mdformat.plugins.ParserExtensionInterface.RENDERER_FUNCS

start and stop kwargs removed from mdformat.renderer.MDRenderer.render, use render_tree to render partial Markdown
mdformat.renderer.TreeNode added
mdformat.renderer.MDRenderer.render_tree added

Just out of interest, why this change?

My thinking is this might be the least hacky solution to the problems I've ran into working on https://github.com/executablebooks/mdformat/pull/85 (or in general, modes where original word wrap is not preserved).
https://github.com/executablebooks/mdformat/pull/85 lists some of the problem points. In brief, not all whitespace is equal in Markdown, so when altering word wrap I need some context (e.g. is the whitespace in an HTML block, part of an inline code block etc.).
The current paragraph formatter that should do word wrap changes (def paragraph_close function) only receives a paragraph str and is not aware what parts of the str belong in what Markdown structures. This limitation has been blocking my work.
A very unfortunate side effect of a change like this is that I think I'd have to break the plugin API...
This is still sort of a "conceptualization phase" so if you have any thoughts, ideas, or alternative ways, that could help out, would appreciate it :smiley_cat:

cheers will do

@chrisjsewell I still haven't been able to think of a less disruptive way to tackle the issues I had, so I'm thinking to merge this.
This will break parser extension plugin API just as I feared earlier. I already sketched out a PR to adapt mdformat-tables to the changes: https://github.com/executablebooks/mdformat-tables/pull/7
If you have time and interest to do a review, would be great! Otherwise I think I'll merge in a day or two.

thanks for the heads-up @hukkinj1, I'll try to find some time to review, but don't worry if not.

This will break parser extension plugin API just as I feared earlier.

can you clarify what you mean by this; does it reduce the functionality available to plugins, or is it just that they have to be re-written?

can you clarify what you mean by this; does it reduce the functionality available to plugins, or is it just that they have to be re-written?

Just have to be rewritten. There shouldn't be any reduced functionality. The plugins just now have to deal with the SyntaxTreeNode tree structure instead of the linear List[Token] stream.


Cloud Endpoints, support Google App Engine Standard for Python 3.x

I have 2 questions.

When will Cloud Endpoints support Google App Engine (GAE) standard environment for python 3.x?
As you know, in https://cloud.google.com/endpoints/docs/frameworks/python/get-started-frameworks-python, "Note: Make sure you have Python 2.7.x installed. python 3.x isn't supported by Endpoints Frameworks." Even though python 2.7.x is end of support this year, I can not upgrade to python 3 using Endpoints Frameworks in GAE standard environment.
Unfortunately, I could not find out features in this repository.

If the Endpoints Frameworks is not supported for GAE standard for python 3, what library should I use?

Kind Regards,

Why are you closing this issues? There are no intentions of provide a version for python 3?
Next year python 2.7 reaches EOL!


HDDS-8588. Add initialization logic in CertificateClient to handle more than one rootCA certificate

What changes were proposed in this pull request?
This enables the CertificateClient to read multiple root CA certificates. Also contains changes for another issue: Prepare TrustManagers to handle multiple root CA certficates.
These changes make it possible to read multiple root CAs from the file system and then add them to the trust managers during initialization. Even though multiple root CA certificates are present at the same time the certificates are still returned with a proper trustchain because they are already stored as a certificate path. The exception under this case is a case when a client still uses the old only the certificate is stored model, in that case it rebuilds the entire trust chain from the stored certificates. (Which adds a bit of complexity, but it shouldn't cause that many performance issues, because usually we are talking about cert chains with the length of 3 rn)
What is the link to the Apache JIRA
Add initialization logic to CertificateClient to handle more than one root ca
Prepare trust managers to store more than one root CA
How was this patch tested?
Added unit test, and run on my gitlab fork: https://github.com/Galsza/ozone/actions/runs/5134600741
TestSecureOzoneCluster indirectly tests the certificate chain building part of the code.
DefaultCertificateClient#getTrustChain might need additional unit tests, but it's being refactored by Pifta rn, and I'd prefer to keep changes to a minimum for methods that might be affected anyway.
NOTE: this change might be failing on TestSecureOzoneCluster#testOMGrpcServerCertificateRenew , for which the fix is added to master, and it's going to be rebased to that once that change gets merged. Here is the pr for it:
https://github.com/apache/ozone/pull/4807

@Galsza is this one still a draft? Please move it to open if you think it is ready to review.

Pr is now ready for review

This PR is continued here: https://github.com/apache/ozone/pull/4853 as the feature branch is abandoned


Freeze renderstate

fixes #3752

Thanks @ateshuseyin!  @bagnell can you take a look at this?

@ateshuseyin, this doesn't entirely fix the issue. You wrote a function to do a deep freeze of objects, but does not freeze the render states.
Take a look at RenderState.fromCache. We want to freeze all new RenderStates.

@bagnell I caught a problem or have a problem :)
3 tests of ShadowMap fail. I mutates render state.

@bagnell do you have any feedback here?

@bagnell I fixed the failing tests.  This is ready for another look

@hpinkos looks good. Can you fix the whitespace in RenderState and for the requires in freezeRenderState?

@bagnell ready

Thanks @hpinkos and @ateshuseyin!

@bagnell this PR breaks master because we only freeze in debug mode and the tests don't account for it.  Should be an easy fix if the tests can detect which mode they are in.

@mramato @bagnell fixed in #5925


Update testnet instructions with addrbook

https://github.com/palomachain/paloma/issues/143
Background
Continue to evolve testnet creation instructions.
Testing completed

[ ] Manual testnet setup.

Rendered.

And stop is not a palomad command as far as I can tell. It can just be killed at any time. stop is a systemd command, but that's not something we need to worry about.

we should update the description for getting funds. Currently we need to ask for it

Rewrite "query balance" in testnet instructions to allow being run from anywhere #203

Unless you mean we need an issue for a "faucet" api, in which case yes, definitely.

No, I mean, if we have others (who are not in our zoom) come in and join the testnet. Wouldn't they have to reach out to someone to get the funds? I don't think they can run the command to send doves themselves?

@verabehr Yes, the situation of messaging someone for grain is unacceptable. Moved to https://github.com/palomachain/paloma/issues/205


matern kernel

This kernel will be useful for Bayesian optimisation.

whats needed to merge this?

whats needed to merge this?

Gradients and unit tests :D

and general clean up

@karlnapf I think this is ready to merge now

@karlnapf shall I merge this?


using iSAFE without an ancestral allele file

Hello,
I have seen a few papers apply iSAFE to identify mutations in domestication selective sweeps in plants, and would really like to conduct this kind of analysis for my own work. For my project, I’ve mapped reads from individuals in two populations to the reference genome assembly for the species and then looked for signals of selective sweeps. From this I have a vcf file for each of the two populations mapped to the reference genome. I was hoping that I could use the vcf input format with the –sample-case and –sample-cont options with iSAFE, but I don’t have an ancestral allele file (as available for humans in the example given). The process for making an ancestral allele file looks very involved, so I’m wondering if I can still do the equivalent of this analysis by converting (and combining) my vcfs to hap files for input to iSAFE? If you have any thoughts on how best to approach this I’d be very grateful!
Many thanks,
Jasmine

Hi Jasmine,
I apologize for the late response. I have released a new version (v1.0.5) that handle vcf format without having AA-file. Please let me know if this works for you or if you encounter any issue.
Best,
Ali

Hi Ali,
Thank you so much! I will give it a go and let you know how I get on.
Thanks again,
Jasmine


importing/webpack

Hi, thanks for the effort you put into this plugin. I have trouble trying to import EasyButton as a node_module to make it work with webpack. This might be more of a webpack-related question but maybe you have an idea on how to solve this.
I tried loading EasyButton into my index.js (which is the entry for webpack bundling) with the following statements in analogy to this thread.
import L from 'leaflet';
import FreeDraw from 'leaflet-freedraw';
import 'leaflet-easybutton';

Importing FreeDraw this way works flawlessly. I get the following error in my console: "leaflet__WEBPACK_IMPORTED_MODULE_0___default.a.easyButton is not a function". I haven't fully understood how webpack and modules work but apparently EasyButton lacks export statements (which are necessary to import?). Any advice on how I can make EasyButton work without using a CDN? Help much appreciated!

To everyone struggling with the same, see the referenced issue for a solution!


Duration of Waiting Between Two Episodes

Hi,
Thanks for your efforts on this great repo!
I'm using this repo to record episodes for a Franka robot with two D435 cameras. Each episode is around 15-20 seconds long. If I set each episode to have its own "tfrecord" file (one "tfrecord" file per episode), is it normal to have around 50-60 seconds of waiting time between episodes to serialize the previous episode?

From my usecases, it will take some time to serialize the single trajectory, around 15-20s.  Feel free to share if you found a way to "speedup" this process.


Inject XCS trigger variables about PR

Automatically add PR, branch, repo etc information into XCS (transparently), so that pre/postbuild scripts can read which PR/branch/repo they're ran on. Useful for danger, fastlane etc.

We'd like this feature too.

Hi @eric-chamberlain-intel, could you please email me at czechboy0 at gmail? I'd love to hear more about your workflow, to understand better what improvements in Buildasaur could benefit you.


Facing error while building mediapipe project that was working earlier on the same machine

Since morning I'm facing the following issue, even though I deleted the _bazel_j.saini dir from tmp and reinstalled the bazel 1.1.0 and removed the project and cloned it again but no luck:
ERROR: /private/var/tmp/_bazel_j.saini/8e90de47814e77234b141ff7b908f1ad/external/com_google_protobuf_javalite/protobuf.bzl:127:19: Traceback (most recent call last):
File "/private/var/tmp/_bazel_j.saini/8e90de47814e77234b141ff7b908f1ad/external/com_google_protobuf_javalite/protobuf.bzl", line 122
rule(<3 more arguments>)
File "/private/var/tmp/_bazel_j.saini/8e90de47814e77234b141ff7b908f1ad/external/com_google_protobuf_javalite/protobuf.bzl", line 127, in rule
attr.label(cfg = "host", <3 more arguments>)

Starting from v0.7.2, we only support Bazel 2 and 3. This upgrade is necessary because most MediaPipe external dependencies are also moving to support Bazel 2 and 3 only. Please follow the latest instruction to upgrade. Thanks.

Hi jiuqiant,
Thanks again for your prompt response on this, I really appreciate. Now I've updated the bazel version to 3.0.0 and I manage to build the projects now. But I'm not able to run any of the project under mediapipe examples except hello world, let's take the example of hand_tracking and right now I'm on Ubuntu 19.10. The error I'm facing now is as below:
Target //mediapipe/examples/desktop/hand_tracking:hand_tracking_gpu up-to-date:
bazel-bin/mediapipe/examples/desktop/hand_tracking/hand_tracking_gpu
INFO: Elapsed time: 184.833s, Critical Path: 108.93s
INFO: 1450 processes: 1449 linux-sandbox, 1 local.
INFO: Build completed successfully, 1566 total actions
INFO: Build completed successfully, 1566 total actions
E0410 18:31:52.742281 11752 demo_run_graph_main_gpu.cc:186] Failed to run the graph: ; Can't find file:

Hi jiuqiant,
Thanks again for your prompt response on this, I really appreciate. Now I've updated the bazel version to 3.0.0 and I manage to build the projects now. But I'm not able to run any of the project under mediapipe examples except hello world, let's take the example of hand_tracking and right now I'm on Ubuntu 19.10. The error I'm facing now is as below:
Target //mediapipe/examples/desktop/hand_tracking:hand_tracking_gpu up-to-date: bazel-bin/mediapipe/examples/desktop/hand_tracking/hand_tracking_gpu INFO: Elapsed time: 184.833s, Critical Path: 108.93s INFO: 1450 processes: 1449 linux-sandbox, 1 local. INFO: Build completed successfully, 1566 total actions INFO: Build completed successfully, 1566 total actions E0410 18:31:52.742281 11752 demo_run_graph_main_gpu.cc:186] Failed to run the graph: ; Can't find file:

Seems like the error is the graph config file can't be found?
Can you confirm that 1) the pbtxt file mediapipe/graphs/hand_tracking/hand_tracking_mobile.pbtxt still exists in your local repo and 2) you run the binary with the --calculator_graph_config_file flag?
I follow the official instruction to build and run the binary. When I run the binary with the --calculator_graph_config_file flag, it prints out the graph first.
$ GLOG_logtostderr=1 bazel-bin/mediapipe/examples/desktop/hand_tracking/hand_tracking_gpu \
    --calculator_graph_config_file=mediapipe/graphs/hand_tracking/hand_tracking_mobile.pbtxt
I0410 10:37:46.775808 48363 demo_run_graph_main_gpu.cc:51] Get calculator graph config contents: # MediaPipe graph that performs hand tracking with TensorFlow Lite on GPU.
# Used in the examples in
# mediapipe/examples/android/src/java/com/mediapipe/apps/handtrackinggpu and
# mediapipe/examples/ios/handtrackinggpu.

# Images coming into and out of the graph.
input_stream: "input_video"
output_stream: "output_video"

# Throttles the images flowing downstream for flow control. It passes through
# the very first incoming image unaltered, and waits for downstream nodes
# (calculators and subgraphs) in the graph to finish their tasks before it
# passes through another image. All images that come in while waiting are
# dropped, limiting the number of in-flight images in most part of the graph to
# 1. This prevents the downstream nodes from queuing up incoming images and data
# excessively, which leads to increased latency and memory usage, unwanted in
# real-time mobile applications. It also eliminates unnecessarily computation,
# e.g., the output produced by a node may get dropped downstream if the
# subsequent nodes are still busy processing previous inputs.
node {
  calculator: "FlowLimiterCalculator"
  input_stream: "input_video"
  input_stream: "FINISHED:hand_rect"
  input_stream_info: {
    tag_index: "FINISHED"
    back_edge: true
  }
  output_stream: "throttled_input_video"
}
...

Hi jiuqiant, Thank you again for replying. I've checked and I've observed a silly mistake done by me when configured my own calculator in mediapipe project. I forgot to mention one attribute output_stream: "RECOGNIZED_HAND_GESTURE:recognized_hand_gesture" in mediapipe/graphs/hand_tracking/subgraphs/hand_landmark_gpu.pbtxt Now I've re-configured the same and project build and running successfully. But there is one issue that is coming in the new version and i.e. my label that was detected from my calculator is not getting displayed on the red box around hand. in earlier version it was working very well. I'm trying to figure out the issue but is there something else that requires any additional configuration in the new version? I'm posting not my complete code but few important lines below for my calcualtor:
namespace mediapipe
{

namespace
{
constexpr char normRectTag[] = "NORM_RECT";
constexpr char normalizedLandmarkListTag[] = "NORM_LANDMARKS";
constexpr char recognizedHandGestureTag[] = "RECOGNIZED_HAND_GESTURE";
}
::mediapipe::Status HandGestureRecognitionCalculator::GetContract(
    CalculatorContract *cc)
{
    RET_CHECK(cc->Inputs().HasTag(normalizedLandmarkListTag));
    cc->Inputs().Tag(normalizedLandmarkListTag).Set<mediapipe::NormalizedLandmarkList>();
    RET_CHECK(cc->Inputs().HasTag(normRectTag));
    cc->Inputs().Tag(normRectTag).Set<NormalizedRect>();
    RET_CHECK(cc->Outputs().HasTag(recognizedHandGestureTag));
    cc->Outputs().Tag(recognizedHandGestureTag).Set<string>();
    return ::mediapipe::OkStatus();
}

::mediapipe::Status HandGestureRecognitionCalculator::Process(
    CalculatorContext *cc)
{
recognized_hand_gesture = new string("OK");
cc->Outputs()
        .Tag(recognizedHandGestureTag)
        .Add(recognized_hand_gesture, cc->InputTimestamp());
    return ::mediapipe::OkStatus();
}
}

So I was expecting OK to be displayed above red box around hand, and the same was working very well with old mediapipe project.
Thanks again for your help
Jitender

Hello, Can any one help here...

Hi, I manage to build and run my project but when I've copied the content of the same project in other directory and trying to build it's throwing some exception there. It seems there are some in stabilities with the new version upgrade of bazel, Even if I explicitly delete dir "/private/var/tmp/_bazel_j.saini" the error still persist.
Extracting Bazel installation...
Starting local Bazel server and connecting to it...
WARNING: Download from https://mirror.bazel.build/github.com/tensorflow/tensorflow/archive/805e47cea96c7e8c6fccf494d40a2392dc99fdd8.tar.gz failed: class com.google.devtools.build.lib.bazel.repository.downloader.UnrecoverableHttpException GET returned 404 Not Found
ERROR: /private/var/tmp/_bazel_j.saini/ab0fad9461c11437663bfbaefa18fee1/external/org_tensorflow/third_party/py/python_configure.bzl:271:27: in call to repository_rule(), parameter 'remotable' is experimental and thus unavailable with the current flags. It may be enabled by setting --experimental_repo_remote_exec
ERROR: error loading package '': in /private/var/tmp/_bazel_j.saini/ab0fad9461c11437663bfbaefa18fee1/external/org_tensorflow/tensorflow/workspace.bzl: Extension file 'third_party/py/python_configure.bzl' has errors
INFO: Elapsed time: 26.510s
INFO: 0 processes.
FAILED: Build did NOT complete successfully (0 packages loaded)
run-hand-tracking-desktop-cpu.sh: line 5: bazel-bin/mediapipe/examples/desktop/hand_tracking/hand_tracking_cpu: No such file or directory
Thanks
Jitender

Why this error:
sh setup_android_sdk_and_ndk.sh
setup_android_sdk_and_ndk.sh: 25: [: Linux: unexpected operator
setup_android_sdk_and_ndk.sh: 27: [: Linux: unexpected operator
setup_android_sdk_and_ndk.sh: 31: [[: not found
Warning: android_sdk_path (argument 1) is not specified. Fallback to ~/Android/Sdk/
Warning: android_ndk_path (argument 2) is not specified. Fallback to ~/Android/Sdk/ndk-bundle/android-ndk-<NDK_VERSION>/
Warning: ndk_version (argument 3) is not specified. Fallback to r18b.
Warning: android_sdk_path is non empty. Android SDK Installation will be ignored.
Warning: android_ndk_path is non empty. Android NDK Installation will be ignored.
Set android_ndk_repository and android_sdk_repository in WORKSPACE
setup_android_sdk_and_ndk.sh: 96: [: ==: unexpected operator
setup_android_sdk_and_ndk.sh: 103: [: ==: unexpected operator
Done

It again see some version upgrade issue:
(base) AMAC02T8AE6GTFJ:mediapipe j.saini$ $ANDROID_HOME
bash: /Users/j.saini/Library/Android/sdk: is a directory
(base) AMAC02T8AE6GTFJ:mediapipe j.saini$ $ANDROID_NDK_HOME
bash: /Users/j.saini/Library/Android/sdk/ndk/21.0.6113669: is a directory
(base) AMAC02T8AE6GTFJ:mediapipe j.saini$
Syncing project: Sync (incremental)...
Updating VCS...
Running Bazel info...
Command: /usr/local/bin/bazel info --tool_tag=ijwb:AndroidStudio --curses=no --color=yes --progress_in_terminal_title=no --
Computing VCS working set...
Querying targets in project directories...
Command: /usr/local/bin/bazel query --tool_tag=ijwb:AndroidStudio --output=label_kind --keep_going "attr("tags", "^((?!manual).)*$", //...:all - //mediapipe/objc/...:all - //mediapipe/examples/ios/...:all - //bazel-bin/...:all - //bazel-genfiles/...:all - //bazel-out/...:all - //bazel-testlogs/...:all - //bazel-mediapipe/...:all - //.aswb/...:all)" --
0 targets found under project directories; syncing 0 of them.
Sync targets from project view targets:
//mediapipe/examples/android/...:all
//mediapipe/java/...:all
Building Bazel targets...
Command: /usr/local/bin/bazel build --tool_tag=ijwb:AndroidStudio --keep_going --build_event_binary_file=/var/folders/bh/68j3cj9s7md8v2vh0wp4vjx80000gq/T/intellij-bep-ca8316de-d81f-4769-a103-d4e0dc3ac583 --nobuild_event_binary_file_path_conversion --curses=no --color=yes --progress_in_terminal_title=no --aspects=@intellij_aspect//:intellij_info_bundled.bzl%intellij_info_aspect "--override_repository=intellij_aspect=/Users/j.saini/Library/Application Support/AndroidStudio3.6/aswb/aspect" --output_groups=intellij-info-android-direct-deps,intellij-info-generic,intellij-info-java-direct-deps,intellij-resolve-android-direct-deps,intellij-resolve-java-direct-deps -- //mediapipe/examples/android/...:all //mediapipe/java/...:all
Loading:
Loading: 0 packages loaded
Loading: 0 packages loaded
Loading: 0 packages loaded
Loading: 0 packages loaded
Loading: 0 packages loaded
INFO: Build options --compilation_mode, --cpu, --crosstool_top, and 3 more have changed, discarding analysis cache.
Analyzing: 74 targets (19 packages loaded, 0 targets configured)
WARNING: The major revision of the Android NDK referenced by android_ndk_repository rule 'androidndk' is 21. The major revisions supported by Bazel are [10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20]. Bazel will attempt to treat the NDK as if it was r20. This may cause compilation and linkage problems. Please download a supported NDK version.
WARNING: API level 29 specified by android_ndk_repository 'androidndk' is not available. Using latest known API level 28
Analyzing: 74 targets (153 packages loaded, 10006 targets configured)
ERROR: /private/var/tmp/_bazel_j.saini/ab0fad9461c11437663bfbaefa18fee1/external/androidndk/BUILD.bazel:41:1: in cc_toolchain_suite rule @androidndk//:toolchain-libcpp: cc_toolchain_suite '@androidndk//:toolchain-libcpp' does not contain a toolchain for cpu 'darwin'
Analyzing: 74 targets (167 packages loaded, 11590 targets configured)
Analyzing: 74 targets (173 packages loaded, 14374 targets configured)
Analyzing: 74 targets (173 packages loaded, 15969 targets configured)
WARNING: errors encountered while analyzing target '//mediapipe/examples/android/src/java/com/google/mediapipe/apps/facedetectioncpu:facedetectioncpu': it will not be built
WARNING: errors encountered while analyzing target '//mediapipe/examples/android/src/java/com/google/mediapipe/apps/objectdetection3d:objectdetection3d': it will not be built
WARNING: errors encountered while analyzing target '//mediapipe/examples/android/src/java/com/google/mediapipe/apps/handdetectiongpu:handdetectiongpu': it will not be built
WARNING: errors encountered while analyzing target '//mediapipe/examples/android/src/java/com/google/mediapipe/apps/objecttrackinggpu:objecttrackinggpu': it will not be built
WARNING: errors encountered while analyzing target '//mediapipe/examples/android/src/java/com/google/mediapipe/apps/multihandtrackinggpu:multihandtrackinggpu': it will not be built
WARNING: errors encountered while analyzing target '//mediapipe/examples/android/src/java/com/google/mediapipe/apps/hairsegmentationgpu:hairsegmentationgpu': it will not be built
WARNING: errors encountered while analyzing target '//mediapipe/examples/android/src/java/com/google/mediapipe/apps/objectdetectiongpu:objectdetectiongpu': it will not be built
WARNING: errors encountered while analyzing target '//mediapipe/examples/android/src/java/com/google/mediapipe/apps/facedetectiongpu:facedetectiongpu': it will not be built
WARNING: errors encountered while analyzing target '//mediapipe/examples/android/src/java/com/google/mediapipe/apps/handtrackinggpu:handtrackinggpu': it will not be built
WARNING: errors encountered while analyzing target '//mediapipe/examples/android/src/java/com/google/mediapipe/apps/objectdetectioncpu:objectdetectioncpu': it will not be built
INFO: Analysis succeeded for only 64 of 74 top-level targets
INFO: Analyzed 74 targets (173 packages loaded, 16101 targets configured).
INFO: Found 64 targets...
[0 / 366] [Prepa] BazelWorkspaceStatusAction stable-status.txt
[1,168 / 1,170] Building mediapipe/examples/android/src/java/com/google/mediapipe/apps/handtrackinggpu/libmediapipe_lib.jar (3 source files); 5s worker ... (2 actions, 1 running)
ERROR: command succeeded, but not all targets were analyzed
INFO: Elapsed time: 95.676s, Critical Path: 13.43s
INFO: 10 processes: 9 darwin-sandbox, 1 worker.
FAILED: Build did NOT complete successfully
INFO: Build Event Protocol files produced successfully.
 The project may not be fully updated or resolve until fixed. If the errors are from your working set, please uncheck 'Bazel > Sync > Expand Sync to Working Set' and try again.
Parsing build outputs...
Total rules: 64, new/changed: 1, removed: 0
Reading IDE info result...
Updating target map
Loaded 1 aspect files, total size 8kB
Target map size: 46
Reading jdeps files...
Loaded 1 jdeps files, total size 2kB
Reading package manifests...
Java content entry count: 2
Updating Unpacked AAR libraries...
Updating Jar Cache...
Prefetching files...
Refreshing files
Computing directory structure...
Initializing project SDKs...
Committing project structure...
Workspace has 41 libraries
Android resource module count: 11, run config modules: 0, order entries: 22, generated resources: 0
Workspace has 13 modules
Updating in-memory state...
Could not read from manifest file: /Users/j.saini/Desktop/workspace/handspeak_mediapipe_bazel2/mediapipe/AndroidManifest.xml
Sync finished
Timing summary:
BlazeInvocation: 125.0s, Prefetching: 6ms, Other: 582ms

Hi, there is a bazel warning in your log: WARNING: The major revision of the Android NDK referenced by android_ndk_repository rule 'androidndk' is 21. The major revisions supported by Bazel are [10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20]. Bazel will attempt to treat the NDK as if it was r20. This may cause compilation and linkage problems. Please download a supported NDK version. Seems like bazel has not supported NDK r21 but your Android Studio has 21.0.6113669.

See https://github.com/google/mediapipe/issues/609#issuecomment-614359395

Hi, Thanks for responding, Actually I'm facing this error when I'm building android project from android studio by clicking the bazel green heart icon from the tool tray. So I'm not sure how to configure build to run with option ( --host_crosstool_top=@bazel_tools//tools/cpp:toolchain) although I checked my .bazelrc file and there I can see the following entries are present
build:android --crosstool_top=//external:android/crosstool
build:android --host_crosstool_top=@bazel_tools//tools/cpp:toolchain
build:android --linkopt=-landroid
So I'm assuming while build is running this toolchain option is already passed as build option. I'm not sure.
Thanks
Jitender

@jitendersaini
Please see this solution, #640

Thanks @weinixuehao for providing the solution!


[Enhancement]: Improve Prompt Management Documentation

Description
This PR updates and improves the prompt management documentation to reflect recent changes in the Prompt SDK and backend. It includes updated examples, and additional guidance for using synchronous and asynchronous methods.
Related Issue
Closes AGE-1284
Additional Improvement

Add Prompt model in SDK types
Update async method naming in ConfigManager for consistency across manager method
Update test_config_manager SDK tests to make use of updated method naming

OSS is inaccessible, thus the reason why the workflow is failing.


Feature discussion: Multiple HTML files and working links

I didn't know how you'd feel about such a feature, so I thought it would be best to bring it up here.  Multiple HTML files is handy for teaching students how websites work.
Multiple HTML files is relatively easy to implement. The trickery comes when trying to make links work to switch between them. I have a working local branch, but it needs polishing before I can make a pull request.
The way I've done it there, is having a new value in state called htmlInView, that is set to whichever html file that was clicked last. I've also added a script in the iframe that catches all links pointing to local files and changes them to parameter/hash values.  Then I monitor the location.href of the runtime and change htmlInView if it points to a html file in state.files. It's working, but I don't know if this breaks the purpose of a sandbox or if there's an easier way to do this?
Any thoughts?

I think this is an interesting idea, and it could be solved quite elegantly if https://github.com/porsager/flems/issues/6 gets implemented. A dropdown to select the active html file could be shown next to the address field if there are more than one .html file..

I don't think #6 should get implemented, as there are a lot of people not using routing. Could be optional though. 🙂
Do you have any suggestions on how to switch pages when overriding local links in the iFrame? I don't think my implementation is very good.

Is there a safe way to message which page that should be active from inside the iFrame? In my prototype I used an url argument that was picked up in the location variable, but this might mess up some scripts. Is there another way you can think of or is this undoable?


Converts build-client.yml pipeline to 1ES template

Description
This PR converts build-client.yml to the new 1ES template required by Microsoft with the minimal required set of template changes required. This new template enables security and auditing checks by Microsoft. Read more on how the logic for converting to a 1ES pipeline works on the official 1ES wiki
A temporary 1ES folder was created for converted pipeline templates. This enables other pipelines to remain unchanged and use the original templates while new PR's are opened for individually converted other pipelines to 1ES as required by Microsoft.

Once all pipelines are moved over, we can start moving the files out of the 1ES folder and eventually remove the folder since it will no longer have any files (This is after we convert the rest of the required pipelines).

Breaking Changes
Reviewer Guidance

Confirm the newly converted pipelines run successfully. Look at the completed steps and compare with a recent successful run on main to ensure the expected steps run (plus the new SDL and 1ES security checks)
Make sure all the relevant templates and pipelines for  build-client.yml have been converted
Make sure there are no unnecessary changes or 1ES template and/or pipeline conversions
Make sure the yml is valid -- a successful pipeline run should suffice for confirming this

Two changes I noticed went into build-npm-package in main but we haven't ported to the 1ES version:

https://github.com/microsoft/FluidFramework/pull/18867/files#diff-b1f37b84a08cf91822f3ded431e0b08d7226f6bba02275e178ba65ff904ebb15
https://github.com/microsoft/FluidFramework/pull/18788/files#diff-b1f37b84a08cf91822f3ded431e0b08d7226f6bba02275e178ba65ff904ebb15

I think those would be the last and we're good to merge.

Great callouts. Changes have been added to both PR's


install certbot from pip

It looks like the certbot version shipped with alpine is relativly old and has a few problems since a few days. It would be better if we install certbot through pip. Then we'll always get the newest version.
The problem is already discussed here: #1018

FYI all PR's are on hold while Alpine ARM builds are being fixed. I will retrigger and assess this PR afterwards.

As the docker image has changed from Alpine to Debian now, this PR needs to be resolved manually.


Add error log for deserialization failures to show original exception information.

Add error log for deserialization failures to show original exception information.

Resolves #793

This has been released now - https://javalin.io/news/2019/11/03/javalin-3.6.0-released.html - Thanks!


[BUG] UnobservedTaskException 8.0.521

We upgraded our app from .net core 3.1 to .net5 and servicefabric nugetpackages from 7.2.45 to 8.0.521. Since this point we are seeing some UnobservedTaskExceptions popping up. Currently around 1 or 2 exceptions a day on average. The stack trace is very minimal but we are confident that the issue is somewhere in the SF code, as we also host the same app without SF (single machine, windows service) and those are not giving the exceptions. So the hypotheses is that it is part of the SF internals/communication. If anyone else is seeing this please add your findings!
System.AggregateException: A Task's exception(s) were not observed either by Waiting on the Task or accessing its Exception property. As a result, the unobserved exception was rethrown by the finalizer thread. (Unable to read data from the transport connection: An existing connection was forcibly closed by the remote host..)
 ---> System.IO.IOException: Unable to read data from the transport connection: An existing connection was forcibly closed by the remote host..
 ---> System.Net.Sockets.SocketException (10054): An existing connection was forcibly closed by the remote host.
   --- End of inner exception stack trace ---
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketError error, CancellationToken cancellationToken)
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.GetResult(Int16 token)
   at System.Net.Security.SslStream.ReadAsyncInternal[TIOAdapter](TIOAdapter adapter, Memory`1 buffer)
   --- End of inner exception stack trace ---

Assignees: /cc @microsoft/service-fabric-triage

please help me  ! Thank you


Add Animation while autoplay

I want to add animations while the swiper is autoplaying. Does this package include any property or function to do this?

Same question here.

Also would like to add animation when page is changed using the buttons


Allow specification of an HTTP proxy for use in dnf-json

osbuild-composer downloads a lot of data from the repositories. For example when running our integration tests I often get an HTTP error that originates from dnf because it cannot find a working mirror. I think we could mitigate the issue if we allowed usage of HTTP proxy in dnf:
https://dnf.readthedocs.io/en/latest/conf_ref.html#options-for-both-main-and-repo
My idea is to introduce either a configuration file or a command line switch to osbuild-composer and then pass the proxy option to dnf-json.
The same problem is present in the worker, but @dvdhrm is working on a solution directly in osbuild.

Can you elaborate how using a proxy will help here? I don't think I understand.
I am also working on metalink-support for osbuild, yeah, and this should make sure we get better mirror-selection working. No guarantee that the selected mirrors will work, though.

I haven't yet fully investigated the issue, but I think we are downloading the same metadata over and over when running e.g. cmd/osbuild-dnf-json-tests which sounds exactly like something http proxy would fix. I know we cache the metadata in osbuild-composer, but I'm not sure about the tests. Anyway they fail pretty often for me now that I run them every day on arm :-)

I should have started with this, but this is an example of the issue:
Running /usr/libexec/tests/osbuild-composer/osbuild-weldr-tests
Running tests against osbuild-composer devel server using V1 API

--- FAIL: TestBlueprintDepsolveV0 (1.32s)
    blueprints_test.go:722:
        	Error Trace:	blueprints_test.go:722
        	Error:      	Expected nil, but got: &client.APIResponse{Status:false, Errors:[]client.APIErrorMsg{client.APIErrorMsg{ID:"BlueprintsError", Msg:"test-deps-blueprint-v0: DNF error occured: RepoError: Error occurred when setting up repo: Failed to download metadata for repo 'fedora': Cannot download repomd.xml: Cannot download repodata/repomd.xml: All mirrors were tried"}}}
        	Test:       	TestBlueprintDepsolveV0
        	Messages:   	DepsolveBlueprint failed: &client.APIResponse{Status:false, Errors:[]client.APIErrorMsg{client.APIErrorMsg{ID:"BlueprintsError", Msg:"test-deps-blueprint-v0: DNF error occured: RepoError: Error occurred when setting up repo: Failed to download metadata for repo 'fedora': Cannot download repomd.xml: Cannot download repodata/repomd.xml: All mirrors were tried"}}}
--- FAIL: TestBlueprintFreezeV0 (1.35s)
    blueprints_test.go:758:
        	Error Trace:	blueprints_test.go:758
        	Error:      	"0" is not greater than "0"
        	Test:       	TestBlueprintFreezeV0
        	Messages:   	No frozen blueprints returned
--- FAIL: TestListAllModulesV0 (1.53s)
    modules_test.go:27:
        	Error Trace:	modules_test.go:27
        	Error:      	Expected nil, but got: &client.APIResponse{Status:false, Errors:[]client.APIErrorMsg{client.APIErrorMsg{ID:"ModulesError", Msg:"msg: DNF error occured: RepoError: Error occurred when setting up repo: Failed to download metadata for repo 'fedora': Cannot download repomd.xml: Cannot download repodata/repomd.xml: All mirrors were tried"}}}
        	Test:       	TestListAllModulesV0
        	Messages:   	ListAllModules failed: &client.APIResponse{Status:false, Errors:[]client.APIErrorMsg{client.APIErrorMsg{ID:"ModulesError", Msg:"msg: DNF error occured: RepoError: Error occurred when setting up repo: Failed to download metadata for repo 'fedora': Cannot download repomd.xml: Cannot download repodata/repomd.xml: All mirrors were tried"}}}
--- FAIL: TestListSomeModulesV0 (1.93s)
    modules_test.go:35:
        	Error Trace:	modules_test.go:35
        	Error:      	Expected nil, but got: &client.APIResponse{Status:false, Errors:[]client.APIErrorMsg{client.APIErrorMsg{ID:"ModulesError", Msg:"msg: DNF error occured: RepoError: Error occurred when setting up repo: Failed to download metadata for repo 'fedora': Cannot download repomd.xml: Cannot download repodata/repomd.xml: All mirrors were tried"}}}
        	Test:       	TestListSomeModulesV0
        	Messages:   	ListSomeProjects failed: &client.APIResponse{Status:false, Errors:[]client.APIErrorMsg{client.APIErrorMsg{ID:"ModulesError", Msg:"msg: DNF error occured: RepoError: Error occurred when setting up repo: Failed to download metadata for repo 'fedora': Cannot download repomd.xml: Cannot download repodata/repomd.xml: All mirrors were tried"}}}
--- FAIL: TestListOneModulesV0 (1.77s)
    modules_test.go:43:
        	Error Trace:	modules_test.go:43
        	Error:      	Expected nil, but got: &client.APIResponse{Status:false, Errors:[]client.APIErrorMsg{client.APIErrorMsg{ID:"ModulesError", Msg:"msg: DNF error occured: RepoError: Error occurred when setting up repo: Failed to download metadata for repo 'fedora': Cannot download repomd.xml: Cannot download repodata/repomd.xml: All mirrors were tried"}}}
        	Test:       	TestListOneModulesV0
        	Messages:   	ListModules failed: &client.APIResponse{Status:false, Errors:[]client.APIErrorMsg{client.APIErrorMsg{ID:"ModulesError", Msg:"msg: DNF error occured: RepoError: Error occurred when setting up repo: Failed to download metadata for repo 'fedora': Cannot download repomd.xml: Cannot download repodata/repomd.xml: All mirrors were tried"}}}
--- FAIL: TestListTwoModulesV0 (1.32s)
    modules_test.go:51:
        	Error Trace:	modules_test.go:51
        	Error:      	Expected nil, but got: &client.APIResponse{Status:false, Errors:[]client.APIErrorMsg{client.APIErrorMsg{ID:"ModulesError", Msg:"msg: DNF error occured: RepoError: Error occurred when setting up repo: Failed to download metadata for repo 'fedora': Cannot download repomd.xml: Cannot download repodata/repomd.xml: All mirrors were tried"}}}
        	Test:       	TestListTwoModulesV0
        	Messages:   	ListModules failed: &client.APIResponse{Status:false, Errors:[]client.APIErrorMsg{client.APIErrorMsg{ID:"ModulesError", Msg:"msg: DNF error occured: RepoError: Error occurred when setting up repo: Failed to download metadata for repo 'fedora': Cannot download repomd.xml: Cannot download repodata/repomd.xml: All mirrors were tried"}}}
--- FAIL: TestOneModuleInfoV0 (1.47s)
    modules_test.go:59:
        	Error Trace:	modules_test.go:59
        	Error:      	Expected nil, but got: &client.APIResponse{Status:false, Errors:[]client.APIErrorMsg{client.APIErrorMsg{ID:"ModulesError", Msg:"msg: DNF error occured: RepoError: Error occurred when setting up repo: Failed to download metadata for repo 'fedora': Cannot download repomd.xml: Cannot download repodata/repomd.xml: All mirrors were tried"}}}
        	Test:       	TestOneModuleInfoV0
        	Messages:   	GetModulesInfo failed: &client.APIResponse{Status:false, Errors:[]client.APIErrorMsg{client.APIErrorMsg{ID:"ModulesError", Msg:"msg: DNF error occured: RepoError: Error occurred when setting up repo: Failed to download metadata for repo 'fedora': Cannot download repomd.xml: Cannot download repodata/repomd.xml: All mirrors were tried"}}}
--- FAIL: TestTwoModuleInfoV0 (1.91s)
    modules_test.go:67:
        	Error Trace:	modules_test.go:67
        	Error:      	Expected nil, but got: &client.APIResponse{Status:false, Errors:[]client.APIErrorMsg{client.APIErrorMsg{ID:"ModulesError", Msg:"msg: DNF error occured: RepoError: Error occurred when setting up repo: Failed to download metadata for repo 'fedora': Cannot download repomd.xml: Cannot download repodata/repomd.xml: All mirrors were tried"}}}
        	Test:       	TestTwoModuleInfoV0
        	Messages:   	GetModulesInfo failed: &client.APIResponse{Status:false, Errors:[]client.APIErrorMsg{client.APIErrorMsg{ID:"ModulesError", Msg:"msg: DNF error occured: RepoError: Error occurred when setting up repo: Failed to download metadata for repo 'fedora': Cannot download repomd.xml: Cannot download repodata/repomd.xml: All mirrors were tried"}}}
--- FAIL: TestListAllProjectsV0 (1.45s)
    projects_test.go:27:
        	Error Trace:	projects_test.go:27
        	Error:      	Expected nil, but got: &client.APIResponse{Status:false, Errors:[]client.APIErrorMsg{client.APIErrorMsg{ID:"ProjectsError", Msg:"msg: DNF error occured: RepoError: Error occurred when setting up repo: Failed to download metadata for repo 'fedora': Cannot download repomd.xml: Cannot download repodata/repomd.xml: All mirrors were tried"}}}
        	Test:       	TestListAllProjectsV0
        	Messages:   	ListAllProjects failed: &client.APIResponse{Status:false, Errors:[]client.APIErrorMsg{client.APIErrorMsg{ID:"ProjectsError", Msg:"msg: DNF error occured: RepoError: Error occurred when setting up repo: Failed to download metadata for repo 'fedora': Cannot download repomd.xml: Cannot download repodata/repomd.xml: All mirrors were tried"}}}
--- FAIL: TestListSomeProjectsV0 (1.46s)
    projects_test.go:35:
        	Error Trace:	projects_test.go:35
        	Error:      	Expected nil, but got: &client.APIResponse{Status:false, Errors:[]client.APIErrorMsg{client.APIErrorMsg{ID:"ProjectsError", Msg:"msg: DNF error occured: RepoError: Error occurred when setting up repo: Failed to download metadata for repo 'fedora': Cannot download repomd.xml: Cannot download repodata/repomd.xml: All mirrors were tried"}}}
        	Test:       	TestListSomeProjectsV0
        	Messages:   	ListSomeProjects failed: &client.APIResponse{Status:false, Errors:[]client.APIErrorMsg{client.APIErrorMsg{ID:"ProjectsError", Msg:"msg: DNF error occured: RepoError: Error occurred when setting up repo: Failed to download metadata for repo 'fedora': Cannot download repomd.xml: Cannot download repodata/repomd.xml: All mirrors were tried"}}}
--- FAIL: TestOneProjectsInfoV0 (1.35s)
    projects_test.go:43:
        	Error Trace:	projects_test.go:43
        	Error:      	Expected nil, but got: &client.APIResponse{Status:false, Errors:[]client.APIErrorMsg{client.APIErrorMsg{ID:"ModulesError", Msg:"msg: DNF error occured: RepoError: Error occurred when setting up repo: Failed to download metadata for repo 'fedora': Cannot download repomd.xml: Cannot download repodata/repomd.xml: All mirrors were tried"}}}
        	Test:       	TestOneProjectsInfoV0
        	Messages:   	GetProjectsInfo failed: &client.APIResponse{Status:false, Errors:[]client.APIErrorMsg{client.APIErrorMsg{ID:"ModulesError", Msg:"msg: DNF error occured: RepoError: Error occurred when setting up repo: Failed to download metadata for repo 'fedora': Cannot download repomd.xml: Cannot download repodata/repomd.xml: All mirrors were tried"}}}
--- FAIL: TestTwoProjectsInfoV0 (1.36s)
    projects_test.go:51:
        	Error Trace:	projects_test.go:51
        	Error:      	Expected nil, but got: &client.APIResponse{Status:false, Errors:[]client.APIErrorMsg{client.APIErrorMsg{ID:"ModulesError", Msg:"msg: DNF error occured: RepoError: Error occurred when setting up repo: Failed to download metadata for repo 'fedora': Cannot download repomd.xml: Cannot download repodata/repomd.xml: All mirrors were tried"}}}
        	Test:       	TestTwoProjectsInfoV0
        	Messages:   	GetProjectsInfo failed: &client.APIResponse{Status:false, Errors:[]client.APIErrorMsg{client.APIErrorMsg{ID:"ModulesError", Msg:"msg: DNF error occured: RepoError: Error occurred when setting up repo: Failed to download metadata for repo 'fedora': Cannot download repomd.xml: Cannot download repodata/repomd.xml: All mirrors were tried"}}}
--- FAIL: TestDepsolveOneProjectV0 (1.51s)
    projects_test.go:68:
        	Error Trace:	projects_test.go:68
        	Error:      	Expected nil, but got: &client.APIResponse{Status:false, Errors:[]client.APIErrorMsg{client.APIErrorMsg{ID:"PROJECTS_ERROR", Msg:"BadRequest: DNF error occured: RepoError: Error occurred when setting up repo: Failed to download metadata for repo 'fedora': Cannot download repomd.xml: Cannot download repodata/repomd.xml: All mirrors were tried"}}}
        	Test:       	TestDepsolveOneProjectV0
        	Messages:   	DepsolveProjects failed: &client.APIResponse{Status:false, Errors:[]client.APIErrorMsg{client.APIErrorMsg{ID:"PROJECTS_ERROR", Msg:"BadRequest: DNF error occured: RepoError: Error occurred when setting up repo: Failed to download metadata for repo 'fedora': Cannot download repomd.xml: Cannot download repodata/repomd.xml: All mirrors were tried"}}}
--- FAIL: TestDepsolveTwoProjectV0 (1.54s)
    projects_test.go:76:
        	Error Trace:	projects_test.go:76
        	Error:      	Expected nil, but got: &client.APIResponse{Status:false, Errors:[]client.APIErrorMsg{client.APIErrorMsg{ID:"PROJECTS_ERROR", Msg:"BadRequest: DNF error occured: RepoError: Error occurred when setting up repo: Failed to download metadata for repo 'fedora': Cannot download repomd.xml: Cannot download repodata/repomd.xml: All mirrors were tried"}}}
        	Test:       	TestDepsolveTwoProjectV0
        	Messages:   	DepsolveProjects failed: &client.APIResponse{Status:false, Errors:[]client.APIErrorMsg{client.APIErrorMsg{ID:"PROJECTS_ERROR", Msg:"BadRequest: DNF error occured: RepoError: Error occurred when setting up repo: Failed to download metadata for repo 'fedora': Cannot download repomd.xml: Cannot download repodata/repomd.xml: All mirrors were tried"}}}
FAIL
/usr/libexec/tests/osbuild-composer/osbuild-weldr-tests failed

Another benefit is that there will be some users who are only able to access the repos via their corporate proxy. In order to make full use of a caching proxy you need to be able to select the repository -- the metalink, mirror, and closest mirror systems do not always (almost never, in some cases) return the same locations each time.

Let's first get the metalink support that @dvdhrm is working on up and running, and then reassess if we still have a need for this. dnf-json should cache the metadata, even in tests, so I'm not sure a proxy would make much of a difference to this particular issue.
There may still be a reason to add proxy support, but that sounds like a bigger discussion.