Cross-compiling facette 0.4

Hi,
I am currently using the facette master branch and cross-compile facette for ARMv7. So far so good, works great on our embedded board, reading RRD data stored by collectd! :+1:
For 0.4-alpha however, I noticed that you switched to gb, which does not support cross compiling Go code, which uses CGO to link to C libraries like librrd. The developer decided against adding it to gb. (https://github.com/constabulary/gb/issues/532#issuecomment-246519616)
What do you think about either switching back to go build instead of gb, or replacing the C library dependencies with pure Go code? Or is there another option?
Thanks,
Clemens

Hi @clemensg,
I did move to gb to ease Go libraries management and vendoring.
I'll take a look at what could be done to address this problem.

Is there any change you can provide us with some build commands you use to cross-compile Facette (for both master and 0.4-alpha)?

Hi @vbatoufflet , thanks.
On master, I have the following workflow:
export PATH=/opt/mycrosstoolchain/armv7a-linux-gnueabihf/gcc-6.3.0-glibc-2.25-binutils-2.28-kernel-4.10-sanitized/bin:$PATH
cd $GOPATH/src/github.com/facette/facette
make clean
PREFIX=/path/to/sysroot-target/usr CC=arm-v7a-linux-gnueabihf-gcc GOOS=linux GOARCH=arm GOARM=7 CGO_ENABLED=1 make install

Due to the #cgo pkg-config: librrd line in rrd_c.go from ziutek/rrd, go build uses -I/path/to/sysroot-target/usr/include -L/path/to/sysroot-target/usr/lib -lrrd -lz ... when compiling the librrd C bindings.
On 0.4-alpha, I tried with the same workflow, but it does not work with gb. I think it linked to the host system libraries instead.
Thanks for looking into it!

@vbatoufflet Were you able to cross compile with my instructions? If you have a Raspberry Pi or something similar, you could use one of the prebuilt toolchains (e.g. https://github.com/raspberrypi/tools/tree/master/arm-bcm2708/arm-rpi-4.9.3-linux-gnueabihf) and cross-compile for it.
Replacing all cgo libraries with go-only libs is too much work imho (it is not only librrd, but also the SQLite bindings and more).
It's probably easier to switch back to go build. What do you think about that? Or maybe it's possible to support both building with gb and go build?

👍 a6e71f1 I see you were working on this. Thank you! I'll try if cross-compiling 0.4-alpha works now.

Hi @clemensg,
I didn't had the time to test it, but I indeed removed any usage of GB in the Makefile. Let me know if it fixes the issue you encountered.

Awesome, it works! Thank you. 👍  🎉
Just one question: I could not find the url_prefix option in 0.4-alpha. (I can't serve it from the base URL because we already have an API endpoint at /api, so I have to set url_prefix to something like /facette)

Indeed, it's not reimplemented yet in this branch. Sorry.
I just wrote a note, not to forget. I'll do that as quickly as possible.

Great, thanks!

Hi @clemensg,
Just for the record, a root_path setting has been implemented in this branch (see 285e9985243bae59d46265c6ee4f13dfb1593d8e).

Hi, thanks! The root_path setting works!
However, I found two other problems with 0.4-alpha:

After adding graphs, they are not visible in the Graphs list in the admin panel or on the main page. I can add it to a collection, but that collection is not visible either.
When adding a rrd provider with an empty filter list, it crashes. I added the stderr output below.

Apr 28 13:41:59 facette[521]: [signal SIGSEGV: segmentation violation code=0x1 addr=0x4 pc=0x36dbf4]
Apr 28 13:41:59 facette[521]: goroutine 189 [running]:
Apr 28 13:41:59 facette[521]: facette/catalog.NewFilterChain(0x0, 0x568d8540)
Apr 28 13:41:59 facette[521]:         /home/clemens/go/src/github.com/facette/facette/build/facette-linux-arm/src/facette/catalog/filter.go:63 +0x13c
Apr 28 13:41:59 facette[521]: main.newProviderWorker(0x56b9dca0, 0x568d4120, 0x568d8420, 0x24, 0x76c9a8)
Apr 28 13:41:59 facette[521]:         /home/clemens/go/src/github.com/facette/facette/build/facette-linux-arm/src/cmd/facette/poller_provider.go:46 +0x1f8
Apr 28 13:41:59 facette[521]: main.(*pollerWorker).StartProvider(0x56b9dca0, 0x568d4120)

Crash has been fixed in 874d2fcb8434d1abe6e29b1eae7b211b3098b625.
Regarding the first problem, I can't manage to reproduce it. If you think of a way, please open a new issue with the details.


Show loading when user first open the home page

https://www.figma.com/file/vqpglMGW8psHKB00eIVDUV/OpenSquare?node-id=4991%3A29299

Some search result:

https://mui.com/components/skeleton/
https://skeletonreact.com/
https://github.com/dvtng/react-loading-skeleton


control: Complete transition to VIDIOC_{G,S}_EXT_CTRLS API

Move away from the old VIDIOC_{G,S}_CTRL API.
The new API allows for larger data types (e.g. 64 bit integers) and
multi-dimensional controls.
Signed-off-by: Christopher N. Hesse<EMAIL_ADDRESS>

@cazou would you mind testing this on your hardware as well?
I'd like to get all the recent control changes into the next release and move to the *_EXT API entirely.

It is all good for me, I don't have a lot of hardware but did some more testing with v4l2loopback (Only setting controls though)


Add fastOptMobile task

Running fullOptMobile is not super fast and also makes debugging a bit harder (due to shortened names). Would it be possible to also provide the fastJS mode, i.e. fastOptMobile?

yeah its pain to debug in prod mode :( , we're blocked on https://github.com/facebook/react-native/issues/465

Ah too bad.

Closing this as it's on your task list.


cli: use docker-py library

Use the docker-py python library instead of interacting directly with the docker command.

i'll give this a shot 🐳

@barbaraDorame Are you working on this issue ?


add assigning operators tutorial and challenge

1. This pull request resolves #9
2. Description

add tutorial for assigning operators
add challenge for assigning operators

3. Fill in checklist by marking [x]

[x] I've read the CONTRIBUTING.md
[x] I was assigned to this issue
[x] My code is formatted using required linting
[x] I've run my code locally and checked it works

@sabderemane looks good!

Thanks @funbeedev ! I will be happy to continue to contribue to the project even the Hacktoberfest is done :)

@sabderemane really glad to hear that 🤩


[DO NOT MERGE] Use default cache on macOS

Checking if this allows us to reproduce the memory issues from https://github.com/swiftlang/sourcekit-lsp/issues/1541 on macOS.

@swift-ci Please build toolchain macOS


Ampersand (&) in Subject for Outlook.com & Office 365 renders as &

Problem
When you pass a Subject with an ampersand &, it displays as & (for Outlook.com and Office 365)
Eg. Birthday & Sleepover percent-encoded to: &subject=Birthday%20%26%20Sleepover
Test link

This appears to be a bug on Microsoft's side.
Solution

Detect and replace & with and? (but only for Outlook.com and Office 365 and only for the Subject field)

Fixed in v0.2.5


VARBINARY Column parameter sent as NVARCHAR when value is nil

VARBINARY Column parameter sent as NVARCHAR
When inserting a Type of Valuer into a VARBINARY(MAX) column if the Value() returns nil, the parameter type sent to sql server is NVARCHAR
Profiler Output
When value provided for the custom type:
exec sp_executesql
N'INSERT INTO [dbo].[event_store] (payload, options, headers) VALUES (@p1, @p2, @p3)',
N'@p1 varbinary(12),
@p2 varbinary(113),   <========
@p3 nvarchar(1)',
@p1=0x74657374207061796C6F6164,
@p2=0x7B22616D71704F75742E45786368616E67654E616D654F7074696F6E223A2274657374222C22616D71704F75742E45786368616E6765547970654F7074696F6E223A22746F706963222C22616D71704F75742E526F7574696E674B65794F7074696F6E223A22746573742E73656E64227D,
@p3=NULL

When no value provided for the custom type:
exec sp_executesql
N'INSERT INTO [dbo].[event_store] (payload, options, headers) VALUES (@p1, @p2, @p3)',
N'@p1 varbinary(12),
@p2 nvarchar(1),  <========
@p3 nvarchar(1)',
@p1=0x74657374207061796C6F6164,
@p2=NULL,  <========
@p3=NULL

Implicit conversion from data type varchar to varbinary(max) is not allowed. Use the CONVERT function to run this query.

The value sent to method
&outboxer.OutboxMessage{
		Payload: []byte("test payload"),
		Options: map[string]interface{}{
			"amqpOut.ExchangeNameOption": "test",
			"amqpOut.ExchangeTypeOption": "topic",
			"amqpOut.RoutingKeyOption":   "test.send",
		}

Snippet from method that is inserting code:
	query := fmt.Sprintf(`INSERT INTO [%s].[%s] (payload, options, headers) VALUES (@p1, @p2, @p3)`, s.SchemaName, s.EventStoreTable)
	if _, err := s.conn.ExecContext(ctx, query, evt.Payload, evt.Options, evt.Headers); err != nil {
		return fmt.Errorf("failed to insert message into the data store: %w", err)
	}

Here Options and Headers are custom type that have Valuer implemented part of a struct OutboxMessage.
type OutboxMessage struct {
	ID           int64
	Dispatched   bool
	DispatchedAt sql.NullTime
	Payload      []byte
	Options      DynamicValues
	Headers      DynamicValues
}

// DynamicValues is a map that can be serialized
type DynamicValues map[string]interface{}

// Value return a driver.Value representation of the order items
func (p DynamicValues) Value() (driver.Value, error) {
	if len(p) == 0 {
		return nil, nil
	}
	return json.Marshal(p)
}

Expected behavior
The type sent to SQL Server must be VARBINARY.
Further technical details
SQL Server version: (DOCKER) Microsoft SQL Server 2017 (RTM-CU11) (KB4462262) - 14.0.3038.14 (X64) 	Sep 14 2018 13:53:44 	Copyright (C) 2017 Microsoft Corporation	Developer Edition (64-bit) on Linux (Ubuntu 16.04.5 LTS)
Operating system: Mac 10.14.5
Go version: go1.13.1 darwin/amd64
Table schema
CREATE TABLE dbo.event_store (
	id int IDENTITY(1,1) NOT NULL PRIMARY KEY,
	dispatched BIT NOT NULL default 0,
	dispatched_at DATETIME,
	payload VARBINARY(MAX)  not null,
	options VARBINARY(MAX),
	headers VARBINARY(MAX)
);

@m4ver1k I was able to reproduce the issue. I delve a bit deeper into the driver, looks like the culprit comes from https://github.com/denisenkom/go-mssqldb/blob/master/types.go#L1121 , when the parameter is nil, the parameter type becomes nvarchar(1) (probably because this is a more flexible type and SQL Server allows implicit conversion of nvarchar to many other SQL datatypes (except for varbinary in this case of course)). Anyhow, the case typeNull essentially comes from https://github.com/denisenkom/go-mssqldb/blob/master/mssql.go#L800 .\
The problem is, then nil is passed as a parameter, the driver needs to guess what data type it should be. For some types (e.g., float64, bool), the sql package provides a null version (e.g., NullFloat64 and NullBool) so the user can use these types. For varbinary however there's no such type.
The only solution I can think of is the introduce another driver specific type (similar to the mssql.VarChar type we have currently) so user is use this type and let the driver know this value is a varbinary. @denisenkom what do you think?

Yeah, I can't think of any other way.

Currently experiencing this bug as well. I'm just trying to NULL out a field that is a VARBINARY and it's giving me this message.


support Bound for classmethod and pass_module

This is a tidied-up copy of #3744 without any attempts to change #[pymodule].
This PR focuses on updating #[classmethod] and #[pyfunction(pass_module)] to accept &Bound<PyType> and &Bound<PyModule> respectively. It allows them to accept GIL Refs for backwards compatibility.
We were already using Into for these conversions, so I created a new helper type BoundRef(&Bound<T>) which implements the Into conversions for &T, &Bound<T>, and Py<T>. The reason for the new helper type was because I didn't want to support From<&Bound<T>> for &T.

Thanks for the review! I decided to add a doc to ref_from_ptr and will proceed to merge 👍


Fix tushare plot and China A Share Market Demo

Fixed tushare plot_all(), and plot() method with specialized baseline,
Updated demo files with available trade time span

thanks for your codes.
have you tested it?

thanks for your codes. have you tested it?

Yes, I have tested them. Please refer to these two github gists for more information.
FinRL-Meta/tutorials/1-Introduction/China_A_share_market_tushare.ipynb
FinRL-Meta/tutorials/3-Practical/FinRL_China_A_Share_Market.ipynb


Make headers matches in generated jUnit code escape regex ''s.

Update tests to reflect desired behavior.

re: https://github.com/spring-cloud/spring-cloud-contract/issues/587

@djdapz Thank you for signing the Contributor License Agreement!


build: bump agent-js v0.11.3 with setBigUint64 for iOS < v15

Motivation
Few users are still using nns-dapp on iOS < v14. As a temporary solution we provided to nns-js the polyfill for setBigUint64 we are already using in nns-dapp.
Changes

bump agent-js v0.11.3

Thanks


add method to set a fixed container mac address

Add method 'WithMacAddress' to set a fixed mac address to a container in TestContainersBuilder. As background information to why I need this: I want to test software that requires a license key that is tied to the mac address.

Thanks for the quick review! I executed the suggested renaming and added a test.
Viele Grüße aus dem Schwarzwald. ;)

f2cb532db6da73d0d79190369f202f75fb9717c7.


REQ-MCT-014 - Permission list for target

The MCT shall store a list of allowed commands and automated sequences for each target, specified using regular expressions

@Umang-Rajkarnikar add your updates here


Plz

Pass me the config of the server of crazy in alis.io

PlayerMaxCell: 100 or 200

More?

'playerMaxCells = 500'

playerMaxCells = 500 @AlexByte918


Max frequency offset with gmskframesync and ofdmframesync?

Hi,
From tests I made, it looks like gmskframesync and ofdmframesync are not able to recover frames when their center frequency is at an offset greater than 1% of the signal bandwidth from the correct center frequency used to create the frames.
Is there a way to increase this maximum offset (for example to 5% or 10%), or not?

Yes. The gmskframesync uses a detector_cccf instance which is used to specify its allowable carrier frequency offset estimate. You can modify this offset when it is created. The downside here is that the computational complexity will increase as it's now having to search over a larger space.
The ofdmframesync object works very differently from the single-carrier framing objects (such as gmskframesync) and uses a frequency-domain method for detection instead of the traditional auto-correlation time-domain method which is susceptible to interference. Expanding the frequency offset range here would require more work.


Quickstart docs improvement: OPENAI_API_KEY context

Summary
When getting my project running locally, I had some confusion around the OPENAI_API_KEY requirement.
This addition to the docs should help new contributors in the AI space avoid this little "speedbump".
Preview

@steven-the-qa , it looks like we had a regression around running tests from forks. It is supposed to grab the secrets when I rerun the tests (which is working with the "secrets", but appears to have issues in playwright and lock file check)
I'm going to bypass the branch protections for this and try to get that working on main again. I might ask you for help in the a few days to verify it works.

@steven-the-qa , it looks like we had a regression around running tests from forks. It is supposed to grab the secrets when I rerun the tests (which is working with the "secrets", but appears to have issues in playwright and lock file check)
I'm going to bypass the branch protections for this and try to get that working on main again. I might ask you for help in the a few days to verify it works.

Roger roger 🫡


Don't know how to have both scroll and swipe

I have a WebView in an absolute layout as a carousel screen.
On Android, I was using this to enable scrolling in the WebView...
Control.Touch += Control_Touch;

void Control_Touch(object sender, Android.Views.View.TouchEventArgs e)
        {
            switch (e.Event.Action)
            {
                case MotionEventActions.Down:

                    Control.Parent.RequestDisallowInterceptTouchEvent(true);

                    break;

                case MotionEventActions.Up:

                    Control.Parent.RequestDisallowInterceptTouchEvent(false);

                    break;
            }

            Control.OnTouchEvent(e.Event);
        }

But that stops swiping from working. If I don't add this code then I can have swipe but no vertical scrolling.
On iOS, I get vertical scrolling but no swipe.
How do I have scrolling and swipe on both platforms?

IsPanInteractionEnabled = false only

I have tried adding IsPanInteractionEnabled = false to my carousel and it has no effect.

@FruitAndAShape it means that XF has such restriction. Because this property disables PanGestureRecognizer and navigation work via swipe gestures only.

I don't understand. Is it possible to have both swipe and scroll?

@FruitAndAShape seems not for WebView. Or i don't know how to achieve it.
If you know, feel free to make PR )

ok. Maybe I will try and trigger it in code from an interaction with the WebView.
Also, when jumping from one card to another, the flow direction isn't consistent. Is it possible to override the flow direction?

if i understood correctly: this method is private now
https://github.com/AndreiMisiukevich/CardView/blob/master/PanCardView/CardsView.cs#L941-L965
But we can make it protected virtual

IsCyclical="false" has fixed it. Thanks.


[PUI] Make dashboard header look less like a widget

This PR changed the header of the dashboard from

to

and moves the editing indicator

Nice addition @matmair


Cannot mount dataset to Compute cluster

Im trying to train a ML experiment on a compute cluster using pytorch.
Created a File Dataset, which I am able to mount in the notebook,
Pass to an experiment via:
`
script_params = {
'--num_epochs': 30,
'--data_folder': dataset.as_named_input('panelts_v1').as_mount('/tmp/dataset'),
'--workspace': workspace_name,
'--output_dir': './outputs'
}
estimator = PyTorch(source_directory=project_folder,
script_params=script_params,
compute_target=compute_target,
entry_script='py_fc_cv_train.py',
use_gpu=True,
pip_packages=['azureml-dataprep[pandas,fuse]>=1.1.14', 'azureml-defaults'])
`
As per the documentation and multiple examples on Microsoft github.... but...
I keep getting this error :
UserError: Dataset initialization failed: DatasetMountValidationException: 	Message: Cannot mount dataset. Source of the dataset is either not accessible or does not contain any data. 	InnerException None 	ErrorResponse  {     "error": {         "code": "UserError",         "message": "Cannot mount dataset. Source of the dataset is either not accessible or does not contain any data."     } }
Is there any reason that I could mount in the Compute but not in the Compute Cluster? Could it be a VPN issue (I dont have any special VPN on my Compute which is able to mount...)?
Help please?

Update, it appears it could be related to the compute type?
On a Compute instance I can mount to a CPU compute (STANDARD_DS3_V2) but not to a GPU (STANDARD_NC6)?

It seems to have been a VPN issue.
Once I opened a GPU within my VPN it worked...

@gstat-gcloud Glad to know that you have self resolved the issue. Thanks for the update. 👍
Just FYI, this azure-docs repository deals about feedback related to particular Azure document page (like correcting doc bugs, doc enhancements, product issues related to wrong doc instructions, etc.) so going forward if you want to share any feedback related to particular Azure document then I suggest you to please click on 'This page' option at the bottom of referred Azure document and share the feedback. For reference, adding screenshot of the 'Feedback' section that you could ideally find at bottom of an Azure document. But on the other hand if you need help in resolving a product related issue or question then I suggest you to ask the question in public forums like Microsoft Q&A, etc. but not here in this azure-docs repository. Hope this clarifies.


Add table aws_elasticache_redis_metric_cpu_utilization_daily

References
Add any related links that will help us understand the resource, including vendor documentation, related GitHub issues, and Go SDK documentation.
Engine level cloudwatch metric of EngineCPUUtilization can be considered
https://docs.aws.amazon.com/AmazonElastiCache/latest/red-ug/CacheMetrics.Redis.html

@sankeyraut thanks for using steampipe and having this issue raised. We will evaluate this and take action. Meanwhile, let us know if we are expecting any further contribution from you 👍

Yes.. will start the work this week and send you a PR

PR : https://github.com/turbot/steampipe-plugin-aws/pull/753


Crash after connection (possible duplicate)

Wanted to lodge a new issue since the other one referencing this (#43) was closed and appears to have been fixed.
I'm getting this same issue. I've updated credo to use runtime: false, I've also removed wobserver from my application (an issue I saw elsewhere) and also I've used the latest binary from the releases page.
** {{timeout,{gen_server,call,
                         [epl_tracer,
                          {command,#Fun<supervisor.which_children.1>,
                                   [<6914.2686.0>]}]}},
    [{gen_server,call,2,[{file,"gen_server.erl"},{line,204}]},
     {epl_st,command,2,[{file,"src/epl_st.erl"},{line,129}]},
     {epl_st,generate_sup_tree,1,[{file,"src/epl_st.erl"},{line,104}]},
     {epl_st,'-handle_info/2-fun-0-',2,[{file,"src/epl_st.erl"},{line,76}]},
     {lists,foldl,3,[{file,"lists.erl"},{line,1263}]},
     {epl_st,handle_info,2,[{file,"src/epl_st.erl"},{line,75}]},
     {gen_server,try_dispatch,4,[{file,"gen_server.erl"},{line,601}]},
     {gen_server,handle_msg,5,[{file,"gen_server.erl"},{line,667}]}]}

=INFO REPORT==== 16-Jun-2017::17:23:38 ===
    application: epl_st
    exited: shutdown
    type: temporary

Elixir v 1.4.2
OTP 19
Any thoughts or assistance is greatly appreciated.

I've just tried building master and using that and had the same issue.

Hi @zachdaniel , thanks for posting the issue! 🙂
Could you please share a list of applications which are started on the node you are observing with erlangpl?
If you're using Elixir, you can use:
iex> :application.info()[:running]

and in case of Erlang:
erl> proplists:get_value(running, application:info()).

This issue usually comes up because of misbehaving OTP applications, but this could be the problem on our side.
And sorry for keeping you waiting 😉

I'm seeing the same thing. My application list is:
[{cuttlefish,undefined},
{setup,<0.1363.0>},
{riak_core,<0.970.0>},
{exometer_core,<0.942.0>},
{cowboy,<0.937.0>},
{lager,<0.913.0>},
{cowlib,undefined},
{basho_stats,undefined},
{riak_sysmon,<0.901.0>},
{goldrush,<0.894.0>},
{recon,undefined},
{luerl,<0.880.0>},
{jiffy,undefined},
{ranch,<0.874.0>},
{crypto,undefined},
{compiler,undefined},
{syntax_tools,undefined},
{clique,<0.866.0>},
{poolboy,undefined},
{pbkdf2,undefined},
{eleveldb,undefined},
{sasl,<0.855.0>},
{runtime_tools,<0.850.0>},
{mnesia,<0.834.0>},
{stdlib,undefined},
{kernel,<0.797.0>}]
Probably it is the 'undefined' for the pid which you are not handling?


Fix IsFileValid() to use "cs" for file path comparisons

analyzer stuffs are located in analyzers/dotnet/cs/ or analyzers/dotnet/vb.
the splited element should be compared with "expectedLanguage" variable.

@WonyoungChoi,
Thanks for having already signed the Contribution License Agreement. Your agreement was validated by .NET Foundation. We will now review your pull request.
Thanks,
.NET Foundation Pull Request Bot

We've moved things around this repo. Please reopen this PR against master if you want us to take a look at this again.


add z-wave config options to example config file

The configuration.yaml.example file is missing any example config for z-wave sticks.  It would be nice to include a sensible default config in this file, and perhaps a note about what is needed to enable z-wave-stick support.

A simple example would indeed be good for the example configuration. I don't want to get too extended, that's what home-assistant.io is for.


[top, pinmux] Fix pinmux to ast connections

Pinmux to ast connections cannot fully go through pinmux and instead has to be tapped at specific points.

@Jacob-Levy / @arnonsha i also updated the open source version of ast to the right connection widths.
Please have a look.

@msfschaffner regarding the inversion thing, I can make a separate fix to move the inversion post sampling into the pinmux.
let me know what you think.  I feel like that would be slightly easier than making exceptions, but you would know better i think.

So @arnonsha initially suggested to just output the raw uninverted form of the pads in the pad wrappers.
Once we have that, we could basically just connect the entire mio_in_raw and dio_in_raw arrays directly to AST, without having to loop this into the top-level and back again.
I am currently working myself through templating the tops and padring, and could provision these outputs in the padring.

o i see. That works too i think.
so does this mean all the scan_idx stuff would be removed from pinmux then?
I guess the strap / tap stuff would still go through pinmux right?
On Wed, Mar 24, 2021 at 11:55 AM Michael Schaffner @.***>
wrote:

So @arnonsha https://github.com/arnonsha initially suggested to just
output the raw uninverted form of the pads in the pad wrappers.
Once we have that, we could basically just connect the entire mio_in_raw
and dio_in_raw arrays directly to AST, without having to loop this into
the top-level and back again.
I am currently working myself through templating the tops and padring, and
could provision these outputs in the padring.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/lowRISC/opentitan/pull/5718#issuecomment-806075232,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AAH2RSTCL7ZR7C7MDLDL7DLTFIYS7ANCNFSM4ZPVXKUA
.

How do you feel about external clock?
Because that one does not technically stay external clock all the time.
Does that make more sense as a direct connection or route via pinmux?
On Wed, Mar 24, 2021 at 12:07 PM Michael Schaffner @.***>
wrote:

Yeah as long as as we do not have to do anything fancy with these signals
(i.e., we just have to connect them over to AST), keeping them entirely on
the chip level could simplify things a bit.
All the strap / tap stuff should remain in the pinmux, I think, since
there is quite a bunch of logic attached to it, and requires qualification
with life cycle.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/lowRISC/opentitan/pull/5718#issuecomment-806082333,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AAH2RSUPJ6LK7BAQJIVMUJTTFIZ7TANCNFSM4ZPVXKUA
.

Does the external clock have to go through the clkmgr, or is the switching handled inside AST?
Because if it is the latter, they could just take it from any of the mio_in_raw signals in the array that we would connect anyways.
Propagation of the clock would be blocked inside the pinmux, as long as no peripheral input is configured to connect to that specific pad.

it doesn't have to go through clkmgr, but a direct connection is a little
strange because it's not functionally always an external clock.
Although come to think of it, that would be the same inside pinmux as
well.
So yeah tapping directly from the pad ring is probably the best choice.
This would also eliminate a ton of clock paths they would otherwise see.
On Wed, Mar 24, 2021 at 12:19 PM Michael Schaffner @.***>
wrote:

Does the external clock have to go through the clkmgr, or is the switching
handled inside AST?
Because if it is the latter, they could just take it from any of the
mio_in_raw signals in the array that we would connect anyways.
Propagation of the clock would be blocked inside the pinmux, as long as no
peripheral input is configured to connect to that specific pad.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/lowRISC/opentitan/pull/5718#issuecomment-806089216,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AAH2RSWOVDEC3F6ROFIRLHTTFI3M3ANCNFSM4ZPVXKUA
.

Yes that is true, but inside AST I guess it would just connect to a clock mux, right?
So, it probably does not really matter at which point we tap it out if we do not do any additional gating/muxing on it (outside of AST) .
It can still be a MIO pad, so that it can be used for other functional stuff later on.

Testing SW just has to be careful not to change the output or pad attribute configuration of that MIO pad as long as it's used as an external clock.


move API exception into root namespace

exception is part of api, it is interface, there is no need to do jetbrains damaged api, please...

Feel free to submit a PR.

Feel free to submit a PR.


[Sema] Check for availability of result type of implicit literal initializer

For literal expressions check availability of the resulting type of the implicit literal as well in addition to the initializer checking.

Resolves  https://github.com/apple/swift/issues/61890

@swift-ci Please smoke test

@swift-ci Please smoke test

@swift-ci Please smoke test

@swift-ci Please test

@swift-ci Please test MacOS platform


Dendron Engine not getting initialized on Windows

Describe the bug
Dendron doesn't seem to be loading on Windows. The commands work but the notes haven't been indexed and I can't use the Dendron previewer.
To Reproduce
Steps to reproduce the behavior:

Go to '...'
Click on '....'
Scroll down to '....'
See error

Expected behavior
A clear and concise description of what you expected to happen.
Screenshots
If applicable, add screenshots to help explain your problem.
Desktop (please complete the following information):

OS: Windows
Windows 10 v 2004

Additional context
Add any other context about the problem here.
Dendron Log file
dendron.log

User error :) Opened the wrong code workspace file.

User error :) Opened the wrong code workspace file.


line length not respected by projector preview window

Set in the OS Settings for motions a line length of 90 (default)
project a motion
now set in the OS Settings for motions a line length of 70.
refresh the browser page (because of bug #3107)

result: the new line length is now used for the projection and the motion in OS' main browser window. But the projector preview window still shows the motion with wrong line length.

You also have to reload the main OS page. Then the preview is correct.
It seems that this issue and issue #3107 are different, but technically it the same problem. @emanuelschuetze Please close this duplicate.


Possible bug in the animation importer, from Blender . .

Godot version:
Godot 4 build, from today . .
OS/device including version:
Windows 10, nVidia graphics . .
Issue description:
It looks like animations are imported incorrectly . . The base animation, in Blender, had 5 steps, here . .

However, in Godot, it looks like there are keyframes, that weren't made, in Blender . . .

Not sure, if there's an error, in the importer, or so . .
Steps to reproduce:
Just imported a .glTF, and it looks like it ' scrambled ', or added to the animations . . It's not important, the animation LOOKS fine, but I like a 1-to-1 import, if possible . . Also, well, it might be a bug, can't say . . .
Minimal reproduction project:
Uhh, just make a simple keyframe animation, say for characters, and move it into Godot, after importing, the keyframes don't match, what was in the 3D DCC, Blender . . Thx . . .

I don't think there's any bug here, as it's probably just that Blender doesn't show all of the bones that are getting transformed by an animation, something that Godot shows.. so the Extra stuff you are seeing is like fingers and such getting transformed when you lift an arm, if you get what I mean..

Well, I'm noob, it's just weird it doesn't look like, in Blender . . also, I haven't animated the fingers, only some bones have keyframes, and well, at least I didn't do that, in Blender . . So, it ' might ' be corrupt data, was thinking maybe Godot auto-optimized data on import, but I'd like to may-be do that manually, so I know it's WYSIWYG . .
Well, prob. something I don't understand, not sure <3 . . . .

This is a duplicate of another issue, but I can't find it right now.

Does this occur in a recent Godot 4.x version such as Godot 4.3 stable?
Please provide a minimal reproduction project, or the problem cannot be reproduced, so the issue will be closed.


Consider changing controls to be on by default

During discussion, @yuinchien pointed out that the number of practical use cases where it is desirable for controls to be disabled is quite small. Let's document the potential consequences of enabling controls by default and consider changing this default so that controls are opt-out instead of opt-in!

@cdata I'd vote for putting this in before 1.0, what do you think?

TBH I don't know. We don't have a lot of data on the preferred use case, and the platform precedent for this feature (it was originally named after <video controls> attribute) is also opt-in (not opt-out) despite being an obviously useful thing to have turned on by default.

Might be worth looking at video embed. For Youtube and vimeo, the control is on without having an attribute. So far I can't recall seeing usage of model-viewer that's designed to not have control.

Your suggested examples actually prove out what I'm saying. <video> has built-in controls, and requires the controls attribute in order to activate those built-in controls. However, YouTube and Vimeo do not use the controls attribute. Here is the HTML where YouTube uses the <video> tag (formatted for readability):
<video tabindex="-1"
  class="video-stream html5-main-video"
  controlslist="nodownload"
  style="width: 447px; height: 251px; left: 0px; top: 0px;"
  src="blob:https://www.youtube.com/a11c89a2-6086-498d-990c-7c6eeaf2a5e6">
</video>

And here is the same one for Vimeo:
<video preload
  loop
  style=""
  src="blob:https://vimeo.com/4940d27c-fa51-4715-8537-949cf2f45eb2">
</video>

The <video> tag deliberately asks that a content author opts-in to interactive user controls. And both of these embeds implement heavily customized controls on top of the <video> tag rather than use the built-in controls.

I think the ship has sailed on this. I'm fine with the current behavior, and our users haven't complained.


Remove use of distutils

The distutils package is now deprecated and support will be fully removed in Python 3.12 (see pep 0632). The deprecation notice also fails linter tests from distutils v3.10.6 onwards and in the newer containers.

/te-ci


What happened to your SOTA result?

https://paperswithcode.com/sota/language-modelling-on-penn-treebank-word
GPT 3 has been released, improving the previous SOTA from 35.76 to 20.5 which is a huge gain.
BUT before the release of GPT 3,I had seen YOUR results and they were so exceptional that I wrote them on a note!
SMIM had a result of 4.6 of text perplexity on the Pen treebank benchmarck
and with order of magnitude less parameters than GPT-2.
WHAT HAPPENENED??
humanity needs those accuracy gains!

@michalivne

The results are still in the paper btw with SMIM 1024 179M
Were the results erroneous, unreproducible? Otherwise, you are loosing your momentum against GPT 3

https://paperswithcode.com/paper/200302645

Someone on hackernews claims:

the MELBO bound in that paper is invalid. Their perplexity numbers using the MELBO bound are also invalid.

Is that true?
With the correct MELBO how much is the text perplexity on Pen Treebank
affected?

The bound is completely invalid, as are the NLL/PPL numbers they report with the MELBO. Look at the equation. If they optimized it directly, it would be trivially driven to 0 by the identity function if we used a latent space equivalent to the input space. The MELBO just adds noiseless autoencoder reconstruction error to a constant offset equal to log of the test set size. This can be driven to zero by evaluating an average bound over test sets of size 1.
The mathematical/conceptual error is that they are assuming each test point is added to the "post-hoc aggregated" prior when they evaluate the bound. This is analogous to including a test point in the training set. Another version of this error would be adding a kernel centered on each test point to a kernel density estimator prior to evaluating test set NLL. In this case, obviously the best kernel has variance 0 and assigns arbitrarily high likelihood to the test data.

@LifeIsStrange  thanks for your interest. We are very excited about sentenceMIM and believe it
is a valuable model that should be further investigated.
Regarding your comments/questions: The MELBO bound is valid, however there is a question
regarding what exactly PPL measures when it is computed with MELBO.
We chose to remove the PPL results for the time being, since comparing it directly to other
probability density estimators is suspicious, as explained below.
The issue with the reported numbers is not their validity, but rather the validity of
the comparison. PPL (i.e., a per-token probability-related measure) is commonly used to test the
generalization of a learned model under a held out sample set. Since the weights of sentenceMIM are
independent of the test sample set, sentenceMIM can be viewed as a transductive model (i.e., the prior depends on the
test sample points, and is then marginalized out). This view, however, raises the question whether the
PPL numbers reported for such a transductive model are comparable to values reported by a model
like GPT-2. As such, we chose to remove the results for the time being, until we complete further
investigation.
Alternatively, MELBO can be viewed as measuring the ability of sentenceMIM to disambiguate between
a set of given observations (i.e., sentences). In that view, sentenceMIM PPL values cannot be compared
to PPL values of other PDF estimators (i.e., we cannot compare apples to oranges). This view is
reflected in your last comment in which the model can be evaluated independently on each test point.
Under this view, the reported PPL values are indeed not a valid measure of the generalization of
the model under a target sample set (and despited the independence of the learned weights from the test sample set).
As a side not, matching the dimensionality of the latent to the observations space is not directly possible
since the observation space is discrete, and the latent space is continuous.
Despite the issues in the reported PPL values, MELBO is never used in training, and was introduced
solely for the purpose of comparison to existing models. Nevertheless, we still demonstrate superior BLEU
score (i.e., compared to VAE and AE), and SOTA Q & A results (i.e., for single task models). Those
results are valid and are independent from the issues introduced by MELBO. We believe that sentenceMIM
is still a promising model that might be of interest to the research community.
I hope my reply answers your questions.

@michalivne thank you for the explanation, sadly I have not enough expertise to fully understand it (I'm not a researcher) but it does not matter!
Personally, PPL on pen Treebank is not what really interest me.

Nevertheless, we still demonstrate superior BLEU
score (i.e., compared to VAE and AE), and SOTA Q & A results (i.e., for single task models).

This is a big achievement!
I fail to understand what kind of Nlp tasks is not suited for SMIM.
Is it as general as BERT/xlnet?
Because GPT-2 is not as general as those (only specialized for "generative" tasks?)
I want to accomplish AGI by building the first true semantic parser for natural language. In order to do that I depend on lower level tasks such as:
POS tagging
Dependency parsing
Coreference resolution
Their errors all add up and the current state of the art is bad honestly.
To that end, training SMIM to those angular, fundamental Nlp tasks seems to me like a priority as it might have the potential to beat the state of the art.
What do you think about this goal? Will you pursue it or do you have other priorities?
For example it seems simple to beat the current coreference resolution SOTA
https://github.com/sebastianruder/NLP-progress/blob/master/english/coreference_resolution.md
By just using the latest SOTA implementation and replacing their pretrainer (spanBERT) by either XLnet or SMIM.

Hi,
I am currently working on a more complete demonstration of sMIM use cases
for NLP.
I will update the repository once the pre-print is updated.
Generally speaking, MIM is a general learning framework (closely related to
VAE), and as such sMIM has no inherent limitations regarding downstream
tasks.
Compared to BERT, sMIM is also a generative model, not only a
representation learning model. As a result it is very easy to perform tasks
such as Q & A, for instance.
I wish you all the best with your goals (I share similar goals), and I
encourage you to share any success stories with me.
I will be happy to add your contributions to the sentenceMIM repo (and
credit you, of course).
Best regards,
Micha
On Mon, Jun 1, 2020 at 6:39 AM LifeIsStrange<EMAIL_ADDRESS>wrote:

@michalivne https://github.com/michalivne thank you for the
explanation, sadly I have not enough expertise to fully understand it (I'm
not a researcher) but it does not matter!
Personally, PPL on pen Treebank is not what really interest me.
Nevertheless, we still demonstrate superior BLEU
score (i.e., compared to VAE and AE), and SOTA Q & A results (i.e., for
single task models).
This is a big achievement!
I fail to understand what kind of Nlp tasks is not suited for SMIM.
Is it as general as BERT/xlnet?
Because GPT-2 is not as general as those (only specialized for
"generative" tasks?)
I want to accomplish AGI by building the first true semantic parser for
natural language. In order to do that I depend on lower level tasks such as:
POS tagging
Dependency parsing
Coreference resolution
Their errors all add up and the current state of the art is bad honestly.
To that end, training SMIM to those angular, fundamental Nlp tasks seems
to me like a priority as it might have the potential to beat the state of
the art.
What do you think about this goal? Will you pursue it or do you have other
priorities?
For example it seems simple to beat the current coreference resolution SOTA
https://github.com/sebastianruder/NLP-progress/blob/master/english/coreference_resolution.md
By just using the latest SOTA implementation and replacing their
pretrainer (spanBERT) by either XLnet or SMIM.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/seraphlabs-ca/SentenceMIM-demo/issues/5#issuecomment-636775234,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ABY3ZWLBOW7MWMREIRRWSTLRUOAOZANCNFSM4NOMYOCQ
.

Thanks for the kind answer :)


Minor Issues in Asset Pricing with Incomplete Markets

Hello again. Some minor typos in Asset Pricing with Incomplete Markets

For the pessimists' beliefs, you copied the optimists' beliefs.

For price_optimistic_beliefs() (and pessimistic) you specify tol=1e-16 in during inputs but the code compares to 1e-12. Also there seems to be no need to pre-assign p_old before the loop starts.

I didn't quite get why the price of the asset had to be weakly greater than 1, as the code assumes. What's the intuition for this restriction?

Thanks as always.

Thanks @spspitze, much appreciated.  @Harveyt47, would you mind to take a look?

Hi @jstac yep I'll have a look at it now.

@spspitze is right the pessimists transition matrix here should be [[2/3, 1/3], [2/3, 1/3]] I believe.
Also we do not use tol in both price_optimistic_beliefs() and price_pessimistic_beliefs(). I'll make a PR


OSX 10.12.5 Sierra - no member named 'raise' in the global namespace

I have attempted to install via homebrew, having the source in my project, and manually building & installing, and I keep getting the same error.  The only usage so far is just adding the headers:
#include <g3log/g3log.hpp>
#include <g3log/logworker.hpp>

I am consistently getting the error:
In file included from extern/g3log/src/g3log/g3log.hpp:25:
In file included from extern/g3log/src/g3log/logcapture.hpp:17:
/Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin/../include/c++/v1/csignal:54:9: error:
      no member named 'raise' in the global namespace
using ::raise;
      ~~^

My compiler command:
g++ -std=c++11 -g -Wall -Wextra  -Iinclude -D_THREAD_SAFE -I/usr/local/include -Iextern/g3log/src -c -o build/accounting.o src/accounting.cpp

g++ --version
Configured with: --prefix=/Applications/Xcode.app/Contents/Developer/usr --with-gxx-include-dir=/usr/include/c++/4.2.1
Apple LLVM version 8.0.0 (clang-8<IP_ADDRESS>)
Target: x86_64-apple-darwin16.6.0
Thread model: posix
InstalledDir: /Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin

something in your setup is not correct.
Ref:
http://www.csl.mtu.edu/cs4411.ck/www/NOTES/signal/raise.html
if csignal is not available then please go through the necessary steps to install the missing c-libraries.   I.e. the issue is not an issue with g3log, it's with the setup of c-libraries that should exist in the runtime but either aren't there or cannot be found due to path issues.

I'd suggest that you make a simple "hello world" example that uses some c-api calls such as in the example in the link that I called out. If that works then you should be able to use the signal parts of g3log


feat(abg)!: replace data class perks by code generation in bindings

Fixes #1629

[!WARNING]
This pull request is not mergeable via GitHub because a downstack PR is open. Once all requirements are satisfied, merge this PR as a stack on Graphite.
Learn more

#1644  👈
#1639
#1643
main

This stack of pull requests is managed by Graphite. Learn more about stacking.

Join @Vampire and the rest of your teammates on  Graphite


"2 definitions" when using  module.exports to export a function wrapped in {}

VSCode Version: 1.28.2
OS Version: macOS 10.14

I noticed there are several issues opened against "2 definitions", noticeably https://github.com/Microsoft/vscode/issues/51459 & https://github.com/Microsoft/TypeScript/issues/24861
But I don't think my issue is the same (I don't use ts or react, just nodejs code). It happens when I export like this
function downloadVoice() {
...
}

module.exports = {
    downloadVoice
}
// If I export like this it will not happen
// module.exports = downloadVoice

But when I hover over to the place when the function is called, vscode can show the definition correctly,

The 2 definitions warning:

Does this issue occur when all extensions are disabled?: Yes

I can't repo this in a simple project:
x.js:
function downloadVoice() {

}

module.exports = {
    downloadVoice
}
// If I export like this it will not happen
// module.exports = downloadVoice

y.js:
const { downloadVoice } = require('./x')

downloadVoice

Please test using the code 1.29. If you still see this, please provide a complete code example that shows this problem

Hi  it is very easy to reproduce
First use express generator to create a simple project, then change router/index.js to this
var express = require("express");
var router = express.Router();

/* GET home page. */
router.get("/", function(req, res, next) {
  res.render("index", { title: "Express" });
});

function hi() {
  console.log("hi");
}

module.exports = { router, hi };

And in app.js import like this
var dup = require("./routes/index");
var usersRouter = require("./routes/users");
dup.hi();

Then click dup.hi() to see the warning.

I tested 1.29, it still has the problem.


QnARecognizer.js results in Error when there is a backslash

When there is a backslash character (i.e ) in a message to the bot it results in the following error:
TypeError: Cannot read property 'length' of undefined
    at Request._callback (C:\Dev\MyBot\node_modules\botbuilder-cognitiveservices\lib\QnAMakerRecognizer.js:54:70)
    at Request.self.callback (C:\Dev\MyBot\node_modules\request\request.js:186:22)
    at emitTwo (events.js:106:13)
    at Request.emit (events.js:191:7)
    at Request.<anonymous> (C:\Dev\MyBot\node_modules\request\request.js:1163:10)
    at emitOne (events.js:96:13)
    at Request.emit (events.js:188:7)
    at IncomingMessage.<anonymous> (C:\Dev\MyBot\node_modules\request\request.js:1085:12)
    at IncomingMessage.g (events.js:292:16)
    at emitNone (events.js:91:20)
/ - ERROR: Cannot read property 'length' of undefined

Line 54 needs to be changed from:
if (result.answers !== null && result.answers.length > 0) {
To:
if (result.answers !== undefined && result.answers.length > 0) {

Thank you for opening an issue against the Bot Framework Cognitive Services repo. As part of the Bot Framework v4 release, we’ve moved all the Luis and QnA work to platform SDK repo. We will continue to support and offer maintenance updates via this repo.
From now on, https://github.com/Microsoft/botframework-sdk repo will be used as hub, with pointers to all the different SDK languages, tools and samples repos.
As part of this restructuring, we are closing all tickets in this repo.
For defects or feature requests, please create a new issue in the Bot Framework repo found here:
https://github.com/Microsoft/botframework-sdk/issues
For product behavior, how-to, or general understanding questions, please use Stackoverflow.
https://stackoverflow.com/search?q=bot+framework
Thank you.
The Bot Framework Team


Bump MLFlow to 2.9.1

Describe changes
Sorry @htahir1 / @safoinme ; https://github.com/zenml-io/zenml/pull/2121 got closed automatically after I had deleted my local fork and reforked for https://github.com/zenml-io/zenml/pull/2155. This PR provides the same diff.
Pre-requisites
Please ensure you have done the following:

[x] I have read the CONTRIBUTING.md document.
[x] If my change requires a change to docs, I have updated the documentation accordingly.
[x] If I have added an integration, I have updated the integrations table and the corresponding website section.
[x] I have added tests to cover my changes.
[x] I have based my new branch on develop and the open PR is targeting develop. If your branch wasn't based on develop read Contribution guide on rebasing branch to develop.

Types of changes

[ ] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to change)
[x] Other (add details above)

I think there is something that fails when using this version with our project templates, will run some local tests tomorrow on our templates to see if there are some suggested modifications that should be done on the integration. Thank you so much for re-opening this @christianversloot

Done

@christianversloot The integrations look good everything works, however, it seems like MLflow now requires TensorFlow to be installed even if it's not going to be used, which would require adding some notes in the documentation, and adding TensorFlow as one of the installed integrations for every example and template we have.

That is interesting, thanks for testing!
If you could point me to where you'd like these changes to be made, I can
help you by adding them into the PR on Monday.
Op za 16 dec. 2023 20:50 schreef Safoine El Khabich <
@.***>:

@christianversloot https://github.com/christianversloot The
integrations look good everything works, however, it seems like MLflow
now requires TensorFlow to be installed even if it's not going to be
used, which would require adding some notes in the documentation, and
adding TensorFlow as one of the installed integrations for every example
and template we have.
—
Reply to this email directly, view it on GitHub
https://github.com/zenml-io/zenml/pull/2156#issuecomment-1858917012, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/ABRG3NDJFMQSNOWWMQOFWGLYJYCQJAVCNFSM6AAAAABAVQDLRGVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQNJYHEYTOMBRGI
.
You are receiving this because you were mentioned.Message ID:
@.***>

That is interesting, thanks for testing!
If you could point me to where you'd like these changes to be made, I can
help you by adding them into the PR on Monday!

@safoinme  does mlflow really now require tensorflow? I would find this incredibly hard to understand..

@htahir1 I think it's related to how ZenML uses MLFlow in the integration, see the stack trace. In zenml.integrations.mlflow.experiment_trackers.mlflow_experiment_tracker:241, it calls tensorflow.autolog(disable=True) because "[t]here is no way to disable auto-logging for all frameworks at once."
The MLFlow Tensorflow callback (added 3 months ago in mlflow==2.8.0) now requires tensorflow: from tensorflow import keras - https://github.com/mlflow/mlflow/commits/master/mlflow/tensorflow/callback.py.
In other words, if you don't have tensorflow installed, it fails now. I missed this in my first test but can replicate this in a clean environment.
I'm not sure if the fix is to require TensorFlow, this would seem weird e.g. in cases where PyTorch is used. Probably better would be to capture autolog disabling in try/except blocks for each framework within ZenML. What do you think? It could be part of this PR.
Failed to run step train_model.
No module named 'tensorflow'
Traceback (most recent call last):
  File "/home/chris/miniconda3/envs/zenml/lib/python3.10/site-packages/zenml/orchestrators/step_launcher.py", line 230, in launch
    self._run_step(
  File "/home/chris/miniconda3/envs/zenml/lib/python3.10/site-packages/zenml/orchestrators/step_launcher.py", line 456, in _run_step
    self._run_step_without_step_operator(
  File "/home/chris/miniconda3/envs/zenml/lib/python3.10/site-packages/zenml/orchestrators/step_launcher.py", line 531, in _run_step_without_step_operator
    runner.run(
  File "/home/chris/miniconda3/envs/zenml/lib/python3.10/site-packages/zenml/orchestrators/step_runner.py", line 222, in run
    self._stack.cleanup_step_run(
  File "/home/chris/miniconda3/envs/zenml/lib/python3.10/site-packages/zenml/stack/stack.py", line 1018, in cleanup_step_run
    component.cleanup_step_run(info=info, step_failed=step_failed)
  File "/home/chris/miniconda3/envs/zenml/lib/python3.10/site-packages/zenml/integrations/mlflow/experiment_trackers/mlflow_experiment_tracker.py", line 263, in cleanup_step_run
    self.disable_autologging()
  File "/home/chris/miniconda3/envs/zenml/lib/python3.10/site-packages/zenml/integrations/mlflow/experiment_trackers/mlflow_experiment_tracker.py", line 241, in disable_autologging
    tensorflow.autolog(disable=True)
  File "/home/chris/miniconda3/envs/zenml/lib/python3.10/site-packages/mlflow/utils/lazy_load.py", line 41, in __getattr__
    module = self._load()
  File "/home/chris/miniconda3/envs/zenml/lib/python3.10/site-packages/mlflow/utils/lazy_load.py", line 30, in _load
    module = importlib.import_module(self.__name__)
  File "/home/chris/miniconda3/envs/zenml/lib/python3.10/importlib/__init__.py", line 126, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
  File "<frozen importlib._bootstrap>", line 1050, in _gcd_import
  File "<frozen importlib._bootstrap>", line 1027, in _find_and_load
  File "<frozen importlib._bootstrap>", line 1006, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 688, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 883, in exec_module
  File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed
  File "/home/chris/miniconda3/envs/zenml/lib/python3.10/site-packages/mlflow/tensorflow/__init__.py", line 35, in <module>
    from mlflow.tensorflow.callback import MLflowCallback  # noqa: F401
  File "/home/chris/miniconda3/envs/zenml/lib/python3.10/site-packages/mlflow/tensorflow/callback.py", line 1, in <module>
    from tensorflow import keras
ModuleNotFoundError: No module named 'tensorflow'

@christianversloot this is a great idea! Lets do it as you suggest in this PR

@htahir1 added in https://github.com/zenml-io/zenml/pull/2156/commits/73c8c99572e1d5c0e2b59d8eeb9178098239415d

Good suggestion. For some reason, however, both proposals remained in the diff after accepting. This was fixed manually.
One question though, to what extent is fromlist required? Search results suggest it's a mandatory component, but it seems to work just fine without it:
>>> mod = __import__('mlflow.tensorflow')
>>> mod.autolog(disable=True)
>>>

Also, to what extent do we prefer importlib over __import()__?
>>> import importlib
>>> mod = importlib.import_module('mlflow.tensorflow')
>>> mod.autolog(disable=True)

Good suggestion. For some reason, however, both proposals remained in the diff after accepting. This was fixed manually.
One question though, to what extent is fromlist required? Search results suggest it's a mandatory component, but it seems to work just fine without it:
>>> mod = __import__('mlflow.tensorflow')
>>> mod.autolog(disable=True)
>>>

That's a very good question actually, fromlist will limit the imported package to autolog instead of importing the whole module. However, i think you have made a great point that we should probably use importlib instead
لإا

Good suggestion. For some reason, however, both proposals remained in the diff after accepting. This was fixed manually.
One question though, to what extent is fromlist required? Search results suggest it's a mandatory component, but it seems to work just fine without it:
>>> mod = __import__('mlflow.tensorflow')
>>> mod.autolog(disable=True)
>>>

That's a very good question actually, fromlist will limit the imported package to autolog instead of importing the whole module. However, i think you have made a great point that we should probably use importlib instead

Thanks for explaining!
I've made some changes wrt importlib, CI is running. Hopefully, we'll be able to merge in time for 0.53.0 :)

Not sure if the e2e failure is related to this PR? @htahir1 WDYT?

Not sure if the e2e failure is related to this PR? @htahir1 WDYT?

No worries, it is just our CI limitations - it fails to pull a branch from forked repos.

Not sure if the e2e failure is related to this PR? @htahir1 WDYT?

No worries, it is just our CI limitations - it fails to pull a branch from forked repos.

Good, thanks!
Looks ready to merge then.
Thanks everyone for your inputs & reviews 😎

Not sure if the e2e failure is related to this PR? @htahir1 WDYT?

No worries, it is just our CI limitations - it fails to pull a branch from forked repos.

Good, thanks! ~Looks ready to merge then.~ Edit: too soon, the new set of CI just started :D
Thanks everyone for your inputs & reviews 😎

Yeah, let's wait for MacOS runners to do their job, they are a bit tiered today. I will try to pull these changes in the release we will be making soon.

Not sure if the e2e failure is related to this PR? @htahir1 WDYT?

No worries, it is just our CI limitations - it fails to pull a branch from forked repos.

Good, thanks! ~Looks ready to merge then.~ Edit: too soon, the new set of CI just started :D
Thanks everyone for your inputs & reviews 😎

Yeah, let's wait for MacOS runners to do their job, they are a bit tiered today. I will try to pull these changes in the release we will be making soon.

Yes, sorry, I figure the MacOS ones started just after I had written the post, or I just missed them... anyway, thanks again!


Cloudguard Dashboard - Add Data verification on the CSPM API Call

Describe the issue
API should be considered as untrusted and data gathering through it should be checked to unsure of the quality of the received data and/or detect some malicious actions.
Currently, when we are calling the CSPM API to get the assets list we don't check the data received.
To be able to created the data verification we need the data scheme used by the API which is currently not in the docs so a ticket must be created on the Cloudguard side to obtain this information.
Additional context

The tickets is Ukeme idea's
there are in the Lambdas two calls on to CSPM and one from AWS, This tickets is focused on the CSPM Side but could be extend ?

Definition of done

We need the CSPM team to provide the Response Schema so that we have a target to aim for. (create a ticket with them)
Implement the specialized NodeJS libraries that Ukeme had suggested
We know what we should expect in the API response, defined in code in the lambda app.
We have code checking that the data received matches what is expected.

not relevant


Cypress Component Test for Topbar

This issue relates to https://github.com/remsfal/remsfal-frontend/blob/main/src/layout/AppTopbar.vue

I want to claim this issue

I want to claim this issue


Fixed missing Unsplash icons when API doesn't return an unsplash setting

closes https://github.com/TryGhost/Ghost/issues/9031

add a default value unsplash value to the setting model so that Unsplash is activated when the server doesn't return an unsplash setting
update the unsplash-settings transform to always deserialize or serialize to {isActive: true} when the value is blank or not parsable
add acceptance regression test covering API not returning an unplash setting
add unit tests for the unsplash-settings transform

Coverage increased (+0.04%) to 72.235% when pulling 9088f26752e2426631955d804040a8db67309dc4 on kevinansfield:fix-unsplash-default-on into 871a104c841825f7f212ca4ebe371944e7343c7c on TryGhost:master.


[help wanted] Input shape / target size flow from directory

Hi,
i´m wondering about the correct input_shape and/or target_size when using fit_generator and flow_from_directory. I´m running keras 2.0.8-tf and tensorflow 1.4 as the backend. My images have the following dimensions:
width: 725 Pixel
height: 180 Pixel
channels: 3
I define the Input_shape as: (width, height, channels) --> (725,180,3), as it is suggested when using tensorflow as the backend.
I use the ImageDataGenerator with the flow_from_directory method to get the training data. Here the target_size may be specified. The target_size can be either (width, height) or (height, width). The API is defining it as (height, width).
And now the Problem occurs. If the Input_shape is (width, height, channels) and the target_size is (heigth, width) - as it should be - a ValueError is raised, saying the shapes don´t match (Error when checking input: expected conv2d_1_input to have shape (None, 725, 180, 3) but got array with shape (50, 180, 725, 3)).
If i set the target_size to (width, height), the training is starting, but if i then plot an Image using the Generator, i see that width and height are exchanged and hence the Image is massively transformed.
How to solve this issue? In fchollets great example the target_size is also set the other way around as in the API.
Any help is appreciated! Thank you.
Here is my code example:
# Set the dimension of the images
img_width = 725
img_height = 180

# Define epochs and batch size
epochs = 1
batch_size = 50

# TensorFlow is the backend, so ordering of input_shape is as below
input_shape = (img_width, img_height, 3)

# Helper function to compile model
def compile_model(model):
    optimizer = Adam(lr=0.001, beta_1=0.9, beta_2=0.999, epsilon=1e-08, decay=0.0)
    model.compile(loss='categorical_crossentropy',
                  optimizer=optimizer,
                  #metrics=['accuracy'])
                  metrics=['accuracy',metrics.categorical_accuracy])

# Define the model
def generate_model(model_path):

    # check if model exists, if exists then load model from saved state
    if Path(model_path).is_file():
        sys.stdout.write('Loading existing model\n\n')
        sys.stdout.flush() #Warum?
        model = load_model(model_path)
        compile_model(model)
        return model

    sys.stdout.write('Loading new model\n\n')
    sys.stdout.flush() #Warum?

    # Define new model
    model = Sequential()
    model.add(Conv2D(32, (4, 4), input_shape=input_shape))
    model.add(Activation('relu'))
    model.add(MaxPooling2D(pool_size=(2, 2)))

    model.add(Conv2D(32, (4, 4)))
    model.add(Activation('relu'))
    model.add(MaxPooling2D(pool_size=(2, 2)))

    model.add(Conv2D(32, (4, 4), input_shape=input_shape))
    model.add(Activation('relu'))
    model.add(MaxPooling2D(pool_size=(2, 2)))

    model.add(Conv2D(64, (4, 4)))
    model.add(Activation('relu'))
    model.add(MaxPooling2D(pool_size=(2, 2)))

    model.add(Flatten())
    model.add(Dense(64))
    model.add(Activation('relu'))
    model.add(Dropout(0.5))
    model.add(Dense(num_classes, activation='softmax'))

    compile_model(model)

    # Save model
    with open(model_path, 'w') as outfile:
        json.dump(model.to_json(), outfile)
        outfile.close()

    return model

model = generate_model(model_path)

# this is the augmentation configuration we will use for training
train_datagen = ImageDataGenerator(
    rescale=1. / 255,
    rotation_range=180.,
    #shear_range=0.2,
    #zoom_range=0.2,
    horizontal_flip=True)

# this is the augmentation configuration we will use for testing:
# only rescaling
test_datagen = ImageDataGenerator(rescale=1. / 255)

train_generator = train_datagen.flow_from_directory(
    train_data_dir,
    target_size=(img_height, img_width), # not running this way
    batch_size=batch_size,
    class_mode='categorical')

validation_generator = test_datagen.flow_from_directory(
    validation_data_dir,
    target_size=(img_height, img_width), # not running this way
    batch_size=batch_size,
    class_mode='categorical')

hist = model.fit_generator(
    train_generator,
    steps_per_epoch=nb_train_samples // batch_size,
    epochs=epochs,
    validation_data=validation_generator,
    validation_steps=nb_validation_samples // batch_size)

model.save(model_path)
print('Saved trained model at %s ' % model_path)

x, y = train_generator.next()
classes_val = validation_generator.class_indices
print(classes_val)
for i in range(0,12):
    img = x[i]
    print(y[i])
    plt.imshow(img)
    plt.show()

@vkessler https://keras.io/layers/convolutional/. by keras doc, conv2d input shape should be (height, width) == (row, colum) sequence.
Sent with GitHawk

Thank you very much for the clarification. I guess i didn´t pay attention enough to the convolutional API.


Add alerts for running out of diskspace on VMs

Running out of space on infrastructure VM can become in outages, so defining alerts in grafana to send notifications when disk usage is > 90%

https://developer.bring.com/blog/forecasted-alerts-with-grafana-and-influxdb/

closed by #1265


Removing endpoints from AWS that are not associated with models in DB

This PR includes a script that looks at all endpoints in AWS, and removed those that are not associated with any model in the DB (excluding those endpoints included in the file DONT_TOUCH_ENDPOINTS.txt)
You can test how many endpoints you will be removing by running the script with flag --test_run and you can actually delete the endpoints by running the script with flag --real_run (note: the script defaults to the test_run mode so nothing will be deleted).
The script also makes sure you are running the right mode by waiting for user input when it is run, and also makes sure the list of DONT_TOUCH_MODELS.txt is updated by waiting for user input.
If run with --real_run flag, the script will delete all endpoints (i.e endpoints, endpoints config, sagemaker models) not associated with a model in the prod db. It does NOT delete the ECR.

These changes were incorporated into #813


How do I insert intrinsics with this library?

Should those be inserted with special API which is not exposed (and thus require insertion with unsafe { ... } & llvm-sys) or is there a way to insert them using existing Builder APIs?

Found a way - you just need to perform module.add_function with desired intrinsic name and parameter/return types, and then use as any other.


Create breaking-changes for VB compiler

I'm unsure of what's the correct place for this new article.
I'm thinking of creating a whats-new directory and move this new file into it. Then move this page to be the index of this new directory.

@Youssef1313 I like the suggestion of adding this to the "what's new" folder, and adding this file there.
Once you do that, and make the associated TOC changes, I'll :shipit:


Fast scroll

Hi,
Your lib is just wonderful! Really nice job!
I'd like to know if there is a way to add a fast scroll feature?
Thank you

I'm sorry, lib only do the adapter，Fast scroll And RecyclerView related


build: fix github web-flow PGPpubkeyFingerprint

fixes: https://github.com/raspiblitz/raspiblitz/issues/4406
need to check if using the new fingerprint doesn't break the checks on the old commits eg the LCD display script.

[x] wait for successful rpi build https://github.com/raspiblitz/raspiblitz/actions/runs/7900058813/job/21560806728?pr=4417

As expected it is a problem:
    arm.raspiblitz-arm64-rpi: # INSTALL 64bit LCD DRIVER
==> arm.raspiblitz-arm64-rpi: sudo: unable to resolve host 3608ec51f8ca: Name or service not known
    arm.raspiblitz-arm64-rpi: raspberrypi-bootloader set on hold.
    arm.raspiblitz-arm64-rpi: # clone/download https://github.com/tux1c/wavesharelcd-64bit-rpi.git
==> arm.raspiblitz-arm64-rpi: sudo: unable to resolve host 3608ec51f8ca: Name or service not known
==> arm.raspiblitz-arm64-rpi: fatal: destination path 'wavesharelcd-64bit-rpi' already exists and is not an empty directory.
==> arm.raspiblitz-arm64-rpi: sudo: unable to resolve host 3608ec51f8ca: Name or service not known
==> arm.raspiblitz-arm64-rpi: sudo: unable to resolve host 3608ec51f8ca: Name or service not known
==> arm.raspiblitz-arm64-rpi: sudo: unable to resolve host 3608ec51f8ca: Name or service not known
==> arm.raspiblitz-arm64-rpi: Already on 'master'
    arm.raspiblitz-arm64-rpi: Your branch is up to date with 'origin/master'.
==> arm.raspiblitz-arm64-rpi: sudo: unable to resolve host 3608ec51f8ca: Name or service not known
    arm.raspiblitz-arm64-rpi: HEAD is now at 5a206a7 Update install.sh
==> arm.raspiblitz-arm64-rpi: sudo: unable to resolve host 3608ec51f8ca: Name or service not known
==> arm.raspiblitz-arm64-rpi: --2024-02-13 17:13:06--  https://github.com/web-flow.gpg
==> arm.raspiblitz-arm64-rpi: Resolving github.com (github.com)... <IP_ADDRESS>
==> arm.raspiblitz-arm64-rpi: Connecting to github.com (github.com)|<IP_ADDRESS>|:443... connected.
==> arm.raspiblitz-arm64-rpi: HTTP request sent, awaiting response... 200 OK
==> arm.raspiblitz-arm64-rpi: Length: 2483 (2.4K) [text/plain]
==> arm.raspiblitz-arm64-rpi: Saving to: ‘/var/cache/raspiblitz/pgp_keys_GitHub.asc’
==> arm.raspiblitz-arm64-rpi:
==> arm.raspiblitz-arm64-rpi:      0K ..                                                    100% 1.66M=0.001s
==> arm.raspiblitz-arm64-rpi:
==> arm.raspiblitz-arm64-rpi: 2024-02-13 17:13:06 (1.66 MB/s) - ‘/var/cache/raspiblitz/pgp_keys_GitHub.asc’ saved [2483/2483]
==> arm.raspiblitz-arm64-rpi:
    arm.raspiblitz-arm64-rpi: # importing key of GitHub
==> arm.raspiblitz-arm64-rpi: gpg: directory '/home/admin/.gnupg' created
==> arm.raspiblitz-arm64-rpi: gpg: keybox '/home/admin/.gnupg/pubring.kbx' created
    arm.raspiblitz-arm64-rpi: pub   rsa2048 2017-08-16 [SC] [expired: 2024-01-16]
    arm.raspiblitz-arm64-rpi:       5DE3E0509C47EA3CF04A42D34AEE18F83AFDEB23
    arm.raspiblitz-arm64-rpi: uid                      GitHub (web-flow commit signing<EMAIL_ADDRESS>    arm.raspiblitz-arm64-rpi:
    arm.raspiblitz-arm64-rpi: pub   rsa4096 2024-01-16 [SC]
    arm.raspiblitz-arm64-rpi:       968479A1AFF927E37D1A566BB5690EEEBB952194
    arm.raspiblitz-arm64-rpi: uid                      GitHub<EMAIL_ADDRESS>    arm.raspiblitz-arm64-rpi:
==> arm.raspiblitz-arm64-rpi: gpg: /home/admin/.gnupg/trustdb.gpg: trustdb created
==> arm.raspiblitz-arm64-rpi: gpg: key 4AEE18F83AFDEB23: public key "GitHub (web-flow commit signing<EMAIL_ADDRESS>imported
==> arm.raspiblitz-arm64-rpi: gpg: key B5690EEEBB952194: public key "GitHub<EMAIL_ADDRESS>imported
==> arm.raspiblitz-arm64-rpi: gpg: Total number processed: 2
==> arm.raspiblitz-arm64-rpi: gpg:               imported: 2
    arm.raspiblitz-arm64-rpi: # running: git verify-commit 5a206a7
    arm.raspiblitz-arm64-rpi:
    arm.raspiblitz-arm64-rpi: gpg: Signature made Sun 16 Aug 2020 02:46:52 PM BST
    arm.raspiblitz-arm64-rpi: gpg:                using RSA key 4AEE18F83AFDEB23
    arm.raspiblitz-arm64-rpi: gpg: Good signature from "GitHub (web-flow commit signing<EMAIL_ADDRESS>[expired]
    arm.raspiblitz-arm64-rpi: gpg: Note: This key has expired!
    arm.raspiblitz-arm64-rpi: Primary key fingerprint: 5DE3 E050 9C47 EA3C F04A  42D3 4AEE 18F8 3AFD EB23
    arm.raspiblitz-arm64-rpi:
    arm.raspiblitz-arm64-rpi: # goodSignature(1)
    arm.raspiblitz-arm64-rpi: # correctKey(0)
    arm.raspiblitz-arm64-rpi:
    arm.raspiblitz-arm64-rpi: # BUILD FAILED --> PGP verification not OK / signature(1) verify(0)

Need to modify the script to check for the old key also.

the failed build here is a result of running out of disks space,  not related to the changes. Also the other two build succeed.

No disk space issue


Dict kwargs recursive wrapping breaks reference assignment

After #92 you can't make reference from Dict to Dict when creating instance:
>>> from addict import Dict
>>> d = Dict(a=1, b=2)
>>> a = Dict(d=d)
>>> a.d
{'a': 1, 'b': 2}
>>> d
{'a': 1, 'b': 2}
>>> a.d is d
False
>>>

I expect, that changes to a.d will affect d.

This is more of documentation issue than a bug.
Dict() copies dict/list/tuple structure so this is expected behaviour.
def test_recursive_wrapping_refs(self):
d = Dict(a=1, b=2)
a = Dict(d=d)
c = Dict(d=d)
c.d.z = 3
    self.assertDictEqual(a.d, d)
    self.assertDictContainsSubset(d, c.d)
    self.assertIsNot(a.d, d)
    self.assertIsNot(c.d, d)

It is implicit copying. Don't you think explicit using of copy module will be more pythonic, so Dict behavior will be closer to dict.

Also, this creates disambiguations:
>>> import addict
>>> addict.__version__
'2.1.1'
>>> from addict import Dict
>>> l = [1, 2, 3]
>>> d = Dict(l=l)
>>> d.l
[1, 2, 3]
>>> d.l is l
False
>>> d.l = l
>>> d.l is l
True
>>>

Hey @pohmelie,
I understand that the behavior is a bit confusing. It's an attempt to balance between expectations of the addict module. Today, whatever you give addict in the constructor will be recursively iterated over and any dict will be turned into a Dict. In contrast, whatever you set as an attribute on the Dict instance will not be copied.  While this is the way we intended it to work, it can lead to surprises.
At this point, I am leaning towards moving today's __init__-functionality in it's own static method, say Dict.from_dict, and let __init__ do as you expect over. This would however warrant a major release.
Thanks @egao1980 for stepping in and answering questions! 👍

hello @mewwts is the new from_dict method already available? I think it could greatly improve the reading of the code, so if it's not done, I think it would be a great idea!


HTTP::CompressHandler doesn't compress on upgrade

Currently HTTP::CompressHandler is corrupting the output when used in combination of a HTTP::WebSocketHandler. This started to happen due to changes done in #9115 and #9243. But actually it worked before because the response.output was never closed and instead manually pushed to get the upgrade response headers written.
This PR is not ideal either. Actually the HTTP::CompressHandler should defer compression maybe until the response is starting to flush and decide right there if it's worth or correct to compress the output, for example if the body is too small, or it shouldn't even exist (like in upgrades). But that would probably require some refactors.

Closing in favor of another PR I'm preparing to solve this and other issues we currently have with HTTP::CompressHandler


Unconstrained Scroll

Hello all,
I am currently using version 7.1.5 of JTAppleCalendar and I am having some troubles with scrolling the calendar through months. I know it is a CollectionView behind the scenes so, my calendar is kinda of scrolling as a normal CollectionView and, not going from month to month as I scroll it. Does anyone know how to fix it ?
I've made a gif to show what I am explaining... I think the gif is not that good but I think it shows what is going on and where I want to go

I would like to constraint the scroll to go through months only..

https://patchthecode.github.io/CalendarScrolling/
closing issue.
let me know if it helped.

@patchthecode
Thanks for the quick and effective response :) It worked like a charm


Master

hi, just keeping the single tests available (not for travis which runs set1 but for local tests with the browser).
funny: the full test is still having that math issue on my laptop but not in travis. and only when its included in the full test, when run standalone module_math it is working.

argh, 74 changed files wtf ... I love github - but I hate git. forget this PR, I make a new fork.


Providing a reference to know on apache kafka

Providing a reference to know on apache kafka where CDC provides a row level change feed to it for downstream process.

This change is

Online preview: http://cockroach-docs-review.s3-website-us-east-1.amazonaws.com/7f1a0f0f194e362d024f8fff9c90a8b52ef72880/
Edited pages:

v19.1/sql-statements.md


Unconditionally copy pull-secret.

Seems like the condition prevents the copy.
Signed-off-by: Alexander Chuzhoy<EMAIL_ADDRESS>Description
Please include a summary of the change and which issue is fixed. Please also include relevant motivation and context. List any dependencies that are required for this change.
Fixes # (issue)
Type of change
Please select the appropriate options:

[ ] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)
[ ] This change requires a documentation update
[ ] This change is a documentation update

Testing
Please describe the tests that you ran to verify your changes. Provide instructions so we can reproduce. Please also list any relevant details for your test configuration

[ ] Test A
[ ] Test B

Test Configuration:

Versions:
Hardware:

Checklist

[ ] I have performed a self-review of my own code
[ ] If a change is adding a feature, it should require a change to the README.md and the review should catch this.
[ ] If the change is a fix, it should have an issue. The review should make sure the comments state the issue (not just the number) and it should use the keywords that will close the issue on merge.
[ ] A change should not be merged unless it passes CI or there is a comment/update saying what testing was passed.
[ ] PRs should not be merged unless positively reviewed.

/cc @flaper87  @jparrill @vkolodny
Apparently the file was there as the condition wasn't met. This patch makes it work.

Changing base branch to consolidate all backports


org.gradle.process.internal.ExecException: Process 'command '/Users/lzj/Library/Android/sdk/ndk-bundle/ndk-build'' finished with non-zero exit value 2

I have reviewed the documentation

I have searched existing issues

I am using React Native version: 0.58.6

I imported ReactAndroid project the source code to android demo. But, The tips are as follows:

React Native version: 0.58.6
React Native Environment Info:
System:
  OS: macOS 10.14.5
  CPU: (8) x64 Intel(R) Core(TM) i7-4770HQ CPU @ 2.20GHz
  Memory: 1.16 GB / 16.00 GB
  Shell: 3.2.57 - /bin/bash
Binaries:
  Node: 11.10.0 - /usr/local/bin/node
  Yarn: 1.13.0 - /usr/local/bin/yarn
  npm: 6.9.2 - /usr/local/bin/npm
  Watchman: 4.9.0 - /usr/local/bin/watchman
SDKs:
  iOS SDK:
    Platforms: iOS 12.2, macOS 10.14, tvOS 12.2, watchOS 5.2
IDEs:
  Android Studio: 3.4 AI-183.6<IP_ADDRESS>22156
  Xcode: 10.2.1/10E1001 - /usr/bin/xcodebuild
npmPackages:
  react: 16.6.3 => 16.6.3
  react-native: 0.58.6 => 0.58.6
npmGlobalPackages:
  react-native-cli: 2.0.1
  react-native-scanner-kit: 0.1.0
Android SDK: 29，API: 28.0.3
Android Studio: 3.2.1
gradle: 4.6

Steps To  Reproduce

Config SDK & NDK path to .bash_profile;

imported ReactAndroid, Config build.gradle、settings.gradle；

Describe what you expected to happen:
Because my project can't use the latest version, but must use version 0.58.6, what is the cause?
Snack, code example, or link to a repository:
https://github.com/facebook/react-native/releases/tag/v0.58.6
Minimal code example：

setting.gradle
include ':app', ':ReactAndroid'
project(':ReactAndroid').projectDir = new File(rootProject.projectDir, '../node_modules/react-native/ReactAndroid')

build.gradle
`dependencies {
classpath 'com.android.tools.build:gradle:3.2.1'
classpath 'de.undercouch:gradle-download-task:3.4.3'
}`

app/build.gradle
` dependencies {
implementation fileTree(dir: 'libs', include: ['*.jar'])
implementation 'com.android.support:appcompat-v7:28.0.0'
implementation 'com.android.support.constraint:constraint-layout:1.1.3'
testImplementation 'junit:junit:4.12'
androidTestImplementation 'com.android.support.test:runner:1.0.2'
androidTestImplementation 'com.android.support.test.espresso:espresso-core:3.0.2'
implementation project(':ReactAndroid')
}`

Please, help?

Unfortunately v0.58 is quite dated and we don't provide support for it. Please try RN 0.59 and if that works, we highly encourage to upgrade to the just released 0.60.


subkey and polkadot-js tools

I am testing the sr25519 signatures both using subkey tool and polkadot-js tool. I found the signature made by js tool could be verified by subkey, but subkey's signature could not be verified by js any way.
network: kusama
substrate version:
commit 3ba0f2a2dbd37c31851a0ff1c1c0c47aa940de90
(HEAD -> polkadot-master, origin/polkadot-master)
sr25519 for subkey: 0.8.4
url for js tool:https://polkadot.js.org/apps/#/toolbox/verify
setting: to kusama host by parity
account:
./subkey --network 'kusama' inspect 'decrease reveal tunnel future ring month oxygen business orient nice save frost'
Secret phrase `decrease reveal tunnel future ring month oxygen business orient nice save frost` is account:
  Secret seed: 0x3b702c543136cb64abffc0740f0cc2fe6c6b7cd0e36fea4ebf3a220a3879a83d
  Public key (hex): 0x2e0a685d757d6904785b1dc01e6e67aecb8675a84bde3a1da85386c2fbb09279
  Address (SS58): Dcgp4X57UXtxRrAiFyP2Gq8qRVLhfmVYacRC9CDwMjtbP3A

subkey verify data=12 in textbox on page
 echo -n '12' | ./subkey --network 'kusama' verify 7eacf1c22fc05166dbd0c6cf95a9c12305a48847ffbe6bc0a318440f489a9851cfdb960da7ca686cb84f616ed2e45a9a12e28ac194a67fae0102bd598ec4db0a 'decrease reveal tunnel future ring month oxygen business orient nice save frost'
verify message [49, 50]
Signature verifies correctly.

sign cmd on subkey
echo -n '12' | ./subkey --network 'kusama' sign 'decrease reveal tunnel future ring month oxygen business orient nice save frost'

Is your js running schnorrkel 0.1.1 or 0.8.*?  We verify correctly the deprecated schnorrkel 0.1.1 signatures in polkadot, but we'll disable this once all the testnets have transitioned.

Thanks Jeff.
I am trying to figure out which version in js. We are not running js by our own but just use the online one.  All rust code turned into asm.js and we can not track the version so far. So may be we need some one from js team to ask..

CC @jacogr

The JS side is on 0.1.1 - since . it still needs Alexander and (some other, e.g. templates) 1.x chain support. The PR is completed, but marked as on-ice until Substrate 1.x support is dropped. https://github.com/polkadot-js/wasm/pull/29

@jacogr Thanks. I verified 0.1.1 is ok.
And BTW, the readme of subkey:
echo <msg> | subkey sign <seed,mnemonic>

There is a little small issue that we will get an '0x0a' in the end of message without -n. Nothing a big deal but will be better if
echo -n <msg> | subkey sign <seed,mnemonic>

@chesterliliang ty for reporting back! I will close this now.

Could we suggest different branches of polkadot-js for different chains?  I'm wondering how long these deployments persist.

I have a whole chain of dependencies -

WASM interfaces - https://github.com/polkadot-js/wasm
utility libraries (wraps above) - https://github.com/polkadot-js/common
API (uses above) - https://github.com/polkadot-js/api
UI (uses above) - https://github.com/polkadot-js/apps

There will be a final version of the api that still supports 1.x before that gets dropped (for chains that are based on Substrate 1.x, while e.g. the UI will just immediately "stop"), but while we still have in-use chains with no actual other options, i.e. we don't have an Alexander replacement as of yet, there is not much room to move to just "drop stuff randomly".
While all do-able, I'm not jumping up and down with joy at the prospect of having to manage multiples of each of the above alongside everything else, I only have so many hours a day and stretched as it is. While there are still compatibility options, not creating extra work.

I see.  We're not going to upgrade Alexander either?  Do we know how long it'll live?

Don't let my lack of action stop anything, there are ways to manage this (it just adds overhead and some additional support/confusion), but nothing should be a show-stopper in the name of progress. The path of least friction till now is "having the work done, but not merged".
Alexander is 6+ months old and really cannot be upgraded from Polkadot 0.4 to 0.5 (lots of things moved around, the trie has changed, etc. It can be done with migration scripts, but is is easier to re-launch a testnet in the same vein without wasted effort)


Use the --immutable-cache flag upon install

The --immutable-cache flag is now used during CI in steps where the cache is expected to be populated. This ensures we are alerted if our CI is misconfigured.

Should we add this to https://github.com/MetaMask/metamask-module-template ?

It already is:
https://github.com/MetaMask/metamask-module-template/blob/main/.github/workflows/build-test.yml#L37


clean up seaice_advdiff.F

What changes does this PR introduce?

reorganization of seaice_advdiff.F to separate SEAICE_ITD code more cleanly from the rest.
remove option of 2nd order centered advection scheme for SEAICE_ITD defined.

What is the current behaviour?
What is the new behaviour
The behavior of the code does not change except that it is no longer possible use the 2nd order centered scheme with SEAICE_ITD defined.
Does this PR introduce a breaking change?
No, but it is no longer possible use the 2nd order centered scheme with SEAICE_ITD defined.
Other information:

@jm-c looks like the first commit (465855d)  in the PR is a left over from a different PR. I don't know how that got in there, but it is exactly the same commit that was already merged in #160
Sorry about that, I am not sure how to fix it now.

This looks good.
I will just make a suggestion: It would be nice to be able to compile pkg/seaice without pkg/generic_advdiff, in case one want to just use the thermodynamics part without dynamics nor advection (a little bit like offline_exf_seaice/input.thermo/). And since you added few #include GAD.h
in few places, they would need to be protected with #ifdef ALLOW_GENERIC_ADVDIFF (like in current seaice_advection.F). Also I don't think GAD.h is needed anymore in  seaice_advdiff.F so it can be removed from there.

Good idea. I added/removed code and flags to make it possible to compile pkg/seaice without pkg/generic_advdiff. We don't have a test for this, but do we need that?  1D_ocean_ice_column does not work because it seems to use/or at least compile KPP, which requires pkg/generic_advdiff (for a good reason) and offline_exf_seaice/input.thermo is tied to the other experiments.


Add compress option when upload file

It is really useful if you upload text file and compress it will save a lot of bandwidth.
The ratio can reach up to 10:1

Also add password option also good and keep their files safe :)

Do you mean compress the file or compress the transaction? I think the user can encrypt the file before the upload

I AGREE, we shouldn't make tool more complicated so closed.


test2

Summary of changes
Changes introduced in this pull request:
Reference issue to close (if applicable)

Closes
Other information and links

Codecov Report

:exclamation: No coverage uploaded for pull request base (master@901d00c). Click here to learn what that means.
The diff coverage is n/a.

@@           Coverage Diff            @@
##             master      #3   +/-   ##
========================================
  Coverage          ?   2.66%
========================================
  Files             ?     207
  Lines             ?   13581
  Branches          ?       0
========================================
  Hits              ?     362
  Misses            ?   13219
  Partials          ?       0

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 901d00c...6a8f88c. Read the comment docs.


operator retake uptick fails

When operator restake Uptick, is shows "Failed 2 messages: runtime error: invalid memory address or nil pointer dereference: panic: unknown request"

Very strange @nodestake - does this happen every time you run the script for Uptick? I might need the full logs if you could send them over on Discord?

Potentially caused by https://github.com/UptickNetwork/uptick/pull/19. This was raised on ECO Stake discord and another validator found this PR


Docker content

Since we're taking the Docker out of getting_started we should also take this stuff out of tools_editors. Caching it here so it doesn't get lost.
.. _docker_main:

Docker
===========

As discussed :ref:`earlier <jl_jupyterdocker>`, Docker is a tool that lets you run preconfigured, lightweight environments as applications on your computer or in a computational cloud

The advantage of a Docker-based workflow is that it's perfectly reproducible, and that setup (of Julia versions and dependencies, etc.) is handled upstream by the image maintainer

Here, we'll walk through the setup and installation steps, along with the main features of the ``quantecon/base`` Docker image

Setup
-----------

* First, create an account for `Docker Hub <https://hub.docker.com/>`_ and create a docker id

* Next, download and install Docker for

    * `Mac <https://store.docker.com/editions/community/docker-ce-desktop-mac>`_
    * `Windows <https://store.docker.com/editions/community/docker-ce-desktop-windows>`_ - **do not** choose to use Windows containers

**Note:** For Windows

    * Hyper-V support should be enabled. For Windows 10 users, this means you must use a Pro, Enterprise, or Education version (**not Home or Mobile**)

    * If you don't meet these requirements, the `Docker Toolbox for Windows <https://docs.docker.com/toolbox/toolbox_install_windows/>`_ may help

* Next, to verify that there are no obvious errors in the installation, open a terminal (macOS/Linux) or Powershell (Windows) and run

    .. code-block:: none

        docker pull hello-world
        docker run hello-world

You should see something like

.. figure:: /_static/figures/docker-hello-world.png
    :scale: 100%

* Then, download the QuantEcon Docker image by running the following in your terminal (this may take some time depending on your internet connection)

    .. code-block:: none

        docker pull quantecon/base

* Next, create a "data volume," or a hidden directory where Docker will persist any changes to your Julia packages

    .. code-block:: none

        docker volume rm quantecon
        docker volume create quantecon

The first line will delete any existing volume we had with that name

Usage
---------------------

The basic, no-frills command is

.. code-block:: none

    docker run --rm -p 8888:8888 quantecon/base

The ``rm`` instructs Docker to delete the container on exit, and the ``p`` flag is for browser access

You will see something like

.. figure:: /_static/figures/docker-basic-command.png
    :scale: 100%

In the output, you should see some text near that bottom that looks like

.. code-block:: none

    <IP_ADDRESS>):8888/?token=7c8f37bf32b1d7f0b633596204ee7361c1213926a6f0a44b

Copy the text after ``?token=`` (e.g. ``7c8f37bf32b1d7f0b633596204ee7361c1213926a6f0a44b``)

In a browser, go to a URL like the following

.. code-block:: none

        http://<IP_ADDRESS>:8888/lab

To see something like

.. figure:: /_static/figures/docker-jupyter-lab.png
    :scale: 100%

**Note**:

* ``Ctrl+C`` is also the keyboard shortcut you use to kill the container, so be sure to copy using the mouse
* When you call this command, Docker may require you to give it permissions to access the drive and the network.  If you do not see the output within 20 or so seconds, then look for confirmation windows which may be hidden behind the terminal/etc.

Paste the text into ``Password or token:`` and choose ``Log in`` to get the full window

.. figure:: /_static/figures/docker-jlab-full.png
    :scale: 100%

We can see that some packages are already pre-installed for our use

.. figure:: /_static/figures/docker-packages-preinstalled.png
    :scale: 100%

Persisting Julia Changes
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

As above, you may want to persist changes in your environment (like added packages) from one session to the next

The command here is

.. code-block:: none

    docker run --rm -p 8888:8888 -v quantecon:/home/jovyan/.julia quantecon/base

This will have Docker write all changes to the user depot to the ``quantecon`` data volume we created

Accessing Local Files
^^^^^^^^^^^^^^^^^^^^^^^^^

The Docker image can exchange files locally (and recursively below in the tree) to where it is run

Open a terminal and ``cd`` to the directory you are interested in storing local files

To run an image local to those files, type the following in the terminal (on Linux and OSX)

.. code-block:: none

    docker run --rm -p 8888:8888 -v quantecon:/home/jovyan/.julia -v "$(pwd)":/home/jovyan/local quantecon/base

Or on Powershell on Windows

.. code-block:: none

    docker run --rm -p 8888:8888 -v quantecon:/home/jovyan/.julia -v ${PWD}:/home/jovyan/local quantecon/base

This will load the folder we ``cd``'d into as the ``local`` directory in the image for both reading and writing

Notice how we stacked this command with the one above it, so that Julia package changes will also be persisted

Maintenance and Troubleshooting
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

A few reminders

* If you forget your token number, you may need to stop and restart the container
* To stop the container, use ``Ctrl-C`` or type ``docker stop $(docker ps -aq)`` in a different terminal
* To reset your Docker volume completely, redo the ``docker volume rm quantecon`` and ``docker volume create quantecon`` steps
* To clean unnecessary Docker assets from your system, run ``docker system prune``
* If you can't log in, make sure you don't have an existing jupyter notebook occupying port 8888. To check, run ``jupyter notebook list`` and (if need be) ``jupyter notebook stop 8888``. If you have difficulties, see `this git issue <https://github.com/jupyter/notebook/issues/2844>`_

Don't do this. The docker is great, just too confusing for windows users to be in the intro setup

Roger, I put it back.


Visio diagram links point to the same file, rather unique files

[Enter feedback here]

Document Details
⚠ Do not edit this section. It is required for learn.microsoft.com ➟ GitHub issue linking.

ID: aa4a3938-1142-4e18-1915-4dcee68d4c99
Version Independent ID: aa4a3938-1142-4e18-1915-4dcee68d4c99
Content: Build a speech-to-text transcription pipeline to analyze recorded conversations - Azure Architecture Center
Content Source: docs/ai-ml/architecture/speech-to-text-transcription-analytics.yml
Service: architecture-center
Sub-service: example-scenario
GitHub Login: @bdleavitt
Microsoft Alias: bleavitt, christinas

@ctsafos
Thanks for your feedback! We will investigate and update as appropriate.

That is correct, they do @ctsafos; the one file contains two tabs; one for each diagram.  This is by design.  Hope you find what you're looking for!

#please-close


What's the best place to log final response?

I tried to log final response of processed message inAbort(), Cleanup(), but they both got called 2 or more times for one message.
So the question is, where should i log final response of processed message? and it should be called only once.

Cleanup() ist the right place. Abort() e.g. also gets called after the client of the MTA sessions issued a STARTTLS so not at the end of the transaction.
Cleanup() might in deed be called multiple times – but it is guranteed to be at least called once for each SMTP transaction. Since your milter backend is only valid for one transaction, just set a boolean

func (b *MyBackend) Cleanup() {
  if b.cleanupCalled {
    return
  }
  b.cleanupCalled = true
  // do cleanup
}

Thanks for the suggestion.
Is it better add a new method to be called ONCE after processed?

Can we add a new method which will be called ONCE after a single message has been processed?
For easy maintenance and troubleshooting, Milter server must log the final response and basic info of each message, so this method will be very neat and make milter development easier. :)

Checked session.go, Cleanup() is called in 3 places:

case wire.CodeQuitNewConn: https://github.com/d--j/go-milter/blob/115badd800c854f60252bd087533e0d12a5f4525/session.go#L310
case wire.CodeQuit: https://github.com/d--j/go-milter/blob/115badd800c854f60252bd087533e0d12a5f4525/session.go#L317
!resp.Continue(): https://github.com/d--j/go-milter/blob/115badd800c854f60252bd087533e0d12a5f4525/session.go#L394

Seems none of them can precisely match each processed message.
We can leave Cleanup() to case 1 and 2, but better add a new method to handle end of each processed message.

Sorry for beeing a little bit slow in understanding – can you explain why you need something other than EndOfMessage()?
https://github.com/d--j/go-milter/blob/30d4d62396d57db43116e28f8bb5c5b61ecf2478/server.go#L69-L75
In case the milter backend opts to reject the message before this callback, the milter backend already knows that the current message has ended, why should the serverSession need to tell the backend what the backend already told it?

EndOfMessage is not applicable at all, for example:

client sends AUTH command but login failed, client or Postfix will disconnect it.
client successfully login and send further SMTP commands, but Postfix rejects it due to, e.g. blacklisted or greylisted.

In both cases, there's no email message submitted at all, hence it doesn't go through EndOfMessage.

Hello @iredmail
Please have a look at PR #17 – I introduced a new method ConnectionClosed that gets called when the the connection to the MTA was closed. Hopefully this might be useful for your logging purposes.