@Transactional with RabbitTemplate.sendConnectionFactorySelectorExpression + SimpleRoutingConnectionFactory

Bug report
I am experiecing weird behavior when using SimpleRoutingConnectionFactory together with RabbitTemplate with filled sendConnectionFactorySelectorExpression. Then usage with @Transactional method,  message has been sent immediately just like without any open transaction
var connectionFactory = new SimpleRoutingConnectionFactory();
// + setup some connections e.g. with key/lookup "someLookup"

RabbitTemplate rabbitTemplate = new RabbitTemplate();
rabbitTemplate.setConnectionFactory(connectionFactory());
rabbitTemplate.setChannelTransacted(true);
var expression = exprParser.parseExpression("someLookup");
rabbitTemplate.setSendConnectionFactorySelectorExpression(expression);

@GetMapping("/test/rabbitmq")
@Transactional
public String rabbitTest() {
    rabbitTemplate.convertAndSend(MessagingConfig.EXCHANGE, MessagingConfig.RT, new MessageDto(1L, TenantContext.getTenantId()));
    System.out.println("breakpoint - in this point message is already sent");
    return "ok";
}

I am using this construct for publishing instead of SimpleResourceHolder.bind
Imo it is caused in RabbitTemplate, when creating channel - method obtainTargetConnectionFactory is used to obtain connection (this method takes into account sendConnectionFactorySelectorExpression) but then, when "transaction" context is evaluated, simple getter getConnectionFactory is used

Can you provide more information? Or, preferably, a MCRE.
I see obtainTargetConnectionFactory being called in send and the result passed to execute().
Then, in doExecute() it is that connection factory that is used to lookup the transactional resource.
Where are you seeing getConnectionFactory() being called?
This test passes:
@Test
@SuppressWarnings("unchecked")
public void testRoutingConnectionFactoryWithTx() throws Exception {
	org.springframework.amqp.rabbit.connection.ConnectionFactory connectionFactory1 = Mockito
			.mock(org.springframework.amqp.rabbit.connection.ConnectionFactory.class);
	org.springframework.amqp.rabbit.connection.Connection connection1
			= mock(org.springframework.amqp.rabbit.connection.Connection.class);
	Channel channel1 = mock(Channel.class, "channel1");
	given(channel1.isOpen()).willReturn(true);
	willReturn(connection1).given(connectionFactory1).createConnection();
	given(connection1.isOpen()).willReturn(true);
	given(connection1.createChannel(true)).willReturn(channel1);

	org.springframework.amqp.rabbit.connection.ConnectionFactory connectionFactory2 = Mockito
			.mock(org.springframework.amqp.rabbit.connection.ConnectionFactory.class);
	org.springframework.amqp.rabbit.connection.Connection connection2
			= mock(org.springframework.amqp.rabbit.connection.Connection.class);
	Channel channel2 = mock(Channel.class, "channel1");
	given(channel2.isOpen()).willReturn(true);
	willReturn(connection2).given(connectionFactory1).createConnection();
	given(connection2.isOpen()).willReturn(true);
	given(connection2.createChannel(true)).willReturn(channel2);

	Map<Object, org.springframework.amqp.rabbit.connection.ConnectionFactory> factories =
			new HashMap<Object, org.springframework.amqp.rabbit.connection.ConnectionFactory>(2);
	factories.put("foo", connectionFactory1);
	factories.put("bar", connectionFactory2);

	AbstractRoutingConnectionFactory connectionFactory = new SimpleRoutingConnectionFactory();
	connectionFactory.setTargetConnectionFactories(factories);
	connectionFactory.setDefaultTargetConnectionFactory(connectionFactory2);

	final RabbitTemplate template = new RabbitTemplate(connectionFactory);
	Expression expression = new SpelExpressionParser()
			.parseExpression("'foo'");
	template.setSendConnectionFactorySelectorExpression(expression);
	template.setChannelTransacted(true);

	new TransactionTemplate(new TestTransactionManager()).execute(status -> {
		template.convertAndSend("foo", "bar", "baz");
		return null;
	});

	Mockito.verify(connectionFactory1, times(1)).createConnection();
	Mockito.verify(connectionFactory2, never()).createConnection();
}

Aha - it does fail, if I use a RabbitTransactionManager...
		new TransactionTemplate(new RabbitTransactionManager(connectionFactory)).execute(status -> {
			template.convertAndSend("foo", "bar", "baz");
			return null;
		});

OK, thank you, or need any more detail?

Looking at it now... will let you know.

The issue is that when using the RabbitTransactionManager, the connection is made by the transaction manager, not the template, and he knows nothing about the lookup key.
Is there some reason that you must use a RabbitTransactionManager rather than just a local transaction, or transaction synchronization?

OK, hint from me, but am not really sure if I am missing something or not
RabbitTemplate.isChannelLocallyTransacted() looks like following:
protected boolean isChannelLocallyTransacted(Channel channel) {
	return isChannelTransacted() && !ConnectionFactoryUtils.isChannelTransactional(channel, getConnectionFactory());
}

and I think in that place it will not find correct object in some transaction holder object

The issue is that when using the RabbitTransactionManager, the connection is made by the transaction manager, not the template, and he knows nothing about the lookup key.
Is there some reason that you must use a RabbitTransactionManager rather than just a local transaction, or transaction synchronization?

I woulnt say I am using that, we using default/autoconfigured manager

I used sendConnectionFactorySelectorExpression to correctly "route" message instead of using suggested SimpleResourceHolder.bind
so edit our code to use SimpleResourceHolder.bind approach without need of sendConnectionFactorySelectorExpression and after those changes it works as expected

Yes, because then the transaction manager will get the right factory.
It's a limitation of using the expression with the template; it won't work if the TM creates the connection.
We should document that limitation - there is no way for the TM to know anything about the template's configuration.
That said, I don't see Boot auto-configuring a RabbitTransactionManager; if you have a small project that shows this behavior, I can take a look at it.

This code is correct:
return isChannelTransacted() && !ConnectionFactoryUtils.isChannelTransactional(channel, getConnectionFactory());

Because the key to the resource is the routing CF, not one of its delegates. If we looked up the delegate there, we would never find an existing transaction.

That said, I don't see Boot auto-configuring a RabbitTransactionManager; if you have a small project that shows this behavior, I can take a look at it.

not needed anymore, thank you for clarification and your time!


Any way to Insert via model in migration?

Hi.
I am trying to insert data into the database as part of migration 0 to migrate from another database we were using.  Is there any way to do this using a model object?
I tried the naïve approach of just creating and saving a model object, but I get "java.lang.IllegalStateException: getDatabase called recursively".
I'm assuming I need to interact with the DatabaseWrapper passed into migrate(), but I'm not sure how to insert a model using that.  model.getModelAdapter().getInsertStatementQuery() is protected.
Am I really forced into doing a SQLite.insert() ? Seems fragile to hard-code column names.
Either way, InsertTableMigration might be nice.

Matthew Carlson

This is def one of the things I am looking at improving. Currently statements and objects don't allow you to specify the database object when doing a migration. I need to evaluate this, but for now you will need to do it manually.

Ok. Good to know.  Thanks for replying so quick.  I'll go with the manual approach; the transition between app versions should be fairly short-lived in my case, so I'm guessing it won't be a problem.

sounds good. I did add ability to specify the DatabaseWrapper in most if not all queries of the DB, so you can take advantage of the wrapper classes for it if need be.


Move instant meilisearch to packages

Add the configuration files for turborepo initialization.

Create a root package.json that is named root is private and contains the workspaces.
Add a turbo.json configuration file with the tasks we want to be able to run in the multiple packages/app (see doc).

duplicated pr #940


Add f# Orleans 7 reminder example

This is very nice Wesley. This example will be a very helpful reference to have.

Nice work, thank you!


Support bus lanes in Python

Just synced Kotlin and Python functionality.

The magic of automated tests verifying things. Easy review :)


Union Type Descriptor - Documentation

Firstly, amazing work on this library, the way you guys have implemented this and the speed at which you guys improve the functionality consistently is great.
I'm having trouble figuring out how to implement union types in a code first fashion. I've had a look at the documentation here: https://hotchocolate.io/docs/code-first-introduction (at the bottom) but unfortunately the link for Union Type Descriptor gives a 404 page (Enum and Input object types also present 404 pages).
#416 suggests you need to create a marker interface and register the types, but i'm unsure how exactly to do this.
Are there any examples I can follow to do this in a code first manner?
Please forgive me if this is the incorrect place to submit this question.

Hi @kyrim,
we will improve the documentation for all schema types with the next release. I have that one one my todo list.
So,
as for your question, we have some unit tests that might help you here:
[Fact]
        public void GenericUnionType_DynamicName()
        {
            // act
            var schema = Schema.Create(c =>
            {
                c.RegisterType(new UnionType<IFooOrBar>(d => d
                    .Name(dep => dep.Name + "Foo")
                    .DependsOn<StringType>()));

                c.RegisterType(new FooType());
                c.RegisterType(new BarType());

                c.Options.StrictValidation = false;
            });

            // assert
            UnionType type = schema.GetType<UnionType>("StringFoo");
            Assert.NotNull(type);
        }

All the union type tests are here:
https://github.com/ChilliCream/hotchocolate/blob/master/src/Core/Types.Tests/Types/UnionTypeTests.cs
They might give you an idea how to use the union type.
We also have a slack channel if you like to join:
https://join.slack.com/t/hotchocolategraphql/shared_invite/enQtNTA4NjA0ODYwOTQ0LTBkZjNjZWIzMmNlZjQ5MDQyNDNjMmY3NzYzZjgyYTVmZDU2YjVmNDlhNjNlNTk2ZWRiYzIxMTkwYzA4ODA5Yzg
My response time is higher on there :)

If this answers your question please be so kind to close this issue.

I have added #698 to track the documentation update.

Thank you that answers my question :)


Plugin with user-defined rule for using "tweak url" products

Few examples

appending outline.com/ before a web article removes all the clutter from the page
replacing github.com/user/repo with github1s.com/user/repo opens the repo in an online vscode editor
appending ss before a youtube link leads to page where the video can be downloaded

#35 is a special case of this functionality

Interesting use case, are these expected to be configured by the user or we just provide them out of the box?

There are multiple ways to do it

We provide them the actions out of the box (code in #61)
User configures the actions creating a javascript bookmarklet(examples below) and use untab to trigger it (no change needed in code)
javascript: window.location.href = window.location.href.replace(/github(1s)?.com/, function(match, p1) { return p1 ? 'github.com' : 'github1s.com' })
javascript: window.location.href = "https://outline.com/" + window.location.href
Using untab gui plugin which facilitates method 2

Benefit of 2. is user will be able to export the bookmarks to other devices

@rohitner Interesting, I did not know bookmarks could store javascript scripts too! Is this supported in Firefox?
I think this is how we can go about this:

Provide some rules out of the box.
Pro users(who are familiar with JS) can create JS bookmarklet with their own features, that UnTab can pick up and trigger them.
Maybe in the future, make a separate interface (probably something like UnTab settings page) which makes this process of adding these bookmarklets easier.

Open to suggestions 🙂

Firefox does support javascript bookmarklets!

As of now, I have added the implementation of outlining articles in #61. Let me know if you are thinking of something else regarding the implementation.
I am trying to figure out how to download youtube videos using a single button instead of redirecting to another website.

It would be great to know about rules you would like to have out of the box :).

@rohitner Great to hear that Firefox supports them too!
#61 looks good, I'll do the code review on the PR soon.
I'm not fully sure which ones we can add out of the box. Here are a few that came to my mind:

https://tinyurl.com/create.php?url= for shortening current page link
outline.com and github1s.com that you suggested also seem cool.
(The github1s.com should only show up when user is on a GitHub repo though)
one for wayback machine? (I don't know if this is any helpful though)

Not sure how I feel about YouTube video downloading support out of the box, it sounds like it'll go against their terms.

Closing this as some of the actions discussed here have been added.
Discussion on user-configured actions using bookmarklets/normal JS scripts can now be on #85


A possible chan deadlock

Current Behavior

sometimes， the client can not connect to the server， and the openvpn-auth-oauth2 receives nothing
If I restart openvpn-auth-oauth2  and it works again and about some random time-lapse, it hangs again
I did some research , and some test code （so ，the code line of the stack  in the photo is not the same as with main branch）, and then dumped the stack when it hangs
I found a chan write blocked about 63 minutes,which is almost the time of my investigate period when I found it hangs
Expected Behavior
no hangs
Steps To Reproduce
-

Environment

openvpn-auth-oauth2 Version: master
OpenVPN Server Version: -
Server OS: -
OpenVPN Client (flavor, OS): -
OIDC Provider: -

openvpn-auth-oauth2 logs
HANGS, nothing

openvpn server logs
-

Anything else?
No response

Could you please enable the debug listener via --debug.pprof?
Then, if the deadlock comes up, please open the url http://localhost:9001/debug/pprof/goroutine?debug=2 and save the output to a file. It would help me more then a single screenshot.

Could you please enable the debug listener via --debug.pprof?
Then, if the deadlock comes up, please open the url http://localhost:9001/debug/pprof/goroutine?debug=2 and save the output to a file. It would help me more then a single screenshot.

goroutine.txt
I don't know when the hang will happen, maybe hours or days, so, the code line number of the pprof is against this tree  https://github.com/ihipop/openvpn-auth-oauth2/tree/df0f2e5c4ec873d6a451de5ed1ac53d1ed984b32

My guess is the main reason is that commandResponseCh is not being read, because the only reader is invoked by SendCommand if you don't send any command, then there is no reader, then, it blocks and blocks the message reader which hangs the hole program this will happen so if you receive a message that is not switched here, it will block I'm debugging what message it is, and I will pull a PR if I find something
discussion is welcome

I can mostly confirm this is the problem , I can confirm it event without the pprof dump

the size of commandResponseCh grows until it comes to 10, this explains why the hang of time-lapse/interval is unstable because it need client activities to triger
a frequently remote-exit message speedup the progress
the root cause is you fallback some message ,for example >NOTIFY:info,remote-exit,EXIT,
into commandResponseCh
which has only a reader active when you send command
this message will only happen when server is in UDP mode and explicit-exit-notify is enabled
a quick fix is to drop this message ,but what about the other messages we don't know?
I suggest a new channel that receives this un-wanted message and dump it to the log?
any idea ?
is a PR welcome?

A PR is welcome.
A test should be mandatory which cover this scenario.
Dont fully understand the issue. I have enabled explicit-exit-noticy local development for long time, but I'm
unable to verify this.

this time it's about >NOTIFY
what about the other message that we don't know?
the problem is that c.commandResponseCh should only receive a message that you expected, because you will only read the chan when you are sending a command
a buffer size of 0 should be set instead of 0 to make this problem to be exposed more quickly


3.2.0 local install build failed due to missing type dependency

Hi Thank you for updating gax-nodejs to 3.2.0
After release, i pulled repository and yarn install to install dependency & compile/build project.
but, i got type error after typescript compile
1) Is this a client library issue or a product issue?
this is a client library issue i think.
[Issue ScreenShot]

2) Did someone already solve this?
I think the problem may due to this commit. (removing "download" package from devDependencies

https://github.com/googleapis/gax-nodejs/commit/5898da6e2e7677dae96e1c51fef8cbd72c227e56#diff-7ae45ad102eab3b6d7e7896acd08c427a9b25b346470d7bc6507b6481575d519)

After I add "download" to devDependencies, it solved.
"download": "^8.0.0",

Environment details

OS: MacOS Monteray 12.5
Node.js version: 16.15.0
npm version: 8.5.5
google-gax version: 3.2.0

Steps to reproduce

local pull latest main
yarn install it

Thank you for reporting this! I was able to reproduce it with yarn (I use npm so I did not get this error locally).
I think the proper fix is not to install download (it's never used from gax-nodejs, only from test applications which are now moved to separate packages), but to remove @types/download from package.json which I left there by mistake.
I'll remove it in https://github.com/googleapis/gax-nodejs/pull/1316.

@alexander-fenster Thank you for quick fix 😄
I'll close my pr 👍🏾
I think this issue can be closed


reset the value to max or min if the current value is > max or < min

We encountered an issue with the datepicker: if the user scrolls month and day of the month at the same time, it is possible to set the value of the datepicker outside the boundary of the min-max. In this case the whole datepicker becomes greyed out and unusable.
I added componentDidUpdate lifecycle hook that checks if the state.value is within min-max. If it is <min, set the value to min. If it >max, set the value to max.

Coverage increased (+0.3%) to 92.727% when pulling 8b44a7d5a23ca8946c7fd2ce4fc281c448c9d19c on magom001:blocking_wheels_bug into 3f6ef0d3c726e462ad38790ea4b5046bc95cf8cd on lanjingling0510:master.

@magom001 why you had modified so much code?

@zengxiaoluan sorry about that: prettier formatted the code

@magom001 I don't see what you've changed =。=. How do you feel about adding a lock? Just let a DatePickerItem scroll.

I added:
componentDidUpdate() {
const value = this.state.value;
const { min, max } = this.props;
if (value.getTime() > max.getTime()) {
this.setState({ value: max });
}
It prevents the value to go outside of the min-max boundary

@magom001 Has been updated to<EMAIL_ADDRESS>


Update external Links Modal

What is the purpose of the change
add checkbox that allows users to opt out of seeing the external links modal. Also update some styles
ClickUp Task
ClickUp Task URL
Brief Changelog
add checkbox that allows users to opt out of seeing the external links modal
Testing and Verifying
This change has been tested locally by rebuilding the website and verified content and links are expected

@MaxMillington text is hiding.

@MaxMillington text is hiding on both windows.

Same to me, I think we can use something like on the link:
    word-break: break-all;

Fixed.

Working fine but if you click on Do not show this again for Margin it will not ask for Perpetuals maybe we should do it separately for both the links.
https://github.com/osmosis-labs/osmosis-frontend/assets/103904125/bc78d9f6-db19-4e4f-a514-99c967a672a7


ISSUE-765: DB based file storage

Currently, we expect users to use HDFS as the FileStorage incase of HA, so that
users uploading jar from one server connection can be seen on another server.
Storing the jars as a blob into DB as a workaround lets us do away with HDFS dependency for HA. This will delegate the replication to the db and if users need HA for stored files, they can have a DB cluster with some kind of a master-master or a master-slave replication.

@HeartSaVioR , @omkreddy , addressed review comments.

Confirmed the following commit addresses all review comments from me.
Still not manually tested though since for now I'm debugging on my own work.
Please take my comment as +1 when anyone verifies the patch via manual test.

@hmcl , thanks for the review, answered the comments and also pushed some changes. If I missed something let me know.

@HeartSaVioR , @omkreddy , @hmcl let me know if you are fine with this patch or you still see any pending issues.
@harshach , QE keeps hitting the FileNotFound exception, so if we can get this merged and set the default to DbFileStorage for HA mode deployments it will help.

@arunmahadevan I am doing one last pass. I should be done soon. Thanks for the patch & for addressing the review comments.

@hmcl , addressed latest comments in ea41943. Will squash after the +1.

@hmcl , renamed the methods and rebased into 3 logical commits.


'and now everything follows' for quot_rem

This still has a sorry regarding finding an integral quaternion near a rational one. Do you want this merged or is it still WIP?

OK I added some hints in the LaTeX and added a new sorried lemma in the Lean.


how to calculate the preprocessing time

How to calculate the time spent on preprocessing. it is 12.4min of s3dis in your paper .

The preprocessing times for the train, val, and test set all appear in the logs (see progress bars) when instantiating a dataset for the first time and preprocessing is triggered.
Otherwise, you can time whatever piece of code you are interested in with:
import torch
from time import time

torch.cuda.synchronize()
start = time()

# stuff happens...

torch.cuda.synchronize()
end = time()

print(end - start)


📃: BudgetBuddy

:red_circle: Title : BudgetBuddy
:red_circle: Aim : To help users manage their finances by tracking income, expenses, and creating budgets.
:red_circle: Tech Stack Used :
AngularJS
Node.js
Express.js
MySQL
HTML5
CSS3
Chart.js
Screenshots 📷

:white_check_mark: To be Mentioned while taking the issue :

Full name :
What is your participant role? (Mention the Open Source Program name. Eg. GSSOC, SSOC, JWOC, etc.)

Happy Contributing 🚀
All the best. Enjoy your open source journey ahead. 😎

@arunimaChintu assign this to me , i  would like to work on this

@Avdhesh-Varshney its my first time raising a pr, pls review it, I guess there were some extra files but they wont cause any issue. Please review and merge , i am really trying to get hacktober badge.
Thank you, looking forward for more assigns.


ability to store Blobs (etc.) nested within other objects

I'm working on integrating localForage into wq.app and overall have found it quite useful.  I'm using the blob storage capability to enable users to take photos with their phones offline, and store them in an "outbox" until they are able to connect.  For this to work, I'd like the ability to store nested records of the form:
{
    "id": 123,
    "date": "2015-05-24",
    "photo": {
        "type": "image/jpeg",
        "name": "IMAG0001.jpg",
        "body": Blob(type="image/jpeg", size=20104)
    }
}

This works fine on the IndexedDB driver, but for the serializing drivers the full Blob is not saved unless it is the top level object.
I was able to work around this in wq/store.js by making a setItem() wrapper that recursively extracts all blobs from an object into separate keys (and then puts them back in place during getItem() so the user never knows the difference).  Would a variation on this algorithm be appropriate for inclusion in the localForage serializer?

I would say this code would be welcome; it allows users to store blobs are part of any object easily. My only concern is performance--doesn't this mean we need to deep scan every Object to check for blobs on set and get even in IndexedDB (which we didn't before).
If the performance hit isn't huge it's worth it though.

tofumatt

On Mon, May 25, 2015 at 1:45 AM, S. Andrew Sheppard
<EMAIL_ADDRESS>wrote:

I'm working on integrating localForage into wq.app and overall have found it quite useful.  I'm using the blob storage capability to enable users to take photos with their phones offline, and store them in an "outbox" until they are able to connect.  For this to work, I'd like the ability to store nested records of the form:
{
    "id": 123,
    "date": "2015-05-24",
    "photo": {
        "type": "image/jpeg",
        "name": "IMAG0001.jpg",
        "body": Blob(type="image/jpeg", size=20104)
    }
}

This works fine on the IndexedDB driver, but for the serializing drivers the full Blob is not saved unless it is the top level object.
I was able to work around this in wq/store.js by making a setItem() wrapper that recursively extracts all blobs from an object into separate keys (and then puts them back in place during getItem() so the user never knows the difference).  Would a variation on this algorithm be appropriate for inclusion in the localForage serializer?
Reply to this email directly or view it on GitHub:
https://github.com/mozilla/localForage/issues/380

Ok, I'll think a bit more about how this would work and see if I can put something together.  I see two potential approaches:

Handle in the serializer (convert to/from base64 in-place)
Handle outside of the serializer (offload to separate keys in whatever driver)

What I've implemented in wq/store.js is more like the second option.  It's automatically disabled for IndexedDB unless the user explicitly requests blob extraction.
Option 1 is cleaner and is what I initially had in mind as an ideal solution.  The main benefit of option 2 is that you could provide hooks like this that the user could override to store blobs somewhere else (e.g. the filesystem).  It sounds like you've already been thinking about something like this for large files (#69).
Either approach will require a deep scan during setItem() (though I leave flags at each level to speed up the getItem() search).  That said, this functionality wouldn't necessarily have to be used for the IndexedDB driver (though #241 suggests it may be needed).  What would your threshold be for performance and how would you measure it?

I guess it's more of a gut feeling regarding performance; we don't even have real perf tests right now so if I had to just come up with numbers: no more than a 5-10% slowdown would be good. If that number seems crazy someone please correct me :-)
Provided option two gives the user hooks without requiring configuration (I'm very adamant that localforage is a "configuration optional" library for all features) it might be more flexible and thus preferred.
And since you already have an implementation of option two I'd go with that.
Thanks! This sounds cool!

tofumatt

On Mon, May 25, 2015 at 3:38 PM, S. Andrew Sheppard
<EMAIL_ADDRESS>wrote:

Ok, I'll think a bit more about how this would work and see if I can put something together.  I see two potential approaches:

Handle in the serializer (convert to/from base64 in-place)
Handle outside of the serializer (offload to separate keys in whatever driver)
What I've implemented in wq/store.js is more like the second option.  It's automatically disabled for IndexedDB unless the user explicitly requests blob extraction.
Option 1 is cleaner and is what I initially had in mind as an ideal solution.  The main benefit of option 2 is that you could provide hooks like this that the user could override to store blobs somewhere else (e.g. the filesystem).  It sounds like you've already been thinking about something like this for large files (#69).
Either approach will require a deep scan during setItem() (though I leave flags at each level to speed up the getItem() search).  That said, this functionality wouldn't necessarily have to be used for the IndexedDB driver (though #241 suggests it may be needed).  What would your threshold be for performance and how would you measure it?

Reply to this email directly or view it on GitHub:
https://github.com/mozilla/localForage/issues/380#issuecomment-105245023

Any news about this? :)

Unfortunately no, I think to do it would be a fair bit of work... it might even be better as an extension to localforage because it could also be slow, requiring checking each nested object’s value before saving.

Matthew Riley MacPherson
tofumatt.com

On 13 Nov 2017, at 11:24, Raul Tomescu<EMAIL_ADDRESS>wrote:
Any news about this? :)
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub, or mute the thread.


fix(migrations) fix migrations related error messages; migrations up -f fix; migrations finish -f addition

Summary
This PR is meant to fix issues reported here:
https://discuss.konghq.com/t/automating-database-migration-for-a-cd-pipeline/2920
Schema state checking is improved on:

kong migrations list
kong start
and kong's init

This PR now also includes two extra commits:

fix(migrations) migrations up with -f will also run the executed teardowns
feat(migrations) migrations finish with -f will also run the executed migrations

Manually merged!


Add rudimentary search to pub.dartlang.org.

Until we have a real search interface built that uses pub.dartlang.org itself to do the search, a simple option is to just lean on Google search for this. We could slap a search box on the site that hits Google for the results and displays them back.

This issue has been moved to dart-lang/pub#372.


Not retrieving tweets anymore

I ran the same code yesterday and it still worked and today the code is retrieving no tweets anymore. Did twitter change their flow or anything or is anyone experiencing the same problem?

Yikes I was just about to install this ... maybe it's a coincidence, but the paper that cites this tool, and directed me here, was published only a couple of days ago?
https://www.jmir.org/2017/8/e289/#box1

I think Twitter bounces you if you make to many requests using this tool. Switching to another IP gets everything working again for me

I ran into the same problem. It works if I take my computer to another network location, but not if I return to my normal IP.

Any tips on using the proxy server within the API, @hardiksondagar?

@bmjr Twitter has banned these common proxy lists.

Does anyone know how long Twitter blacklists for? I've been unable to use this on any network since being blacklisted...


text detection using yolact, icdar 2015?

@dbolya Can yolact be trained to detect text-lines like icdar2015

If you can convert the text-line annotations into masks, then yeah. And I think youlact would be pretty good at that, considering the amount of contrast in text vs its background.


Copy custom extension flags in a call to SSL_set_SSL_CTX()

The function SSL_set_SSL_CTX() can be used to swap the SSL_CTX used for
a connection as part of an SNI callback. One result of this is that the
s->cert structure is replaced. However this structure contains information
about any custom extensions that have been loaded. In particular flags are
set indicating whether a particular extension has been received in the
ClientHello. By replacing the s->cert structure we lose the custom
extension flag values, and it appears as if a client has not sent those
extensions.
SSL_set_SSL_CTX() should copy any flags for custom extensions that appear
in both the old and the new cert structure.
Fixes #2180
This version is for master. Versions for 1.1.0 and 1.0.2 coming up.

Checklist

[ ] documentation is added or updated
[x] tests are added or updated

Also see #3426 for the 1.1.0 version and #3427 for the 1.0.2 version.

Updated commit pushed addressing review feedback. Similar commits made and pushed to #3426 and #3427.

Pushed. Thanks.


parameter conditionally required by another parameter

Is there a way of defining that a request parameter is conditionally required when another parameter is used? In other words, a way of defining dependency between parameters?

from an answer on stackoverflow I found out that there is already an issue that addresses this concern. #256


Incorrect src path on asset @pic  tag

[X] I tried updating to the latest version.

[ ] I can't, there is an issue.

[ ] I Am on Windows

[ ] I Am on Bash on Windows

[X] I Am on Linux

[ ] I Am on OS X

Description
Path is missing a / for the picture > img element on asset @pic.
Steps
{% asset 'image.png' @pic
        srcset:max-width=400
        srcset:max-width=200
%}

Output
<picture>
<source srcset="/assets/400.png 400w" media="(max-width: 400px)">
<source srcset="/assets/200.png 200w" media="(max-width: 200px)">

</picture>

Expected
<picture>
<source srcset="/assets/400.png 400w" media="(max-width: 400px)">
<source srcset="/assets/200.png 200w" media="(max-width: 200px)">

</picture>

Can you please provide more information or a repository that can be shimmed to replicate this issue. While checking this issue it does seem that we do provide the proper path: https://github.com/envygeeks/jekyll-assets/blob/master/lib/jekyll/assets/plugins/html/pic.rb#L39

Thanks!

This, is still a bug, depending on circumstances when proxies are ran we will return the wrong path on a second run, this is because we cache incorrectly.  We should be wrapping the entire logic, and catching a path, based on a digest of the arguments, this way we can determine if proxies have ran, and then get the path of the result without having to run everything again.
That said, this is about to be fixed again

Oh it look like this was about pics, not proxies.  I cannot read.


Write automated tests: Android Basics with Compose

Run the instrumentation test failed both on my local code as well as the solution code.

Picture is screenshot of the solution code that failed.


v0.30.1 release note draft

Release Note
This release contains 5 new features,8 bug fixes and 10 Documentation improvements.
🆕 Features
Add len into docindex (#1454)
you can now do  len(vector_index) which is equivalent to vector_index.num_docs()
🐞 Bug Fixes
Point to older versions when importing Document or Documentarray (#1422)
Trying to load Document or DocumentArray from docarray will raise a error saying that you need to downgrade your version of docarray if you want to use this two objects.
fix AnyDoc from_protobuf #1437)
AnyDoc can now read any BaseDoc protobuf file. The same apply to DocList.
other bug fixes

fix: add  logs to elasticsearch index  (#1427)
Fixes a bug in Document Index where torch tensors that require grad were not able to be converted to np array (#1429)
Fix a bug with HNSW  (#1426)
Hubble Binary format version bump (#1414)
Save index during creation for hnswlib (#1424)

📗 Documentation Improvements

Fix fastapi docs (#1453)
Fix typos (#1436)
Index predefined Documents (#1434)
Proofread (#1423)
Basic fixes (#1418)
Clean up data types section (#1412)
Consistent wording (#1419)
Fix issues (#1417)
Fix readme.md (#1411)
Remove duplicate api reference section (#1408)
Docindex URLs (#1433)
Fix Install commands hint (#1421)
Add google analytics (#1432)
Add install instructions for hnswlib and elastic doc index (#1431)

🤟 Contributors
We would like to thank all contributors to this release:

Alex Cureton-Griffiths (@alexcg1)
samsja (@samsja)
Johannes Messner (@JohannesMessner)
Anne Yang (@AnneYang720)
Scott Martens (@scott-martens)
カレン (@RStar2022)
Aman Agarwal (@agaraman0)
Yanlong Wang (@nomagick)
Charlotte Gerhaher (@anna-charlotte)

@alexcg1 can u take a look ?

Done from my end @samsja


You have 3 'p's in upper in the documentation, meaning the samples error when used

For example, you have:
models: # or seeds:
  - name: my_model
    tests:
    - dbt_expectations.expect_table_columns_to_not_contain_set:
        column_list: ["col_a", "col_b"]
        transform: uppper # (Optional)

when really it should be:
models: # or seeds:
  - name: my_model
    tests:
    - dbt_expectations.expect_table_columns_to_not_contain_set:
        column_list: ["col_a", "col_b"]
        transform: upper # (Optional)

(Notice uppper vs upper)

Thanks for flagging that typo, we'll get that fixed.


ng build error: Cannot find name 'HammerManager'

Bug, feature request, or proposal:
ERROR in [default] c:\test-app\node_modules@angular2-material\core\gestures\MdGestureConfig.d.ts:4:39
ng build error: Cannot find name 'HammerManager'
What are the steps to reproduce?

create new project using angular-cli@webpack
npm install latest material components
modify app.module.ts:

`import { MdCoreModule } from '@angular2-material/core';
@NgModule({
declarations: [
AppComponent
],
imports: [
// Angular 2
BrowserModule,
CommonModule,
FormsModule,
HttpModule,
// Material Design
MdCoreModule,
],
providers: [],
entryComponents: [AppComponent],
bootstrap: [AppComponent]
})
export class AppModule {
}`
4 ng build
Which versions of Angular, Material, OS, browsers are affected?
angular rc5, material 7.2, angular-cli@webpack

@RedFour I am not sure you should actually load MdCoreModule  module, check getting started on how to load modules of a specific components. If you want to use md-slide-toggle or md-slider you need to make sure you are loading HammerJS as it's described [here].(https://github.com/angular/material2/blob/master/GETTING_STARTED.md#additional-setup-for-md-slide-toggle-and-md-slider)

I find that, with<EMAIL_ADDRESS>I get the following error (with multiple components)
EXCEPTION: Error in ./MdSlideToggle class MdSlideToggle - inline template:0:783
ORIGINAL EXCEPTION: Hammer.js is not loaded, can not bind slidestart event

@m0t0r you are right I don't need to import MdCoreModule. Thank you!


Enable an admin to edit meeting details...

Recently, we had a situation where the wrong PR was linked to the meeting invite. As an API Steward, I went in a fixed this. However, I could not change the meeting invite.
As an admin, I should be able to manage all aspects of the meeting, e.g.

edit any meeting details. Updating this should cause the calendar invite to refresh.
add/remove attendees.
change time/date
etc...

@markweitzel
Currently the fields that admin can't modify are:

Service Name
Sub service name
PR issue (will be enabled with issue https://github.com/Azure/azure-sdk-tools/issues/3869)
Github issue

Do you want these to be editable for only admins?


Draft of an update to the Table widget to allow for selection.

Hello!  I needed a selectable table for a project, and saw this issue.  The code same referenced in that issue no longer works with the latest versions of egui, so I modified the Table instead.  It definitely needs work!  But before going too far down the path, I thought I would at least float the basics since I'm still getting my feet wet in egui.
There are definitely some oddities and it feels unnatural.  For example, in the calling code, you need to know if the row is selected or not when adding the widget:
           .body(|mut body| {
                for row_index in 0..self.things.len() {
                    let selected_row = if let Some(index) = self.selected {
                        index == row_index
                    } else {
                        false
                    };
                    body.row_with_selection(text_height, selected_row, |mut row| {
                        let selected = row.selected();
                        if row
                            .col(|ui| {
                                if selected {
                                    ui.strong(row_index.to_string());
                                } else {
                                    ui.label(row_index.to_string());
                                }
                            })
                            .clicked()
                        {
                            self.selected = Some(row_index);
                        };
                        if row
                            .col(|ui| {
                                if selected {
                                    ui.strong(self.things.len().to_string());
                                } else {
                                    ui.label(self.things.len().to_string());
                                }
                            })
                            .clicked()
                        {
                            self.selected = Some(row_index);
                        };
                        if row
                            .col(|ui| {
                                if selected {
                                    ui.strong(&self.things[row_index]);
                                } else {
                                    ui.label(&self.things[row_index]);
                                }
                            })
                            .clicked()
                        {
                            self.selected = Some(row_index);
                        }
                    });
                }
            })

This seems both repetitive and verbose.  I guess it allows you to decide which part of the row you are using to determine clicks?  Not sure what a cleaner way to do this would be, but I'm happy to keep working on it if you think it's worth pursuing.
Closes https://github.com/emilk/egui/issues/2000.
demo.webm

One consideration is that "selected" in egui currently seems to imply a text field.  So it make make sense to specialize Table into e.g., SelectableTable with an additional requirement that the entries in the table impl Into<WidgetText> or whatever.

Hi do you know if this is still working ? Thanks !

Im really interested in this feature


Parametername for DeleteTimeEntryAsync not correct.

It should be
public Task DeleteTimeEntryAsync(string workspaceId, string timeEntryId)

Right, my bad. Will fix soon!


field names somewhat counter to convention

In RegularLattice, these are some of the fields:
    """
    The number of basis cells along each of the basis directions.
    """
    lattice_dims::NTuple{D, Int}
    """
    Coordinates of the basis vectors of the underlying Bravais lattice. `basis[:, i]` gives the ``i``-th basis vector.
    """
    basis::SMatrix{D,D, T}
    """
    Unit cell of the lattice.
    """
    unit_cell::CT

And here is the relevant bit of signature of the constructor:
    #Arguments
    - `lattice_dims::NTuple{D,Int}`: specifies the number of unit cells along each of the basis directions.
    - `basis::SMatrix{D,D,T}`: stores as columns the basis vectors of the underlying Bravais lattice.
    - `unit_cell::AbstractCell{D,T}`: specifies the unit cell of the lattice; if the unit cell does not have any special structure, an instance of `TrivialCell` should be used.
    """

However, some of this terminology is a bit counter to convention (see e.g. this). In particular, in crystallography, we think of a crystal as being composed of a (Bravais) lattice (which we can specify purely by the three primitive cell translation vectors) and a basis, i.e. which atoms occupy a single unit cell and where.
To "fully" resolve this, the package and types would need to refer to crystals rather than lattice, but I don't personally think such a dramatic change is necessary. Since there are people other than crystallographers that use lattices, I don't think it's reasonable to ask that the terminology of this package be fully consistent with crystallographic terminology. But it would probably be nice if it were not directly counter to it. 😉
My suggestion would be to remame basis to something like primtive_cell. This is also nice because it distinguishes from what I think of as a "supercell" (repeating tiling of primitive cell), and you specify as lattice_dims. As far as what to call unit_cell, it's perhaps too confusing to suggest the crystallographic term of basis, but I also don't have any other great ideas right now...

I think it is ok to leave unit_cell as it is, because I think sometimes crystallographic basis is referred to as such. Also, I don't want to change the names of Cell types.
With basis, I would call it primitive_vecs or something like that (primitive_cell introduces element of confusion if we have unit_cell refer to crystallographic basis)
Finally, lattice_dims can be renamed to supercell_dims.

What do you think about that?

Sounds like an improvement to me!

IMO "basis" should never be used for what is also called "motif",
since in linear-algebra terms
the set of primitive translation vectors do form a basis of the direct space,
and a basis of the lattice (with integer coordinates).
So I'd rather support keeping
    """
    Coordinates of the basis vectors of the underlying Bravais lattice.
    `basis[:, i]` gives the ``i``-th basis vector.
    """
    basis::SMatrix{D,D, T}


Preparing 3.4 release notes

Description
☝
Issues Resolved
N/A
Check List

~[ ] New functionality includes tests~
~[ ] All tests pass~
[x] RELEASE_NOTES.md has been updated if required (not required for bugfixes, required for API changes)
[x] All commits have been signed-off for the Developer Certificate of Origin. See https://github.com/chef/chef/blob/master/CONTRIBUTING.md#developer-certification-of-origin-dco

Fauxhai
Fauxhai has been updated from 6.6.0 to version 6.9.1. This update brings in the latest mocked Ohai run data for use with ChefSpec. This release adds data for Linux Mint 19, macOS 10.14, Solaris 5.11 (11.4 release), and SLES 15. This release also deprecates the following platforms for removal April 2018: Linux Mint 18.2, Gentoo 4.9.6, All versions of ios_xr, All versions of omnios, All versions of nexus, macOS 10.10, and Solaris 5.10. See https://github.com/chefspec/fauxhai/tree/master/lib/fauxhai/platforms for a complete list of non-deprecated platform data for use with ChefSpec.
Foodcritic 14.3
Foodcritic has been updated from 14.1 to 14.3. This updates the metadata that ships with Foodcritic to provide the latest Chef 13.11 and 14.5 metadata, while removing metadata from older Chef releases. This update also removes the FC121 rule, which was causing confusion with community cookbook authors. This rule will be added back when Chef 13 goes EOL in April 2019.
kitchen-azurerm
The Kitchen AzureRM driver now supports the Shared Image Gallery.
Kitchen-DigitalOcean
The Kitchen DigitalOcean driver now supports FreeBSD 10.4 and 11.2 in Kitchen configs.
Kitchen Google
The Kitchen Google driver now supports using instance labels to label your GCE instances from the Kitchen config.
Knife Windows
Knife Windows has improved Windows detection support to identify Windows 2012r2, 2016, and 10. Additionally when bootstrapping nodes, there is now support for using the client.d directories.


Trace timeline seems wrong

A page in a Razor Web app calls different endpoints of the same API.
The trace timeline seems wrong.

My bad. I was into the flow and the wrongness seemed clear to me.
This is the OnGetAsync method of the razor web app
    public async Task<ActionResult> OnGetAsync(CancellationToken cancellationToken)
    {
        var provider = await adminApi.Http.GetFromJsonAsync<Something>($"endpoint1", cancellationToken);

        if (provider is null)
        {
            return NotFound();
        }

        Provider = provider;

        Courses = await adminApi.Http.GetFromJsonAsync<Something2[]>($"endpoint2", cancellationToken);

        Sites = await adminApi.Http.GetFromJsonAsync<Something3[]>($"endpoint3", cancellationToken);

        Users = await adminApi.Http.GetFromJsonAsync<Something4[]>($"endpoint4", cancellationToken);

        return Page();
    }

Given this snippet, I had the assumption that the trace timeline had the following characteristics:

The first span, representing the whole request, should be the first to start and the last to end
The second and third spans should be nested within the first span, sometimes after its start. The third span should start after the start of the second and end before its end.
The fourth and fifth span, should start after the end of the second span and similarly to the previous two spans, the fifth should be nested within the fourth,
finally, sixth and seventh span should start after the end of the fifth and behave like the other two.

Here is my wonderful ASCII representation.
1st xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx
2nd      xxxxxxxxxxxx
3rd           xxxxxxxx
4th                                 xxxxxxxxxxxxxxxx
5th                                      xxxxxxxxxx
6th                                                                   xxxxxxxxxxxxxxxxx
7th                                                                       xxxxxxxxxxx

I hope this is clearer.

cc @JamesNK

Edit: The first request does look strange.

To me also the right part of the time diagram (the bars). the name column looks correct.

@JamesNK  thoughts?

I agree it's odd.
One possibility: You can have a situation where the root span for a trace isn't available yet, which means results can be unexpected.
For example:

The server receives a HTTP request and starts a trace and a span.
The server makes HTTP calls to other servers that creates new spans in the trace.
The HTTP calls complete, the HTTP call spans complete, and they're sent via OTLP.
The first HTTP request completes, and its span is sent via OTLP.

After 3, but before 4, there are child spans in the trace without a root span.
However, I don't think that is the issue because the first two HTTP call spans are nested under the providers/{providerId:guid} span.
Another possibility is different apps have different clocks, but I don't think that is the issue because the providers/{providerId:guid} span and HTTP call spans are from the same app.
TLDR; I don't know. I'd be interested if there is a reproduction that I could look at.

I was hoping to get out a full representation of the whole trace but couldn't find how. (maybe a feature?)
Anyway, clicking on each row of the name column I got the following information (which confirms my hypothesis that the timeline graph is wrong)

#
Name
Service
Duration
Start time

1
providers/{providerId:guid}
admin
18,35ms
0μs

2
HTTP GET
admin
4ms
1,76ms

3
/providers/f0bc5c95-2d24-45fe-8d7e-9ca5bb724f57
api
3,55ms
2,12ms

4
HTTP GET
admin
3,07ms
6,41ms

5
/providers/f0bc5c95-2d24-45fe-8d7e-9ca5bb724f57/courses
api
2,64ms
6,73ms

6
HTTP GET
admin
3,1ms
10,08ms

7
/providers/f0bc5c95-2d24-45fe-8d7e-9ca5bb724f57/sites
api
2,78ms
10,33ms

8
HTTP GET
admin
3,31ms
13,63ms

9
/providers/f0bc5c95-2d24-45fe-8d7e-9ca5bb724f57/users
api
2,95ms
13,89ms

This is the timeline I got passing this data to GPT 4

@JamesNK @danmoseley @davidfowl
Is there anything else other than a repro repo I can provide to help triage the issue?

I tried to reproduce this based on your description and got the result you expected:

Here's my Razor Page's model class:
public class IndexModel(ILogger<IndexModel> logger, AdminApiClient adminApi) : PageModel
{
    private string? provider = "something";

    public int Something { get; set; }
    public int Something2s { get; set; }
    public int Something3s { get; set; }
    public int Something4s { get; set; }

    public async Task OnGetAsync()
    {
        var something = await adminApi.GetApi1();

        if (provider is null)
        {
            return;
        }

        Something = something;

        Something2s = await adminApi.GetApi2();

        Something3s = await adminApi.GetApi3();

        Something4s = await adminApi.GetApi4();
    }
}

And the apis:
app.MapGet("/api1", async () =>
{
    await Task.Delay(100);
    return 1;
});

app.MapGet("/api2", async () =>
{
    await Task.Delay(100);
    return 2;
});

app.MapGet("/api3", async () =>
{
    await Task.Delay(100);
    return 3;
});

app.MapGet("/api4", async () =>
{
    await Task.Delay(100);
    return 4;
});

At this point I think we'd need a repro repo.

I'll put something together!

@DamianEdwards could you share your repro?
I tried running a "dotnet new aspire-starter" application and I got this timeline. See the first line.

repro:
$ md Aspire2
$ cd Aspire2
$ dotnet new aspire-starter
$ dotnet run --project .\Aspire2.AppHost\

https://github.com/DamianEdwards/AspireIssue841Repro

You might be onto something. This is what I got when I ran your repro fresh of checkout

I note that your culture is using , for thousands separators.

I think you mean digital separator.

I'm guessing the problem is here: https://github.com/dotnet/aspire/blob/eceed4d2bd168d5a969d90dd5608e213edd345d2/src/Aspire.Dashboard/Components/Pages/TraceDetail.razor#L95
The ToStrings should use invariant culture.
The long-term solution is making sure code analysis is enabled (or maybe it is but doesn't run on Razor pages? IDK).

@kvenkatrajan would be good to get this one fixed in preview 2


Multiple hosts section removal

The Multiple Hosts section was removed in https://github.com/drduh/YubiKey-Guide/commit/d6848d544037bac5726a958d4425325a248e4e67, which was merged from https://github.com/drduh/YubiKey-Guide/pull/417. Neither the commit removing the section or the merge request in which it was included have any text explaining the rationale for which it was removed, which is terrible practice in a living guide such as this.
As someone who's relied on this guide for guidance in the past, coming back to find a section that describes something you were using missing, with no explanation, I'm left wondering whether it was removed because it was unsafe and I should do a security assessment, because it was bad practice, or because the author personally disliked it.
In the future, can we document these changes somewhere? Even if not on any kind of "changelog", explaining the reason why a change such as this was made in the commit that introduces that change would inspire a lot more trust.

Nevermind, I should get some sleep 😅 Found the new "multiple computers" section in "Notes".

Sorry about that @laurazard - I also hate it when changes are made without details.
The guide got a big overhaul recently and some stuff got shifted around to reduce steps and time. Let me know if anything else was missed! We will also continue posting any known or discovered security issues at the top of the guide for a relevant amount of time.

Hello, one item was missed. When "Multiple Hosts" was renamed, not only should this page in the Yubico docs have the below section updated to mention to look at the Notes section here, but also the link should be updated to point to the Notes section.

Using your YubiKey's OpenPGP function on multiple computers
In order to use the OpenPGP private keys stored on your YubiKey on computers apart from the one where they were generated, it is necessary to import the corresponding public keys. Please see this guide (under the section Multiple Hosts) for more information.

I'm not sure if you have any sway with Yubico, but since they are linking to your content, I figured you might want to reach out and let them know of the issue.


databricks - finding uploaded data

Module: 00
Lab/Demo: 23 VM lab 18
Task: 00
Step: 00
Description of issue
users having difficulty finding uploaded data  - make it a little more general and have them enable the DBFS file store in the admin settings console.
solution:
If you have uploaded the data but cannot find it in the data.
Note:  Data must be uploaded already
Any errors you face afterwards:

enable DBFS file store in your admin console

then refresh and return to your notebook

Find your file using the DBFS explore -> right click and copy the file path
Note: you may have to do a bit of digging based on where you uploaded your data but it should be there. Otherwise, you can always add it again.
REPLACE THE FOLLOWING CODE
filepath = #INSERT YOUR FILEPATH
df1 = spark.read.format("csv").option("header", "true").load(filepath)

Please note: this is not a bug. We can't account for user error or not remembering where they uploaded their file(s) to. The MCT/MTT should be guiding the learners on the caveats of copying and remembering where they may have placed a file.

The file does not show up for them as dbfs doesn't show them where they can access the txt file.

From: James Herring @.>
Sent: Wednesday, June 28, 2023 5:24 PM
To: MicrosoftLearning/dp-203-azure-data-engineer @.>
Cc: Victoria Eshelby @.>; Author @.>
Subject: Re: [MicrosoftLearning/dp-203-azure-data-engineer] databricks - finding uploaded data (Issue #47)
Please note: this is not a bug. We can't account for user error or not remembering where they uploaded their file(s) to. The MCT/MTT should be guiding the learners on the caveats of copying and remembering where they may have placed a file.
—
Reply to this email directly, view it on GitHubhttps://github.com/MicrosoftLearning/dp-203-azure-data-engineer/issues/47#issuecomment-1611644246, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AY7ZEEIAR5GUOIS7YXWMCFDXNREBJANCNFSM6AAAAAAZXI5OIY.
You are receiving this because you authored the thread.Message ID: @.***>

Re-opened - looks like a chane to Databricks.

I went through this twice and intentionally didn't copy the code as directed by the directions to 'lose' where it might be located. The best fix is to take a step back and start with the File..Upload data to DBFS... step again to correct versus going through the process outlined above. There is no bug with this lab.


Add documentation for including new Python modules in PATHs to run pipeline

Currently, to use the new RED module, we need to install it's required modules for our local python.

do we have a better solution as we add more modules?
can we add some documentation to the repo?

I think the readme would be the perfect place. People should use the requirements.txt file with pip as I don't think poetry is set up in this repo

I was going to ask at the next meeting:
Are we using one or more than one Python virtual environments? If it's just the genebuild one, doesn't it include all packages required by the Repeatmask_Red eHive module? And then we would activate it to run the pipeline with Python modules?
Also, now with our first brand new Python eHive module, how about generating a new Genebuild pipeline virtual environment from scratch and use Poetry to manage dependencies?

@ens-carlos

I think that in the short term it would be better to install the packages required by Repeatmask_Red in the Python environment used by the central software repository, which is the default one used when we set up the annotation pipeline. If we are using local Python environments we should try to stick to just using one or if we use more than one to make them work automatically when we set up and run things so we don't have to manually change environments or set them up every time we start or make progress on any annotation project. Also, whatever way we go forward, we should remove the other options so we don't get Python environments and configs mixed. For example, if we use local Python set ups by default, we should find a way to disable the set up pointing to the central Python by removing it from the system paths, python paths, etc.

First at the moment, the software for the pipeline should all be in the central environment. But with the new cluster coming, I would push to not have python centralised because that mean having 2 pyenv for most people which can cause more problems.
Once we are getting close to having an automated pipeline, we can look to have a shared (central for genebuild) production environment to run the pipelines and dev environments for any other projects.
For the software we create it is easy to enforce only one environment, for software we don't it's not that easy. For example, the current ncRNA pipeline needs specific versions of libraries which means that any other python software we use would need to work with these older versions... One solution is using containers which needs to be created. Some are being created or have already been created.
Nothing stops you from either do symlinks to the central python install or to install the software you need in your own pyenv

I agree with @ens-carlos points that the use of Python virtual environments should be transparent, and not spend time setting up things manually.
I also agree with @thibauthourlier that it's probably for the best to not have a centralized Python installation in the new cluster, it just complicates things.
For now, the best option for running the eHive Python modules is in my view using Genebuild-wide virtual environments that we manage on our own, and simply using symlinks to them to import them to our own pyenv setup. I also propose we create them using Poetry, so we can generate them and update packages deterministically.
The advantages to using Genebuild-wide venvs is that we will not have to think about them, even after occasionally updating their dependencies. We can also include the symlink generation commands in the pipeline setup script, so their use would be completely automatic to us when running a pipeline.
Does that make sense to you?

@ens-carlos, does the current requirements.txt file have all dependencies? I can add it to the central software
I may forget but if people remind me or create a ticket for me I can install any software, no need for having virtualenv everywhere. As long as the Codon stuff is not agreed, I would prefer to keep the current setting and not start something which we will have to ditch in 3 months.


Identify more pools

This is the current list of pools we can identify:
https://github.com/BitMEXResearch/forkmonitor/blob/a15b0302b590094ba61a906295f196983bc931a8/app/models/block.rb#L81-L95

Added more pools in 4da8db40155e3f72d8e5607359027ae6534cc38a


Explain bug and link to support form

Sometimes a document can get into a state whereby its latest
edition is deleted, and the most recent non-deleted edition
is marked as 'superseded'. The result is a 'Go to most
recent edition' button that just refreshes the same page
again and again.
A 'proper fix' needs careful consideration. When an edition
is deleted, should the previous edition itself be changed
from 'superseded', or should it be cloned to retain history
(i.e. a timeline of ['superseded', 'deleted', 'draft'])?
Do we have any way of knowing what the previous edition
state was prior to being 'superseded' (e.g. 'draft' /
'published'), and therefore what it should now be set to?
In the absence of a permanent fix, a pragmatic stop-gap
would be to explain the situation to users and link to a
support form so that they can ask for help if needed. The
extra context should enable us to help them more quickly
too.
This PR arises out of https://trello.com/c/9u5j3uI0/1989-investigate-the-situation-regarding-documents-in-whitehall-where-the-latest-edition-is-somehow-also-superseded
An example of a document in this state is https://whitehall-admin.staging.publishing.service.gov.uk/government/admin/statistical-data-sets/75305
Before:

After:

Possibly superseded by #5630. Will close when we're a little further along.


NuGet and .Net Foundation logos missing from NuGet.org downloads page

Observed on chrome, edge and internet explorer.

Looks like https://docs.nuget.org/images/logo.png is broken.

@ryuyu , this is probably related to the site move.

Deployed fixes to point to local copies of the images.


Nexmo SMS provider is always execute even when phone_number is empty.

@steffjenl
https://github.com/steffjenl/okazanta-legacy/issues/11 Removed Nexmo for now, there is no phone_number input field.


fix: moves find_package calls to common file

This PR moves some calls to find_package into the
GoogleCloudCppCommon.cmake file, because these packages will be changing
location when Spanner moves to -cpp. Moving these into the common file
lets the CMakeLists.txt files in google/cloud/spanner/ compile in this
repo and in -cpp, without modification.

This change is

Sigh... Lemme fix the build breaks and get back to this.

Rebased to pull in a cpp-cmakefiles 0.9.0 (https://github.com/googleapis/google-cloud-cpp-spanner/pull/1489). Trying the builds again.

PTAL, this should work now.

Missed the failures. :-(

Fixed.


Allow metrics filtering based on IQ "stage"

One of the main reasons why we never use the success metrics, is because there is no way to scope/limit the results to a particular (set of) Nexus IQ stage(s).
In our organization we use very different scan patterns for Source/Build/Stage-Release/Release, since the analysis focus of each stage is different. For (Stage-)Release we are only interested in "production" dependencies, whereas in earlier stages we are also interested in test/dev dependencies (for LCM).
So in our case, the "Source" stage is incredibly noisy with vulnerabilities, because it contains just about every library we use for absolutely everything.
For our success metrics, we are primarily interested in our "production" dependencies, but since we cannot filter by stage, the succes metrics always look terrible and can swing wildly over time.
We would very much appreciate a way to filter the "Source" stage reports from our success metrics.

Hi @PayBas - I can certainly see a use case for that, unfortunately that's something that Sonatype Product Management would need to address (this is just an open source tool for viewing the metrics from the IQ product). There's a product improvement idea here which you could vote on, the more votes, the more traction an idea will get.

I would like to support this as well. I'd like the ability to filter by build/release.


Add Primitives for Error calculation, smoothing, and thresholding

I want to add primitives for dynamic error calculation, smoothing, and thresholding.
I will be adding the code for these functions to MLPrimitives as its own python file, to be called MLPrimitives/mlprimitives/dynamic_error_thresholding.py
The implementation is as per Section 3.2 of : https://arxiv.org/pdf/1802.04431.pdf
dynamic_error_thresholding.py software architecture:
It will be a Python class called ErrorThresholder
which is initialized with

y_true (np array): array of test targets corresponding to true values to be predicted at end of each sequence
y_hat (np array): predicted test values for each timestep in y_test
smoothed (bool): If False, return unsmooothed errors (used for assessing quality of predictions)
Some parameters that have default values:
BATCH_SIZE = 70        # number of values to evaluate in each batch
WINDOW_SIZE = 30       # number of trailing batches to use in error calculation
SMOOTHING_PERC = 0.05  # determines window size used in EWMA smoothing (percentage of total values for channel)

Methods:

get_errors(Calculate the difference between predicted telemetry values and actual values, then smooth residuals using ewma to encourage identification of sustained errors/anomalies.)
process_errors(returns a list of anomalies detected from the errors)
other helper methods for these two functions

@itinawi what would be the outputs? For example for the method process_errors?

The output would be a list of lists/tuples indicating the start and end time of anomalous sequences

Closed via #58


[FLOC-4557] Bind mount /dev into the lsblk test container

Fixes:

https://clusterhq.atlassian.net/browse/FLOC-4557
https://github.com/ClusterHQ/flocker/issues/2970

Bind mount /dev into the lsblk test container so that multi-path devices can be examined.
@shay-berman please test this modified version of the acceptance test with your IBM driver.
I dug into the Docker and runc code to understand how /dev gets populated inside the container.
See the comments and links in the patch.

I just planned to push that fix to the project(for my first flocker contribution) but you did that first :-)

@shay-berman great minds think alike :-)
Let me know how your testing goes.
The tests still seem to pass on with the Loopback driver on Centos7, Ubuntu 16.04 and Ubuntu 14.04

http://ci-live.clusterhq.com:8080/job/ClusterHQ-flocker/job/FLOC-4557-dev-mapper-blockdevice-size/job/run_acceptance_loopback_on_AWS_Ubuntu_Trusty_for_flocker.acceptance/1/testReport/flocker.acceptance.endtoend.test_dockerplugin/DockerPluginTests/
http://ci-live.clusterhq.com:8080/job/ClusterHQ-flocker/job/FLOC-4557-dev-mapper-blockdevice-size/job/run_acceptance_loopback_on_AWS_Ubuntu_Xenial_for_flocker.acceptance/1/testReport/flocker.acceptance.endtoend.test_dockerplugin/DockerPluginTests/
http://ci-live.clusterhq.com:8080/job/ClusterHQ-flocker/job/FLOC-4557-dev-mapper-blockdevice-size/job/run_acceptance_loopback_on_AWS_CentOS_7_for_flocker.acceptance/1/testReport/flocker.acceptance.endtoend.test_dockerplugin/DockerPluginTests/

See https://github.com/docker/docker/issues/16160 for more discussion of why /dev inside the container does not have all the devices that are available on the host server.


Issue with oAuth and tokens

So I am trying application like that:
from quickbooks import QuickBooks

clientkey = "xx"
clientsecret = "xx"

client = QuickBooks(
    sandbox=True,
    consumer_key=clientkey,
    consumer_secret=clientsecret,
    callback_url='http://localhost/qbo_token.php'
)

authorize_url = client.get_authorize_url()
request_token = client.request_token
request_token_secret = client.request_token_secret

print(authorize_url,request_token,request_token_secret)

It sends:
('https://appcenter.intuit.com/Connect/Begin?oauth_token=true', u'true', u't6mwhA1AgLFNKjvIOg829Xj6ZycWo2KRKkOtoTre')

Which is a wrong URL.

The authorize_url is where you redirect the user to when authorizing your application. After authorization is complete quickbooks will redirect back to the callback_url.


Added an extension for downloading an entire study

related issue: https://github.com/OHIF/Viewers/issues/2430#issue-907754649

User can trigger the download of a complete study, via toolbar button
User gets detailed status information in a modal view

Individual steps (downloading, zipping, saving)

a pull request for the dicomweb-client client has been issued. With this version the user sees also the progress of the download in terms of downloaded bytes (see https://github.com/dcmjs-org/dicomweb-client/pull/44#issue-676285054).

[x] Brief description of changes
[x] Links to any relevant issues
[x] Required status checks are passing
[x] User cases if changes impact the user's experience
[ ] @mention a maintainer to request a review

Hey @Christian-e-S, great job here :) 🎖
So, I just quickly tested the feature and it seems to be working fine. We have some of this logic in another extension (debugging) but I think it its currently broken, maybe we are better off accepting this separate extension and dumping the old download logic from debugging (what do you think @swederik?)
I have some comments regarding the modal though:

When clicking to open the modal, it downloads right away but I think we should add a 'download' button there to avoid clicking the button in the toolbar by mistake and starting a huge downloading request in the background
The size was not updated after downloading
There's no visible loading indicator, I thought it was stuck with a blank status: ...
You can leverage the notification service to display notifications e.g. 'Study downloaded successfully' or something

Extras

What about adding options in the modal to download display set (series) based or instance-based (we can tackle this in another branch)
Another extra case that is really not important right now (just thought about it): Adding an option to disable and enable a save button in the viewport overlay so users can download the active viewport

Hey @igoroctaviano!
Thank you very much for your review!
Please find my comment below:

Hey @Christian-e-S, great job here :) 🎖
So, I just quickly tested the feature and it seems to be working fine. We have some of this logic in another extension (debugging) but I think it its currently broken, maybe we are better off accepting this separate extension and dumping the old download logic from debugging (what do you think @swederik?)
I have some comments regarding the modal though:

I think toolbar button should not be enabled in master by default (@pieper @swederik do we have liability concerns?)

I agree, this makes absolutely sense!

When clicking to open the modal, it downloads right away but I think we should add a 'download' button there to avoid clicking the button in the toolbar by mistake and starting a huge downloading request in the background

We had it like this, but users complained about the additional click. In some use cases, users use the online viewer just for previewing images, and then download the series to be able to use the specific features of the tool that they are used to, so downloading becomes their major use case and they want to have it efficient.

The size was not updated after downloading

This works only with a recent commit of the dicomweb-client https://github.com/dcmjs-org/dicomweb-client/commit/c292726a421cd84e6a34aec4e72fbbad3c87621c that was created from my pull request to the dicomweb-client repository. This is required to get progress information in terms of bytes downloaded.
Should we wait until this gets into the next release of dicomweb-client?

There's no visible loading indicator, I thought it was stuck with a blank status: ...

See comment above. With the latest master branch of the dicomweb-client you can see the transferred bytes progressing, during the download, which gives a good indication:

You can leverage the notification service to display notifications e.g. 'Study downloaded successfully' or something

Agreed

Extras

What about adding options in the modal to download display set (series) based or instance-based (we can tackle this in another branch)
Another extra case that is really not important right now (just thought about it): Adding an option to disable and enable a save button in the viewport overlay so users can download the active viewport

I like these ideas.

@igoroctaviano what is the status on this?

@sedghi codewise LGTM but we need to check if we want to merge it (I know that there are some implications to having an easy download button in a viewer).

@Christian-e-S , do you have this extension to v3? rgds and great job.

Did you ever try this with v3? If so, how did you go about it? I don't even know how to get started with adding the extension.

@threehappypenguins No we haven't done it in v3

I'm closing this as not planned because it's related to v2-legacy. Keeping it open might suggest we support fixing issues in v2-legacy. If this problem persists in v3, please open an issue or, even better, provide a fix for v3.


Confusing error message for sample_code_init_fields

What
If a sample_code_init_field for a repeated field is missing the index, the validator produces a confusing error message.
For example,
- time_series[0].points.interval.end_time.seconds=1489504140
                 ^^^^^^
    should be points[0]

results in java.lang.IllegalArgumentException: Could not assign value 'interval' to type uint64, which is confusing: there is no value called "interval" in this configuration, and it's unclear what relevance "unit64" has to this config.
Expected behavior
java.lang.IllegalArgumentException: Repeated field 'points' is missing an index. Did you mean points[0]?

@geigerj Can you add a priority to this?

Obsolete.


SyntaxError: Unexpected number

C:\Users\'user'\Desktop\PossumBot-master>node Startbot.bat
C:\Users\'user'\Desktop\PossumBot-master\Startbot.bat:1
WScript.Sleep 3000
              ^^^^

SyntaxError: Unexpected number
←[90m    at wrapSafe (internal/modules/cjs/loader.js:1001:16)←[39m
←[90m    at Module._compile (internal/modules/cjs/loader.js:1049:27)←[39m
←[90m    at Object.Module._extensions..js (internal/modules/cjs/loader.js:1114:10)←[39m
←[90m    at Module.load (internal/modules/cjs/loader.js:950:32)←[39m
←[90m    at Function.Module._load (internal/modules/cjs/loader.js:790:12)←[39m
←[90m    at Function.executeUserEntryPoint [as runMain] (internal/modules/run_main.js:76:12)←[39m
←[90m    at internal/main/run_main_module.js:17:47←[39m

I can't resolve it by myself. Can you help me ?

It was just because I've changed the prefix for the commands.


Checklist for 5.4.0 (draft)

Implementations

[ ] Excalibur and Magical Amplification change into а toggle ability. (#184)
[ ] max heal for hero (#184)
[x] Fix Killing Intent (#184)
[x] Rework Supermassive (#184)
[ ] Additional diaglogue (#146)

[ ] Add additional dialogue option with statue in Nenio questline.

Add some polymorph abilities as special powers.
[x] Fix number of challenges per day for cavalier legacies.

Pre-Release Tasks

[ ] Update LocalizationPack.json
[ ] Update CHANGELOG.md
[ ] Update README.md
[x] Update Info.json
[x] Update Repository.json

Post-Release Tasks

Update mod description
Update mod version
New screenshots
Release description

Hi! I have a request for you.
Can you please add the polymorph abilities and dialogs in the next patch, and not in this one, in order to release it faster? I will also try to translate it as quickly as possible.
BG3 is coming out soon and I be very happy to play again the Pathfinder before that with your mod.
I understand that fashion development is a complicated matter, and I'm sincerely sorry that I'm rushing you. But I'm just afraid that I don't have time to play Pathfinder with your mod again before the release of BG3.

Of course.
I've been more busy than usual, but I'll try to finish this update as soon as I can.


create excel if not exists

#9 create excel if not exists: Solved

Good job!! @AshwinaRakish

!bounty 5


Grammatical and typo tweaks

Note the comments I put against qobuz to confirm the use of the wording of favourites or library

Also the filename for Installation is not found by the nav section as it should be installation.md rather than Installation.md


Error: Uncommitted change(s) has been found!

Describe the bug
I am trying to do a fail-on-diff check for a terraform module doc on a pull request. The GHA fails with
 * [new tag]         1.0.0      -> 1.0.0
 * [new tag]         1.1.0      -> 1.1.0
::debug working_dir=.
::debug config_file=.terraform-docs.yml
::debug output_mode=replace
::debug output_file=README.md
::debug terraform-docs markdown table --config .terraform-docs.yml --output-mode replace --output-file README.md --output-template
{{ .Content }}
 .
README.md updated successfully
::debug No change in ./ detected

Error: Uncommitted change(s) has been found!

There is no change between my current README.md and the generated one (well, there shouldn't be in theory).

How can we reproduce it?
workflow
name: 'terraform docs'

on:
  pull_request:

permissions:
  contents: read

jobs:
  docs:
    runs-on: ubuntu-latest
    steps:
    - uses: actions/checkout@v3
      with:
        ref: ${{ github.event.pull_request.head.ref }}

    - name: Generate TF Docs
      uses<EMAIL_ADDRESS>      with:
        config-file: .terraform-docs.yml
        working-dir: .
        output-file: README.md
        output-method: replace
        fail-on-diff: true

config
formatter: markdown table
header-from: main.tf
footer-from: ""
sections:
  show:
    - all
output:
  file: README.md
  mode: replace
  template: |-

    {{ .Content }}

sort:
  enabled: true
  by: required

settings:
  anchor: true
  indent: 2
  escape: false
  default: true
  required: true
  type: true

Environment information

I've also attempted to manually install terraform docs:
workflow
jobs:
  docs:
    runs-on: ubuntu-latest
    steps:
      - name: Checkout
        uses: actions/checkout@v3
        with:
          ref: ${{ github.event.pull_request.head.sha }}

      - name: Check README.md is up to date
        run: |
            curl -Lo ./terraform-docs.tar.gz https://github.com/terraform-docs/terraform-docs/releases/download/v0.17.0/terraform-docs-v0.17.0-linux-amd64.tar.gz
            tar -xzf terraform-docs.tar.gz
            chmod +x terraform-docs
            ./terraform-docs . --output-check

output
Run curl -Lo ./terraform-docs.tar.gz https://github.com/terraform-docs/terraform-docs/releases/download/v0.17.0/terraform-docs-v0.17.0-linux-amd64.tar.gz
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed

  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0

100 6014k  100 6014k    0     0  19.7M      0 --:--:-- --:--:-- --:--:-- 19.7M
Error: README.md is out of date
Error: Process completed with exit code 1.

But when I run it locally
» terraform-docs . --output-check
README.md is up to date

I'm not sure what the remote is picking up that's causing a difference...

I saved the results the remote is giving me and then did a diff with my local copy:
diff README.md README2.md
< |  [google](#provider_google) | 4.84.0 |
< |  [google-beta](#provider_google-beta) | 4.84.0 |
---
> |  [google](#provider_google) | < 5.0 |
> |  [google-beta](#provider_google-beta) | < 5.0 |

🤔 why

AHA!
if I run terraform-docs without initialising terraform terraform init it takes the exact provider version from my terraform. If I initialise first, it uses whatever it downloads which happened to be 4.84.0.
So locally I had initialised, but remotely its just running terraform-docs as is.

Was running into the same issue. Ran terraform-docs locally but the github actions was failing with the same Error: Uncommitted change(s) has been found! error.
Because I hadn't committed .terraform-lock.hcl, it wasn't present in GHA and so it uses provider version constraints from the required_providers block, compared to locally where it would use the exact version from .terraform.lock.hcl.
Running rm -r .terraform/ .terraform.lock.hcl locally and then re-running terraform-docs fixed the issue and allowed the README generated locally match what gets generated in GHA.
Thanks @arivictor for the fix 🫡


Allow support for className?

Hi,
To avoid redundancy, it would be better if we could provide a class that could provide;
height, width, backgroundColor, color, margins, padding
Would avoid repeated code too...

Hi bonbonio, you can provide a class by passing className as a prop to the SocialIcon component: <SocialIcon url="https://www.example.com" className="a-custom-class" />. This should give you the flexibility to add custom styles and override styles on the child elements. You can also pass a style object using the style prop on the SocialIcon component.
React docs for className prop: https://reactjs.org/docs/faq-styling.html
React docs for style prop: https://reactjs.org/docs/dom-elements.html#style


Running slow than normal pandas

System information

OS Platform and Distribution (e.g., Linux Ubuntu 16.04):
Modin installed from (source or binary):
Modin version:
Python version:
Exact command to reproduce:

Describe the problem

Source code / logs

First it ran fast then it became dead slow. Anything required to do from my side

Hi @pavanpraneeth , can you give the code snippet that you are using, please?

import os
from distributed import Client
Client(n_workers=10)
import modin.pandas as pd
global df1
s=time.time()
df1=pd.read_parquet('class1_sec_out.parquet.gzip')
e=time.time()
print(e-s)
df2=pd.read_parquet('hcc_class1.parquet.gzip')
df2.loc[:,'flag'] = ''
df2.loc[:,'sec'] = ''
df2.loc[:,'sec_std'] = ''
from tqdm import tqdm
import warnings
warnings.filterwarnings('ignore')
e=time.time()
def hcc(df2):
for i in tqdm(range(len(df2))):
temp=df1[df1['document_id']==df2['document_id'][i]]
temp.reset_index(drop=True,inplace=True)
sub_temp=temp[temp['Section_start']<=df2['start_char'][i]]
sub_temp.reset_index(drop=True,inplace=True)
    if len(sub_temp) > 0 :
        if (sub_temp['Section_end'].iloc[-1] >= df2['end_char'][i]):

            s1=sub_temp['Section'].iloc[-1]
            s2=sub_temp['Section_Standardized'].iloc[-1]
            df2['flag'][i]=1
            df2['sec'][i]=s1
            df2['sec_std'][i]=s2
        else:
            df2['flag'][i]=0
            df2['sec'][i]=''
            df2['sec_std'][i]=''

    else:
            df2['flag'][i]=0
            df2['sec'][i]=''
            df2['sec_std'][i]=''
return df2

Hi @pavanpraneeth , can you give the code snippet that you are using, please?

hi please check

@pavanpraneeth , I would like to clarify what issue you are experiencing. I see you measured this line df1=pd.read_parquet('class1_sec_out.parquet.gzip') and print the time via print(e-s). When does this become slower?

@pavanpraneeth , I would like to clarify what issue you are experiencing. I see you measured this line df1=pd.read_parquet('class1_sec_out.parquet.gzip') and print the time via print(e-s). When does this become slower?

it just ran well in the morning, normally by pandas it take 2 secs to read this ,with modin it is taking 4 sec and rest function is aslo exec slowly

@pavanpraneeth , I would like to clarify what issue you are experiencing. I see you measured this line df1=pd.read_parquet('class1_sec_out.parquet.gzip') and print the time via print(e-s). When does this become slower?

it just ran well in the morning, normally by pandas it take 2 secs to read this ,with modin it is taking 4 sec and rest function is aslo exec slowly

when i run this line 2 times, it is fast for second time

@pavanpraneeth , I would like to clarify what issue you are experiencing. I see you measured this line df1=pd.read_parquet('class1_sec_out.parquet.gzip') and print the time via print(e-s). When does this become slower?

it just ran well in the morning, normally by pandas it take 2 secs to read this ,with modin it is taking 4 sec and rest function is aslo exec slowly

Hi @YarShev please reply fast

can u please suggest some solution to engine initialization?
also size is(505421,22)
please it will be great

also should i use loc instead of indexing

can u please suggest some solution to engine initialization?
also size is(505421,22)
please it will be great

You can initialize an engine yourself, i.e. do as follows:
# in case of Dask engine
from distributed.client import Client
client = Client(n_workers="your_number")
# in case of Ray engine
import ray
ray.init(num_cpus="your_number")

In that case two identical Modin operations that follow to each other should have +/- the same performance.

also should i use loc instead of indexing

loc is one of the indexing's way. Please, refer to this comment about loc.

@YarShev @devin-petersohn
I have a dataframe having >100k records, it has 10-15 columns which needs to be coalesced, I used following code:
for COL in [cols_to_be_coalesced]:
df['COL'] = np.where(df['COL']!='', df['COL'], df['COL_X'])
Here if df is pandas dataframe, it executes it in ~2 minutes but of df is modin dataframe, it takes ~30 minutes.
Can you please suggest equivalent faster alternative of np.where for modin dataframe ?

@mivikasgarud I answered on the mailing list, copying here:
Thanks for the question. It's a good point, we don't currently support the numpy functionalities, but there might be a way we can with NEP18. If you are comfortable, it would be nice to add an issue to the GitHub repo to support NEP18 in Modin.
A small rewrite to enable the parallelism of the low level Modin implementation:
def apply_func(df):
    for COL in [cols_to_be_coalesced]:
        df['COL'] = np.where(df['COL']!='', df['COL'], df['COL_X'])

df.apply(lambda s: apply_func(s.to_frame(), axis=1)

Let me know how it goes!

Hi folks! It seems like the performance issues in question have hopefully been resolved by Devin's code snippet above, so I'm marking this as closed! If folks have further questions, please feel free to reopen this issue, or to open a new issue!


Connecting to Greenplum ERROR

[Y ] I have checked the superset logs for python stacktraces and included it here as text if any
[N ] I have reproduced the issue with at least the latest released version of superset
[Y ] I have checked the issue tracker for the same issue and I haven't found one similar

Superset version
0.15.4
Steps to reproduce
Greenplum v4.3 base on PostgreSQL 8.2
psycopg2 2.7 & 2.6.2 & 2.6.1
SQLAlchemy URI prefix: postgresql+psycopg2://
When I creating the database connection, I use these information to connect to Greenplum, it always raise error information:
(psycopg2.ProgrammingError) column "typarray" does not exist LINE 1: SELECT t.oid, typarray
I have try to psycopg2 version: 2.7 or 2.6.2 or 2.6.1, same error message.
try to connect to PostgreSQL 9.4, It works well.

That's a psycopg2 error, not a superset one.

full stacktrace would help


Fixed bug with Unix

Similar to #4, the same thing happens with Unix / Linux OS's. This fixes that bug by adding a check for Unix based systems as well. This will resolve #5

Thank you for this great PR


Prefab_LoadNFT

NFT Loader Prefab.
Loads an NFT image and metadata from the editor fields - contract address and token ID.
Also adding ThirdwebManager - minimal script to have an SDK Instance available across scripts.
Having a "Core" or "Manager" script is standard across SDKs, and makes things simpler for everyone imo.
Accessible through ThirdwebManager.Instance.SDK alongside potentially interesting SDK-wide data like GetChainID.
Also removed custom log functions for simplicity.
Fixed up the scene a little.

Added ERC1155 support through a simple bool flag. The NFT struct doesn't seem like a good fit for input, only output - correct me if I'm wrong.

Hm ok I see I'll turn this into a multi NFT loader no problem

I'll make this an NFT Prefab that you can instantiate and load from script, and make another prefab to load multiple NFTs with additional parameters

Introducing: Prefab_NFTLoader
Uses NFTQuery - which consists of a list of single, multiple and owned queries (Get, GetAll and GetOwned)
Respectively loads Prefab_NFT into a scroll view after querying all the NFTs set in the editor!

Prefab_NFT:
Displays an NFT by passing calling LoadNFT through script.

Instantiate this Prefab
Get its Prefab_NFT component
Call the LoadNFT(NFT) function to display your fetched NFT's images

Prefab_NFTLoader:
Standalone Drag & Drop grid/scroll view of NFTs you ask it to display.

Go to the prefab's "Settings" in the Inspector
Load specific NFTs with token ID
Load a specific range of NFTs
Load NFTs owned by a specific wallet
Or any combination of the above - they will all be displayed automatically in a grid view with vertical scroll!


Adding Git repo takes precendence over HTTP

Setup

Rancher version: 2.8-head
Rancher UI Extensions: release-2.8 832a24819
Browser type & version: Firefox

Describe the bug

When adding a repo, git repo takes precedence over the http repo, if both the forms are filled.
To Reproduce

Go to "Repository: Create" form.
Select target: Git repo
Enter the git repo and branch name.
Select target: http
Enter the http URL.
Hit Save.

Result
The repo pointed by git is taken into account.
Expected Result

The HTTP repo should have been used.
Screenshots

Screencast from 03-26-2024 12:59:12 PM.webm
Additional context

Thanks for reporting this issue @valaparthvi . However, the issue was implicity fixed in https://github.com/rancher/dashboard/pull/10325 and will be available in v2.9.0.
CLosing as resolved.


Setup Let's Encrypt

Configure node.js to redirect 80 to 443, and encrypt 443 with Let's Encrypt.

https://github.com/Daplie/letsencrypt-express
Drop into lib/app.js in the initialize() method.


StyleCop for Resharper 2016.1 code cleanup header/doc

I have strange problem with insterting docs and header.
I have StyleCopeAnlayzers added to project.
If there is no summary for constructor, code cleanup removes header and do not insert default summary.
However if there is even empty summary for contructor, code cleanup insert file header. But still not insterts default default constructor documenation.

I am seeing the exact same behaviour
R# 2016.1.2 / StyleCop by Jetbrains 2016.1.0

Do you have a small project I can test this on, please?

Hello
I'm trying to reproduce this issue with small app, and latest reshaper 2016.2 and stylecop 2016.2 and cannot. Looks like issue is solved. I will monitor and let you know, if it happen again

Cool, thanks! I'll close for now, please reopen if you see it again.


Added Volume Change & Mute on IOS, Droid and UWP

This PR includes changes for IOS, Droid and UWP to implement volume
change and mute.  Forms samples are updated to include volume change and
mute/unmute examples.

Sorry for the double commit in the PR, I forgot I had the "Fix for droid service remaining after app kill" changes already sync'd.  I am not sure how to remove a commit from a PR.
I made the Volume changes partially based on the Issue report by aiviet (https://github.com/martijn00/XamarinMediaManager/issues/263) but that code had a number of other features included and the code had to be manually pulled, changed and added to the existing develop branch code.  Let me know if you see any issues and I'll dig in, I tested both IOS and Android for Video and Audio via the Forms Sample (as well as in my own app)

Hey Mike, those changes are looking good! If you want to separate pr's, you got to commit them on separate branches that are both based from a clean develop branch synced from upstream. I would like to have a chat with you to talk about some of my plans and see if we can work together. Are you on the xamarinchat slack room? If not join at https://xamarinchat.herokuapp.com and dm me at martijn00.


Failed to load API definition, Unauthorized... (Foxx Swagger API)

my environment running ArangoDB
I'm using the latest ArangoDB of the respective release series:

[x] 3.3

Mode:

[x] Single-Server

Storage-Engine:

[x] mmfiles

On this operating system:

[x] Windows, version: 10 Pro, Version 1709, Build 16299.125

Foxx
this is a web interface-related issue:
I'm using the web interface with this browser:  Chrome (Version 63.0.3239.132)    running on this OS: Windows  10 Pro (same as above)

[x] authentication is enabled?
[ ] using the cluster?
[ ] _system database?

These are the steps to reproduce:

open the browser on http://<IP_ADDRESS>:8529
log in as anyone (used root in screenshots)
use database: Any (used _system in screenshots)
click "Services" on side menu and then "Add Service"
create "New Service", fill with any data, doesn't matter (used "test" for each field in screenshots)
click newly created service then click "API" in the top bar

The following problem occurs:
Newer versions (3.3.3-1 and 3.3.2-3) I receive an error message displayed in the screenshots.  Version number of ArangoDB is Photoshopped in the bottom corner.
Each screenshot was taken with a fresh install of ArangoDB on Windows with the .EXE installer.  Previous versions of ArangoDB were uninstalled prior to installing the next version.

Instead I would be expecting:
ArangoDB version 3.3.2-2 appears to be working as shown in the below screenshot.

It is worth noting that on the newer versions that are not working by default (3.3.3-1 and 3.3.2-3), I am able to get them working by changing "authentication = false".

Hello,
same issue for me, tried creating simple service and tried downloading service: in both cases it was impossible to see the API, but the service interface was visible.


Add a link to the NPM package

Add the link to the npm package (https://www.npmjs.com/package/sbuttons) in README and Get Started page. The link should be under "NPM" in Installation, added on the word "NPM".
For example, in README it's" You can install sButtons using NPM:"

Can I please be assigned to this ?

Hi @crew-guy sure I'll assign you

Hi @shahednasser, is this still open?
If yes, I'd love to work on it

Hi @Caleb335 someone is working on this

Hi @Caleb335 someone is working on this

Isn't this completed ?

@crew-guy no please review my comment on #782

Done. Kindly check out PR #826


Access fields data before form save

I have the following fields as part of my Meteor autoform schema, problem I am facing is that if the user entered many records the form will expand vertically a lot, so I was wondering if there is any way to access the data (specifically records saved under Items) so that I can display them in a table to be easily viewed by the user OR if this is not possible, is there anyway I can have each of the ITEMS sub-fields placed in a separate column so that they can all come on one line? Thanks
  ITEMS: {
      type: Array,
      label: "Invoice Items",
      optional: true
  },
  "ITEMS.$": {
      type: Object
  },
  "ITEMS.$.ItemCode": {
      type: String,
      label: "Item Code"
  },
  "ITEMS.$.ItemName": {
      type: String,
      label: "Item Name"
  },
  "ITEMS.$.ItemQty": {
      type: String,
      label: "Item Qty"
  },
  "ITEMS.$.ItemPrice": {
      type: String,
      label: "Item Price"
  },
  "ITEMS.$.ItemDiscount": {
      type: String,
      label: "Item Discount"
  },
  "ITEMS.$.ItemTotal": {
      type: String,
      label: "Total"
  }

https://github.com/aldeed/meteor-autoform#getting-current-field-values
So something like:
AutoForm.getFormValues('my-form-id');

Would return an object containing all the values entered so far in the form.


Update to match changelog dated 1/12/2017

Remove all files and references to twitter lead generation cards as this
feature has been deprecated entirely from Mailchimp
Update documentation to remove references to twitter lead generation cards
Increment version number to 2.0.5, no minor version change because while
features were removed with this change, they were done on the side of the
vendor interface and do not damage backwards compatibility any more than
attempting to use those endpoints on an older version will

Thanks 👍


Android build error after updating from RN v51 to v55

This is the error that I get when I am building the application or if I try to run it using react-native run-android

Fixed it, it was an issue with the build.gradle file.


I will recieved data when come from firebase console

From @Pradipkoravi on September 20, 2018 6:14
URL: https://pub.dartlang.org/packages/firebase_messaging
{notification: {body: this is test notification.Run the following command to create the client for our notes app.This shou..., title: Test}, data: {ni: 1, text: notification, color: red, image: image ur, title: Test}}
but I need to get individual value from it
Copied from original issue: dart-lang/pub-dartlang-dart#1634

Please add the output of flutter doctor -v.
What do you mean by "individual value"?
Where do you want to get it?
Please consider asking support questions in one of the other channels listed at http://flutter.io/support .

Without additional information, we are unfortunately not sure how to resolve this issue. We are therefore reluctantly going to close this bug for now. Please don't hesitate to comment on the bug if you have any more information for us; we will reopen it right away!
Thanks for your contribution.